cc4dc8c4f889d8a7bb1be9b6160caf7b322ac6cf:2024-02-14:33136
=== RUN TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress
=== CONT TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run: kubectl --context addons-800005 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run: kubectl --context addons-800005 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run: kubectl --context addons-800005 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [4b693d7f-0b6e-4400-b5a4-bfbad8002db8] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [4b693d7f-0b6e-4400-b5a4-bfbad8002db8] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 15.003403501s
addons_test.go:262: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-800005 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m11.053374755s)
** stderr **
ssh: Process exited with status 28
** /stderr **
addons_test.go:278: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:286: (dbg) Run: kubectl --context addons-800005 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 ip
addons_test.go:297: (dbg) Run: nslookup hello-john.test 192.168.39.41
addons_test.go:306: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:306: (dbg) Done: out/minikube-linux-amd64 -p addons-800005 addons disable ingress-dns --alsologtostderr -v=1: (1.218307989s)
addons_test.go:311: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 addons disable ingress --alsologtostderr -v=1
addons_test.go:311: (dbg) Done: out/minikube-linux-amd64 -p addons-800005 addons disable ingress --alsologtostderr -v=1: (7.913502884s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-800005 -n addons-800005
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-800005 logs -n 25: (1.398335548s)
helpers_test.go:252: TestAddons/parallel/Ingress logs:
-- stdout --
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete | -p download-only-867870 | download-only-867870 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| delete | -p download-only-558086 | download-only-558086 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| delete | -p download-only-082683 | download-only-082683 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| delete | -p download-only-867870 | download-only-867870 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| start | --download-only -p | binary-mirror-299732 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | binary-mirror-299732 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:39433 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p binary-mirror-299732 | binary-mirror-299732 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| addons | disable dashboard -p | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | addons-800005 | | | | | |
| addons | enable dashboard -p | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | addons-800005 | | | | | |
| start | -p addons-800005 --wait=true | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:50 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| | --addons=helm-tiller | | | | | |
| addons | addons-800005 addons | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | disable metrics-server | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ssh | addons-800005 ssh cat | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | /opt/local-path-provisioner/pvc-e70ed7af-dbd6-450e-8554-0f8d99cefa0f_default_test-pvc/file1 | | | | | |
| addons | addons-800005 addons disable | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | disable cloud-spanner -p | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | addons-800005 | | | | | |
| addons | enable headlamp | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | -p addons-800005 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-800005 ip | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| addons | addons-800005 addons disable | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | disable nvidia-device-plugin | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | -p addons-800005 | | | | | |
| addons | disable inspektor-gadget -p | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | addons-800005 | | | | | |
| addons | addons-800005 addons disable | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | 14 Feb 24 02:51 UTC |
| | helm-tiller --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| ssh | addons-800005 ssh curl -s | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:51 UTC | |
| | http://127.0.0.1/ -H 'Host: | | | | | |
| | nginx.example.com' | | | | | |
| addons | addons-800005 addons | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:52 UTC | 14 Feb 24 02:52 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-800005 addons | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:52 UTC | 14 Feb 24 02:52 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-800005 ip | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:54 UTC | 14 Feb 24 02:54 UTC |
| addons | addons-800005 addons disable | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:54 UTC | 14 Feb 24 02:54 UTC |
| | ingress-dns --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-800005 addons disable | addons-800005 | jenkins | v1.32.0 | 14 Feb 24 02:54 UTC | 14 Feb 24 02:54 UTC |
| | ingress --alsologtostderr -v=1 | | | | | |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 02:48:26
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 02:48:26.150186 1495417 out.go:291] Setting OutFile to fd 1 ...
I0214 02:48:26.150454 1495417 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 02:48:26.150464 1495417 out.go:304] Setting ErrFile to fd 2...
I0214 02:48:26.150468 1495417 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 02:48:26.150665 1495417 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 02:48:26.151335 1495417 out.go:298] Setting JSON to false
I0214 02:48:26.152331 1495417 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":19854,"bootTime":1707859053,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 02:48:26.152392 1495417 start.go:138] virtualization: kvm guest
I0214 02:48:26.155040 1495417 out.go:177] * [addons-800005] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 02:48:26.156633 1495417 out.go:177] - MINIKUBE_LOCATION=17909
I0214 02:48:26.156666 1495417 notify.go:220] Checking for updates...
I0214 02:48:26.158125 1495417 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 02:48:26.159952 1495417 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 02:48:26.161566 1495417 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 02:48:26.162974 1495417 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 02:48:26.164474 1495417 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 02:48:26.166126 1495417 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 02:48:26.197689 1495417 out.go:177] * Using the kvm2 driver based on user configuration
I0214 02:48:26.199140 1495417 start.go:296] selected driver: kvm2
I0214 02:48:26.199155 1495417 start.go:900] validating driver "kvm2" against <nil>
I0214 02:48:26.199174 1495417 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 02:48:26.199909 1495417 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 02:48:26.199997 1495417 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 02:48:26.213995 1495417 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 02:48:26.214080 1495417 start_flags.go:308] no existing cluster config was found, will generate one from the flags
I0214 02:48:26.214304 1495417 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 02:48:26.214372 1495417 cni.go:84] Creating CNI manager for ""
I0214 02:48:26.214392 1495417 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 02:48:26.214403 1495417 start_flags.go:317] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0214 02:48:26.214484 1495417 start.go:339] cluster config:
{Name:addons-800005 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-800005 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c
rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg
entPID:0 GPUs:}
I0214 02:48:26.214601 1495417 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 02:48:26.217672 1495417 out.go:177] * Starting "addons-800005" primary control-plane node in "addons-800005" cluster
I0214 02:48:26.219040 1495417 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 02:48:26.219073 1495417 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 02:48:26.219086 1495417 cache.go:56] Caching tarball of preloaded images
I0214 02:48:26.219156 1495417 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 02:48:26.219170 1495417 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 02:48:26.219499 1495417 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/config.json ...
I0214 02:48:26.219525 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/config.json: {Name:mk17df9c73de3b2fd408d87740270b77becb337c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:26.219685 1495417 start.go:360] acquireMachinesLock for addons-800005: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 02:48:26.219745 1495417 start.go:364] duration metric: took 42.989µs to acquireMachinesLock for "addons-800005"
I0214 02:48:26.219776 1495417 start.go:93] Provisioning new machine with config: &{Name:addons-800005 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:addons-800005 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M
ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 02:48:26.219840 1495417 start.go:125] createHost starting for "" (driver="kvm2")
I0214 02:48:26.221678 1495417 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
I0214 02:48:26.221836 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:48:26.221905 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:48:26.235735 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39559
I0214 02:48:26.236172 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:48:26.236714 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:48:26.236737 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:48:26.237132 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:48:26.237340 1495417 main.go:141] libmachine: (addons-800005) Calling .GetMachineName
I0214 02:48:26.237487 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:48:26.237638 1495417 start.go:159] libmachine.API.Create for "addons-800005" (driver="kvm2")
I0214 02:48:26.237670 1495417 client.go:168] LocalClient.Create starting
I0214 02:48:26.237707 1495417 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 02:48:26.299035 1495417 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 02:48:26.502689 1495417 main.go:141] libmachine: Running pre-create checks...
I0214 02:48:26.502725 1495417 main.go:141] libmachine: (addons-800005) Calling .PreCreateCheck
I0214 02:48:26.503372 1495417 main.go:141] libmachine: (addons-800005) Calling .GetConfigRaw
I0214 02:48:26.503891 1495417 main.go:141] libmachine: Creating machine...
I0214 02:48:26.503910 1495417 main.go:141] libmachine: (addons-800005) Calling .Create
I0214 02:48:26.504107 1495417 main.go:141] libmachine: (addons-800005) Creating KVM machine...
I0214 02:48:26.505559 1495417 main.go:141] libmachine: (addons-800005) DBG | found existing default KVM network
I0214 02:48:26.506326 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:26.506128 1495439 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015a50}
I0214 02:48:26.506351 1495417 main.go:141] libmachine: (addons-800005) DBG | created network xml:
I0214 02:48:26.506460 1495417 main.go:141] libmachine: (addons-800005) DBG | <network>
I0214 02:48:26.506488 1495417 main.go:141] libmachine: (addons-800005) DBG | <name>mk-addons-800005</name>
I0214 02:48:26.506501 1495417 main.go:141] libmachine: (addons-800005) DBG | <dns enable='no'/>
I0214 02:48:26.506514 1495417 main.go:141] libmachine: (addons-800005) DBG |
I0214 02:48:26.506529 1495417 main.go:141] libmachine: (addons-800005) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0214 02:48:26.506541 1495417 main.go:141] libmachine: (addons-800005) DBG | <dhcp>
I0214 02:48:26.506556 1495417 main.go:141] libmachine: (addons-800005) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0214 02:48:26.506573 1495417 main.go:141] libmachine: (addons-800005) DBG | </dhcp>
I0214 02:48:26.506587 1495417 main.go:141] libmachine: (addons-800005) DBG | </ip>
I0214 02:48:26.506598 1495417 main.go:141] libmachine: (addons-800005) DBG |
I0214 02:48:26.506618 1495417 main.go:141] libmachine: (addons-800005) DBG | </network>
I0214 02:48:26.506633 1495417 main.go:141] libmachine: (addons-800005) DBG |
I0214 02:48:26.512307 1495417 main.go:141] libmachine: (addons-800005) DBG | trying to create private KVM network mk-addons-800005 192.168.39.0/24...
I0214 02:48:26.584287 1495417 main.go:141] libmachine: (addons-800005) DBG | private KVM network mk-addons-800005 192.168.39.0/24 created
I0214 02:48:26.584403 1495417 main.go:141] libmachine: (addons-800005) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005 ...
I0214 02:48:26.584436 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:26.584233 1495439 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 02:48:26.584455 1495417 main.go:141] libmachine: (addons-800005) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 02:48:26.584492 1495417 main.go:141] libmachine: (addons-800005) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 02:48:26.820780 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:26.820616 1495439 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa...
I0214 02:48:26.935128 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:26.934984 1495439 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/addons-800005.rawdisk...
I0214 02:48:26.935165 1495417 main.go:141] libmachine: (addons-800005) DBG | Writing magic tar header
I0214 02:48:26.935177 1495417 main.go:141] libmachine: (addons-800005) DBG | Writing SSH key tar header
I0214 02:48:26.935186 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:26.935116 1495439 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005 ...
I0214 02:48:26.935279 1495417 main.go:141] libmachine: (addons-800005) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005
I0214 02:48:26.935309 1495417 main.go:141] libmachine: (addons-800005) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 02:48:26.935325 1495417 main.go:141] libmachine: (addons-800005) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 02:48:26.935336 1495417 main.go:141] libmachine: (addons-800005) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 02:48:26.935346 1495417 main.go:141] libmachine: (addons-800005) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005 (perms=drwx------)
I0214 02:48:26.935358 1495417 main.go:141] libmachine: (addons-800005) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 02:48:26.935367 1495417 main.go:141] libmachine: (addons-800005) DBG | Checking permissions on dir: /home/jenkins
I0214 02:48:26.935380 1495417 main.go:141] libmachine: (addons-800005) DBG | Checking permissions on dir: /home
I0214 02:48:26.935400 1495417 main.go:141] libmachine: (addons-800005) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 02:48:26.935414 1495417 main.go:141] libmachine: (addons-800005) DBG | Skipping /home - not owner
I0214 02:48:26.935425 1495417 main.go:141] libmachine: (addons-800005) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 02:48:26.935469 1495417 main.go:141] libmachine: (addons-800005) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 02:48:26.935500 1495417 main.go:141] libmachine: (addons-800005) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 02:48:26.935519 1495417 main.go:141] libmachine: (addons-800005) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 02:48:26.935533 1495417 main.go:141] libmachine: (addons-800005) Creating domain...
I0214 02:48:26.937211 1495417 main.go:141] libmachine: (addons-800005) define libvirt domain using xml:
I0214 02:48:26.937239 1495417 main.go:141] libmachine: (addons-800005) <domain type='kvm'>
I0214 02:48:26.937272 1495417 main.go:141] libmachine: (addons-800005) <name>addons-800005</name>
I0214 02:48:26.937287 1495417 main.go:141] libmachine: (addons-800005) <memory unit='MiB'>4000</memory>
I0214 02:48:26.937297 1495417 main.go:141] libmachine: (addons-800005) <vcpu>2</vcpu>
I0214 02:48:26.937302 1495417 main.go:141] libmachine: (addons-800005) <features>
I0214 02:48:26.937320 1495417 main.go:141] libmachine: (addons-800005) <acpi/>
I0214 02:48:26.937345 1495417 main.go:141] libmachine: (addons-800005) <apic/>
I0214 02:48:26.937351 1495417 main.go:141] libmachine: (addons-800005) <pae/>
I0214 02:48:26.937359 1495417 main.go:141] libmachine: (addons-800005)
I0214 02:48:26.937368 1495417 main.go:141] libmachine: (addons-800005) </features>
I0214 02:48:26.937375 1495417 main.go:141] libmachine: (addons-800005) <cpu mode='host-passthrough'>
I0214 02:48:26.937383 1495417 main.go:141] libmachine: (addons-800005)
I0214 02:48:26.937388 1495417 main.go:141] libmachine: (addons-800005) </cpu>
I0214 02:48:26.937400 1495417 main.go:141] libmachine: (addons-800005) <os>
I0214 02:48:26.937407 1495417 main.go:141] libmachine: (addons-800005) <type>hvm</type>
I0214 02:48:26.937413 1495417 main.go:141] libmachine: (addons-800005) <boot dev='cdrom'/>
I0214 02:48:26.937421 1495417 main.go:141] libmachine: (addons-800005) <boot dev='hd'/>
I0214 02:48:26.937429 1495417 main.go:141] libmachine: (addons-800005) <bootmenu enable='no'/>
I0214 02:48:26.937435 1495417 main.go:141] libmachine: (addons-800005) </os>
I0214 02:48:26.937443 1495417 main.go:141] libmachine: (addons-800005) <devices>
I0214 02:48:26.937448 1495417 main.go:141] libmachine: (addons-800005) <disk type='file' device='cdrom'>
I0214 02:48:26.937460 1495417 main.go:141] libmachine: (addons-800005) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/boot2docker.iso'/>
I0214 02:48:26.937471 1495417 main.go:141] libmachine: (addons-800005) <target dev='hdc' bus='scsi'/>
I0214 02:48:26.937477 1495417 main.go:141] libmachine: (addons-800005) <readonly/>
I0214 02:48:26.937486 1495417 main.go:141] libmachine: (addons-800005) </disk>
I0214 02:48:26.937493 1495417 main.go:141] libmachine: (addons-800005) <disk type='file' device='disk'>
I0214 02:48:26.937509 1495417 main.go:141] libmachine: (addons-800005) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 02:48:26.937557 1495417 main.go:141] libmachine: (addons-800005) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/addons-800005.rawdisk'/>
I0214 02:48:26.937585 1495417 main.go:141] libmachine: (addons-800005) <target dev='hda' bus='virtio'/>
I0214 02:48:26.937605 1495417 main.go:141] libmachine: (addons-800005) </disk>
I0214 02:48:26.937618 1495417 main.go:141] libmachine: (addons-800005) <interface type='network'>
I0214 02:48:26.937631 1495417 main.go:141] libmachine: (addons-800005) <source network='mk-addons-800005'/>
I0214 02:48:26.937645 1495417 main.go:141] libmachine: (addons-800005) <model type='virtio'/>
I0214 02:48:26.937659 1495417 main.go:141] libmachine: (addons-800005) </interface>
I0214 02:48:26.937677 1495417 main.go:141] libmachine: (addons-800005) <interface type='network'>
I0214 02:48:26.937693 1495417 main.go:141] libmachine: (addons-800005) <source network='default'/>
I0214 02:48:26.937706 1495417 main.go:141] libmachine: (addons-800005) <model type='virtio'/>
I0214 02:48:26.937720 1495417 main.go:141] libmachine: (addons-800005) </interface>
I0214 02:48:26.937731 1495417 main.go:141] libmachine: (addons-800005) <serial type='pty'>
I0214 02:48:26.937745 1495417 main.go:141] libmachine: (addons-800005) <target port='0'/>
I0214 02:48:26.937757 1495417 main.go:141] libmachine: (addons-800005) </serial>
I0214 02:48:26.937772 1495417 main.go:141] libmachine: (addons-800005) <console type='pty'>
I0214 02:48:26.937786 1495417 main.go:141] libmachine: (addons-800005) <target type='serial' port='0'/>
I0214 02:48:26.937799 1495417 main.go:141] libmachine: (addons-800005) </console>
I0214 02:48:26.937812 1495417 main.go:141] libmachine: (addons-800005) <rng model='virtio'>
I0214 02:48:26.937834 1495417 main.go:141] libmachine: (addons-800005) <backend model='random'>/dev/random</backend>
I0214 02:48:26.937847 1495417 main.go:141] libmachine: (addons-800005) </rng>
I0214 02:48:26.937854 1495417 main.go:141] libmachine: (addons-800005)
I0214 02:48:26.937867 1495417 main.go:141] libmachine: (addons-800005)
I0214 02:48:26.937875 1495417 main.go:141] libmachine: (addons-800005) </devices>
I0214 02:48:26.937881 1495417 main.go:141] libmachine: (addons-800005) </domain>
I0214 02:48:26.937893 1495417 main.go:141] libmachine: (addons-800005)
I0214 02:48:26.942862 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:a0:e7:83 in network default
I0214 02:48:26.943526 1495417 main.go:141] libmachine: (addons-800005) Ensuring networks are active...
I0214 02:48:26.943546 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:26.944239 1495417 main.go:141] libmachine: (addons-800005) Ensuring network default is active
I0214 02:48:26.944515 1495417 main.go:141] libmachine: (addons-800005) Ensuring network mk-addons-800005 is active
I0214 02:48:26.945074 1495417 main.go:141] libmachine: (addons-800005) Getting domain xml...
I0214 02:48:26.945812 1495417 main.go:141] libmachine: (addons-800005) Creating domain...
I0214 02:48:28.125812 1495417 main.go:141] libmachine: (addons-800005) Waiting to get IP...
I0214 02:48:28.126549 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:28.126966 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:28.127001 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:28.126943 1495439 retry.go:31] will retry after 254.074021ms: waiting for machine to come up
I0214 02:48:28.382550 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:28.383036 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:28.383078 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:28.383018 1495439 retry.go:31] will retry after 390.098855ms: waiting for machine to come up
I0214 02:48:28.774430 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:28.774873 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:28.774927 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:28.774838 1495439 retry.go:31] will retry after 357.836834ms: waiting for machine to come up
I0214 02:48:29.134575 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:29.135020 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:29.135046 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:29.135007 1495439 retry.go:31] will retry after 402.59524ms: waiting for machine to come up
I0214 02:48:29.539753 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:29.540193 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:29.540224 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:29.540123 1495439 retry.go:31] will retry after 477.742486ms: waiting for machine to come up
I0214 02:48:30.019559 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:30.019953 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:30.019980 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:30.019922 1495439 retry.go:31] will retry after 668.638275ms: waiting for machine to come up
I0214 02:48:30.689799 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:30.690145 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:30.690178 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:30.690092 1495439 retry.go:31] will retry after 912.046933ms: waiting for machine to come up
I0214 02:48:31.603662 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:31.604070 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:31.604102 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:31.604009 1495439 retry.go:31] will retry after 915.324282ms: waiting for machine to come up
I0214 02:48:32.521164 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:32.521707 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:32.521732 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:32.521631 1495439 retry.go:31] will retry after 1.377183216s: waiting for machine to come up
I0214 02:48:33.901150 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:33.901589 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:33.901621 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:33.901533 1495439 retry.go:31] will retry after 1.846515799s: waiting for machine to come up
I0214 02:48:35.750447 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:35.750904 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:35.750929 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:35.750836 1495439 retry.go:31] will retry after 2.700434267s: waiting for machine to come up
I0214 02:48:38.454159 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:38.454648 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:38.454678 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:38.454588 1495439 retry.go:31] will retry after 2.333150079s: waiting for machine to come up
I0214 02:48:40.790292 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:40.790750 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:40.790785 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:40.790706 1495439 retry.go:31] will retry after 3.31441102s: waiting for machine to come up
I0214 02:48:44.110181 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:44.110634 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find current IP address of domain addons-800005 in network mk-addons-800005
I0214 02:48:44.110662 1495417 main.go:141] libmachine: (addons-800005) DBG | I0214 02:48:44.110585 1495439 retry.go:31] will retry after 4.166210196s: waiting for machine to come up
I0214 02:48:48.278008 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.278479 1495417 main.go:141] libmachine: (addons-800005) Found IP for machine: 192.168.39.41
I0214 02:48:48.278517 1495417 main.go:141] libmachine: (addons-800005) Reserving static IP address...
I0214 02:48:48.278528 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has current primary IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.278824 1495417 main.go:141] libmachine: (addons-800005) DBG | unable to find host DHCP lease matching {name: "addons-800005", mac: "52:54:00:89:94:78", ip: "192.168.39.41"} in network mk-addons-800005
I0214 02:48:48.351092 1495417 main.go:141] libmachine: (addons-800005) DBG | Getting to WaitForSSH function...
I0214 02:48:48.351151 1495417 main.go:141] libmachine: (addons-800005) Reserved static IP address: 192.168.39.41
I0214 02:48:48.351166 1495417 main.go:141] libmachine: (addons-800005) Waiting for SSH to be available...
I0214 02:48:48.353710 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.354116 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:minikube Clientid:01:52:54:00:89:94:78}
I0214 02:48:48.354147 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.354256 1495417 main.go:141] libmachine: (addons-800005) DBG | Using SSH client type: external
I0214 02:48:48.354285 1495417 main.go:141] libmachine: (addons-800005) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa (-rw-------)
I0214 02:48:48.354327 1495417 main.go:141] libmachine: (addons-800005) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.41 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 02:48:48.354347 1495417 main.go:141] libmachine: (addons-800005) DBG | About to run SSH command:
I0214 02:48:48.354369 1495417 main.go:141] libmachine: (addons-800005) DBG | exit 0
I0214 02:48:48.444889 1495417 main.go:141] libmachine: (addons-800005) DBG | SSH cmd err, output: <nil>:
I0214 02:48:48.445180 1495417 main.go:141] libmachine: (addons-800005) KVM machine creation complete!
I0214 02:48:48.445558 1495417 main.go:141] libmachine: (addons-800005) Calling .GetConfigRaw
I0214 02:48:48.446127 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:48:48.446339 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:48:48.446501 1495417 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 02:48:48.446516 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:48:48.447746 1495417 main.go:141] libmachine: Detecting operating system of created instance...
I0214 02:48:48.447766 1495417 main.go:141] libmachine: Waiting for SSH to be available...
I0214 02:48:48.447776 1495417 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 02:48:48.447790 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:48.449907 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.450204 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:48.450238 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.450295 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:48.450482 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:48.450641 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:48.450828 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:48.451002 1495417 main.go:141] libmachine: Using SSH client type: native
I0214 02:48:48.451504 1495417 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 02:48:48.451521 1495417 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 02:48:48.568194 1495417 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 02:48:48.568219 1495417 main.go:141] libmachine: Detecting the provisioner...
I0214 02:48:48.568228 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:48.570977 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.571316 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:48.571348 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.571544 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:48.571760 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:48.571914 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:48.572097 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:48.572299 1495417 main.go:141] libmachine: Using SSH client type: native
I0214 02:48:48.572689 1495417 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 02:48:48.572703 1495417 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 02:48:48.693901 1495417 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 02:48:48.694026 1495417 main.go:141] libmachine: found compatible host: buildroot
I0214 02:48:48.694038 1495417 main.go:141] libmachine: Provisioning with buildroot...
I0214 02:48:48.694047 1495417 main.go:141] libmachine: (addons-800005) Calling .GetMachineName
I0214 02:48:48.694302 1495417 buildroot.go:166] provisioning hostname "addons-800005"
I0214 02:48:48.694331 1495417 main.go:141] libmachine: (addons-800005) Calling .GetMachineName
I0214 02:48:48.694516 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:48.697653 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.698081 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:48.698116 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.698240 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:48.698429 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:48.698605 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:48.698718 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:48.698914 1495417 main.go:141] libmachine: Using SSH client type: native
I0214 02:48:48.699365 1495417 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 02:48:48.699386 1495417 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-800005 && echo "addons-800005" | sudo tee /etc/hostname
I0214 02:48:48.829565 1495417 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-800005
I0214 02:48:48.829608 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:48.832424 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.832793 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:48.832835 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.832994 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:48.833214 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:48.833395 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:48.833534 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:48.833688 1495417 main.go:141] libmachine: Using SSH client type: native
I0214 02:48:48.834055 1495417 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 02:48:48.834074 1495417 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-800005' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-800005/g' /etc/hosts;
else
echo '127.0.1.1 addons-800005' | sudo tee -a /etc/hosts;
fi
fi
I0214 02:48:48.961089 1495417 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 02:48:48.961133 1495417 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 02:48:48.961165 1495417 buildroot.go:174] setting up certificates
I0214 02:48:48.961177 1495417 provision.go:84] configureAuth start
I0214 02:48:48.961188 1495417 main.go:141] libmachine: (addons-800005) Calling .GetMachineName
I0214 02:48:48.961510 1495417 main.go:141] libmachine: (addons-800005) Calling .GetIP
I0214 02:48:48.964401 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.964770 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:48.964795 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.965003 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:48.967361 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.967692 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:48.967716 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:48.967921 1495417 provision.go:143] copyHostCerts
I0214 02:48:48.968041 1495417 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 02:48:48.968243 1495417 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 02:48:48.968476 1495417 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 02:48:48.968589 1495417 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.addons-800005 san=[127.0.0.1 192.168.39.41 addons-800005 localhost minikube]
I0214 02:48:49.083532 1495417 provision.go:177] copyRemoteCerts
I0214 02:48:49.083590 1495417 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 02:48:49.083619 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:49.086180 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.086487 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.086520 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.086698 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:49.086901 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:49.087052 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:49.087193 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:48:49.174662 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 02:48:49.196425 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0214 02:48:49.217660 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 02:48:49.239478 1495417 provision.go:87] duration metric: took 278.285327ms to configureAuth
I0214 02:48:49.239521 1495417 buildroot.go:189] setting minikube options for container-runtime
I0214 02:48:49.239716 1495417 config.go:182] Loaded profile config "addons-800005": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 02:48:49.239808 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:49.242393 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.242733 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.242768 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.242912 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:49.243103 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:49.243226 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:49.243311 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:49.243427 1495417 main.go:141] libmachine: Using SSH client type: native
I0214 02:48:49.243744 1495417 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 02:48:49.243760 1495417 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 02:48:49.553981 1495417 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 02:48:49.554016 1495417 main.go:141] libmachine: Checking connection to Docker...
I0214 02:48:49.554027 1495417 main.go:141] libmachine: (addons-800005) Calling .GetURL
I0214 02:48:49.555371 1495417 main.go:141] libmachine: (addons-800005) DBG | Using libvirt version 6000000
I0214 02:48:49.557867 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.558248 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.558268 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.558517 1495417 main.go:141] libmachine: Docker is up and running!
I0214 02:48:49.558535 1495417 main.go:141] libmachine: Reticulating splines...
I0214 02:48:49.558544 1495417 client.go:171] duration metric: took 23.320862827s to LocalClient.Create
I0214 02:48:49.558573 1495417 start.go:167] duration metric: took 23.320935953s to libmachine.API.Create "addons-800005"
I0214 02:48:49.558587 1495417 start.go:293] postStartSetup for "addons-800005" (driver="kvm2")
I0214 02:48:49.558603 1495417 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 02:48:49.558638 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:48:49.558890 1495417 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 02:48:49.558934 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:49.561002 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.561347 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.561379 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.561504 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:49.561681 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:49.561862 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:49.562005 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:48:49.650457 1495417 ssh_runner.go:195] Run: cat /etc/os-release
I0214 02:48:49.654977 1495417 info.go:137] Remote host: Buildroot 2021.02.12
I0214 02:48:49.655009 1495417 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 02:48:49.655085 1495417 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 02:48:49.655109 1495417 start.go:296] duration metric: took 96.514207ms for postStartSetup
I0214 02:48:49.655148 1495417 main.go:141] libmachine: (addons-800005) Calling .GetConfigRaw
I0214 02:48:49.655704 1495417 main.go:141] libmachine: (addons-800005) Calling .GetIP
I0214 02:48:49.658110 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.658464 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.658497 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.658707 1495417 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/config.json ...
I0214 02:48:49.658914 1495417 start.go:128] duration metric: took 23.439060151s to createHost
I0214 02:48:49.658951 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:49.660970 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.661309 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.661347 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.661458 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:49.661644 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:49.661819 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:49.661995 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:49.662190 1495417 main.go:141] libmachine: Using SSH client type: native
I0214 02:48:49.662558 1495417 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 02:48:49.662571 1495417 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 02:48:49.781574 1495417 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707878929.759146078
I0214 02:48:49.781604 1495417 fix.go:216] guest clock: 1707878929.759146078
I0214 02:48:49.781617 1495417 fix.go:229] Guest: 2024-02-14 02:48:49.759146078 +0000 UTC Remote: 2024-02-14 02:48:49.658933143 +0000 UTC m=+23.560938502 (delta=100.212935ms)
I0214 02:48:49.781639 1495417 fix.go:200] guest clock delta is within tolerance: 100.212935ms
I0214 02:48:49.781644 1495417 start.go:83] releasing machines lock for "addons-800005", held for 23.561887798s
I0214 02:48:49.781668 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:48:49.781934 1495417 main.go:141] libmachine: (addons-800005) Calling .GetIP
I0214 02:48:49.784729 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.785061 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.785088 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.785289 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:48:49.785762 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:48:49.785922 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:48:49.786015 1495417 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 02:48:49.786070 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:49.786178 1495417 ssh_runner.go:195] Run: cat /version.json
I0214 02:48:49.786210 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:48:49.788770 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.788971 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.789153 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.789182 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.789338 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:49.789461 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:49.789490 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:49.789539 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:49.789662 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:48:49.789751 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:49.789823 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:48:49.789888 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:48:49.789938 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:48:49.790063 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:48:49.903093 1495417 ssh_runner.go:195] Run: systemctl --version
I0214 02:48:49.908574 1495417 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 02:48:50.063763 1495417 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 02:48:50.069598 1495417 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 02:48:50.069683 1495417 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 02:48:50.083847 1495417 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 02:48:50.083869 1495417 start.go:494] detecting cgroup driver to use...
I0214 02:48:50.083926 1495417 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 02:48:50.096793 1495417 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 02:48:50.108379 1495417 docker.go:217] disabling cri-docker service (if available) ...
I0214 02:48:50.108442 1495417 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 02:48:50.119806 1495417 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 02:48:50.131458 1495417 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 02:48:50.234205 1495417 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 02:48:50.355909 1495417 docker.go:233] disabling docker service ...
I0214 02:48:50.356015 1495417 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 02:48:50.369728 1495417 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 02:48:50.380574 1495417 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 02:48:50.490499 1495417 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 02:48:50.599207 1495417 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 02:48:50.612244 1495417 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 02:48:50.628866 1495417 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 02:48:50.628934 1495417 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 02:48:50.638401 1495417 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 02:48:50.638470 1495417 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 02:48:50.648042 1495417 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 02:48:50.657604 1495417 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 02:48:50.667232 1495417 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 02:48:50.677373 1495417 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 02:48:50.686033 1495417 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 02:48:50.686096 1495417 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 02:48:50.698435 1495417 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 02:48:50.707018 1495417 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 02:48:50.809094 1495417 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 02:48:50.966743 1495417 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 02:48:50.966844 1495417 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 02:48:50.972259 1495417 start.go:562] Will wait 60s for crictl version
I0214 02:48:50.972323 1495417 ssh_runner.go:195] Run: which crictl
I0214 02:48:50.976134 1495417 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 02:48:51.022080 1495417 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 02:48:51.022167 1495417 ssh_runner.go:195] Run: crio --version
I0214 02:48:51.067743 1495417 ssh_runner.go:195] Run: crio --version
I0214 02:48:51.121663 1495417 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 02:48:51.123049 1495417 main.go:141] libmachine: (addons-800005) Calling .GetIP
I0214 02:48:51.125637 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:51.125948 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:48:51.125982 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:48:51.126184 1495417 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 02:48:51.130221 1495417 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 02:48:51.142634 1495417 kubeadm.go:877] updating cluster {Name:addons-800005 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.
4 ClusterName:addons-800005 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountTy
pe:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 02:48:51.142770 1495417 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 02:48:51.142831 1495417 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 02:48:51.173644 1495417 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 02:48:51.173723 1495417 ssh_runner.go:195] Run: which lz4
I0214 02:48:51.177597 1495417 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 02:48:51.181646 1495417 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 02:48:51.181677 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 02:48:52.952593 1495417 crio.go:444] duration metric: took 1.775034889s to copy over tarball
I0214 02:48:52.952682 1495417 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 02:48:55.958906 1495417 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.006181486s)
I0214 02:48:55.958938 1495417 crio.go:451] duration metric: took 3.006307631s to extract the tarball
I0214 02:48:55.958945 1495417 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 02:48:56.002271 1495417 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 02:48:56.067324 1495417 crio.go:496] all images are preloaded for cri-o runtime.
I0214 02:48:56.067354 1495417 cache_images.go:84] Images are preloaded, skipping loading
I0214 02:48:56.067363 1495417 kubeadm.go:928] updating node { 192.168.39.41 8443 v1.28.4 crio true true} ...
I0214 02:48:56.067500 1495417 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-800005 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.41
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:addons-800005 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 02:48:56.067572 1495417 ssh_runner.go:195] Run: crio config
I0214 02:48:56.124018 1495417 cni.go:84] Creating CNI manager for ""
I0214 02:48:56.124060 1495417 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 02:48:56.124078 1495417 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 02:48:56.124112 1495417 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.41 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-800005 NodeName:addons-800005 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.41 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kube
rnetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 02:48:56.124317 1495417 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.41
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "addons-800005"
kubeletExtraArgs:
node-ip: 192.168.39.41
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.41"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 02:48:56.124394 1495417 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 02:48:56.134563 1495417 binaries.go:44] Found k8s binaries, skipping transfer
I0214 02:48:56.134641 1495417 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 02:48:56.142566 1495417 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)
I0214 02:48:56.158739 1495417 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 02:48:56.173783 1495417 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)
I0214 02:48:56.191375 1495417 ssh_runner.go:195] Run: grep 192.168.39.41 control-plane.minikube.internal$ /etc/hosts
I0214 02:48:56.195523 1495417 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.41 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 02:48:56.208579 1495417 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 02:48:56.321705 1495417 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 02:48:56.335293 1495417 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005 for IP: 192.168.39.41
I0214 02:48:56.335320 1495417 certs.go:194] generating shared ca certs ...
I0214 02:48:56.335346 1495417 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:56.335498 1495417 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 02:48:56.537405 1495417 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt ...
I0214 02:48:56.537442 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt: {Name:mk446da3cfe9a1958cd00d30d6270441bd4f2e8c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:56.537650 1495417 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key ...
I0214 02:48:56.537666 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key: {Name:mk5a5273594d8fb2d86af61d8311c43c48d13839 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:56.537781 1495417 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 02:48:56.640323 1495417 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt ...
I0214 02:48:56.640358 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt: {Name:mkd98f3ecabda04fb5880e5ace07640c89ff5dfd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:56.640539 1495417 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key ...
I0214 02:48:56.640562 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key: {Name:mkb462c5a8f12c47a7ec442eff5f68718b7b05d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:56.640661 1495417 certs.go:256] generating profile certs ...
I0214 02:48:56.640741 1495417 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.key
I0214 02:48:56.640760 1495417 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt with IP's: []
I0214 02:48:56.931914 1495417 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt ...
I0214 02:48:56.931953 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: {Name:mka0b99ac0592fbccaae2903614f415255c773ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:56.932151 1495417 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.key ...
I0214 02:48:56.932169 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.key: {Name:mkfc3d9eb8e3b901286ce827757a11560e6d4803 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:56.932270 1495417 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.key.68f176cb
I0214 02:48:56.932295 1495417 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.crt.68f176cb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41]
I0214 02:48:57.238916 1495417 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.crt.68f176cb ...
I0214 02:48:57.238958 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.crt.68f176cb: {Name:mk2ac16571b116f484f8d2894a53345c1d4cd52b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:57.239138 1495417 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.key.68f176cb ...
I0214 02:48:57.239153 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.key.68f176cb: {Name:mk7543ba591a268f11a153d6b731f2301086a840 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:57.239225 1495417 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.crt.68f176cb -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.crt
I0214 02:48:57.239294 1495417 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.key.68f176cb -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.key
I0214 02:48:57.239337 1495417 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/proxy-client.key
I0214 02:48:57.239356 1495417 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/proxy-client.crt with IP's: []
I0214 02:48:57.515975 1495417 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/proxy-client.crt ...
I0214 02:48:57.516014 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/proxy-client.crt: {Name:mkffc7b7697cb0bdc5a333b3c9f8f14cf9ce43fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:57.516177 1495417 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/proxy-client.key ...
I0214 02:48:57.516191 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/proxy-client.key: {Name:mk0faa2e65dc6124edd69a0fa9d464045d73522c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:57.516359 1495417 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 02:48:57.516404 1495417 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 02:48:57.516428 1495417 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 02:48:57.516451 1495417 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 02:48:57.517067 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 02:48:57.541978 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 02:48:57.566072 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 02:48:57.589193 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 02:48:57.612899 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0214 02:48:57.635570 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 02:48:57.658606 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 02:48:57.682700 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 02:48:57.708577 1495417 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 02:48:57.733524 1495417 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 02:48:57.750973 1495417 ssh_runner.go:195] Run: openssl version
I0214 02:48:57.756585 1495417 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 02:48:57.766167 1495417 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 02:48:57.770718 1495417 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 02:48:57.770762 1495417 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 02:48:57.776282 1495417 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 02:48:57.785570 1495417 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 02:48:57.789790 1495417 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 02:48:57.789850 1495417 kubeadm.go:391] StartCluster: {Name:addons-800005 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 C
lusterName:addons-800005 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:
9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 02:48:57.789953 1495417 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 02:48:57.790035 1495417 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 02:48:57.834791 1495417 cri.go:89] found id: ""
I0214 02:48:57.834863 1495417 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0214 02:48:57.848212 1495417 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 02:48:57.857190 1495417 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 02:48:57.865923 1495417 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 02:48:57.865940 1495417 kubeadm.go:156] found existing configuration files:
I0214 02:48:57.865995 1495417 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 02:48:57.873918 1495417 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 02:48:57.873971 1495417 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 02:48:57.882357 1495417 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 02:48:57.890295 1495417 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 02:48:57.890346 1495417 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 02:48:57.898764 1495417 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 02:48:57.906770 1495417 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 02:48:57.906820 1495417 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 02:48:57.915128 1495417 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 02:48:57.923267 1495417 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 02:48:57.923318 1495417 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 02:48:57.936861 1495417 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 02:48:58.016254 1495417 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 02:48:58.016339 1495417 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 02:48:58.145366 1495417 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 02:48:58.145504 1495417 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 02:48:58.145635 1495417 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 02:48:58.380362 1495417 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 02:48:58.558969 1495417 out.go:204] - Generating certificates and keys ...
I0214 02:48:58.559124 1495417 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 02:48:58.559213 1495417 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 02:48:58.559366 1495417 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 02:48:58.704153 1495417 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 02:48:58.924377 1495417 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 02:48:59.249049 1495417 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 02:48:59.686736 1495417 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 02:48:59.686932 1495417 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [addons-800005 localhost] and IPs [192.168.39.41 127.0.0.1 ::1]
I0214 02:48:59.761726 1495417 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 02:48:59.761911 1495417 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [addons-800005 localhost] and IPs [192.168.39.41 127.0.0.1 ::1]
I0214 02:48:59.946451 1495417 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 02:49:00.410296 1495417 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 02:49:00.524712 1495417 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 02:49:00.524888 1495417 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 02:49:00.764865 1495417 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 02:49:00.866811 1495417 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 02:49:01.056610 1495417 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 02:49:01.137604 1495417 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 02:49:01.138297 1495417 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 02:49:01.140651 1495417 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 02:49:01.142904 1495417 out.go:204] - Booting up control plane ...
I0214 02:49:01.143028 1495417 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 02:49:01.143126 1495417 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 02:49:01.143573 1495417 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 02:49:01.158863 1495417 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 02:49:01.159657 1495417 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 02:49:01.159741 1495417 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 02:49:01.269092 1495417 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 02:49:08.770137 1495417 kubeadm.go:309] [apiclient] All control plane components are healthy after 7.503011 seconds
I0214 02:49:08.770297 1495417 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 02:49:08.794754 1495417 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 02:49:09.325454 1495417 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 02:49:09.325699 1495417 kubeadm.go:309] [mark-control-plane] Marking the node addons-800005 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 02:49:09.842917 1495417 kubeadm.go:309] [bootstrap-token] Using token: xqqodb.unxv56w1b1xf2mlf
I0214 02:49:09.844750 1495417 out.go:204] - Configuring RBAC rules ...
I0214 02:49:09.844919 1495417 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 02:49:09.853207 1495417 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 02:49:09.860108 1495417 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 02:49:09.863587 1495417 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 02:49:09.866761 1495417 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 02:49:09.874312 1495417 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 02:49:09.894180 1495417 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 02:49:10.134090 1495417 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 02:49:10.259764 1495417 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 02:49:10.260737 1495417 kubeadm.go:309]
I0214 02:49:10.260802 1495417 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 02:49:10.260811 1495417 kubeadm.go:309]
I0214 02:49:10.260874 1495417 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 02:49:10.260881 1495417 kubeadm.go:309]
I0214 02:49:10.260900 1495417 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 02:49:10.260949 1495417 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 02:49:10.261024 1495417 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 02:49:10.261043 1495417 kubeadm.go:309]
I0214 02:49:10.261093 1495417 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 02:49:10.261105 1495417 kubeadm.go:309]
I0214 02:49:10.261176 1495417 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 02:49:10.261186 1495417 kubeadm.go:309]
I0214 02:49:10.261239 1495417 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 02:49:10.261361 1495417 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 02:49:10.261451 1495417 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 02:49:10.261457 1495417 kubeadm.go:309]
I0214 02:49:10.261524 1495417 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 02:49:10.261598 1495417 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 02:49:10.261613 1495417 kubeadm.go:309]
I0214 02:49:10.261676 1495417 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token xqqodb.unxv56w1b1xf2mlf \
I0214 02:49:10.261752 1495417 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 02:49:10.261777 1495417 kubeadm.go:309] --control-plane
I0214 02:49:10.261783 1495417 kubeadm.go:309]
I0214 02:49:10.261848 1495417 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 02:49:10.261854 1495417 kubeadm.go:309]
I0214 02:49:10.261917 1495417 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token xqqodb.unxv56w1b1xf2mlf \
I0214 02:49:10.262007 1495417 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 02:49:10.262839 1495417 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 02:49:10.262866 1495417 cni.go:84] Creating CNI manager for ""
I0214 02:49:10.262874 1495417 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 02:49:10.264595 1495417 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 02:49:10.265967 1495417 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 02:49:10.336751 1495417 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 02:49:10.436403 1495417 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 02:49:10.436476 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-800005 minikube.k8s.io/updated_at=2024_02_14T02_49_10_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=addons-800005 minikube.k8s.io/primary=true
I0214 02:49:10.436480 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:10.465376 1495417 ops.go:34] apiserver oom_adj: -16
I0214 02:49:10.584823 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:11.085022 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:11.585187 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:12.085611 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:12.585217 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:13.085683 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:13.585097 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:14.084905 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:14.585711 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:15.085671 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:15.585229 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:16.085529 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:16.585407 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:17.084911 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:17.585186 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:18.085776 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:18.584846 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:19.085679 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:19.585425 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:20.085421 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:20.585777 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:21.085263 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:21.585021 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:22.085033 1495417 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 02:49:22.180482 1495417 kubeadm.go:1106] duration metric: took 11.744091939s to wait for elevateKubeSystemPrivileges
W0214 02:49:22.180541 1495417 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 02:49:22.180552 1495417 kubeadm.go:393] duration metric: took 24.390709501s to StartCluster
I0214 02:49:22.180580 1495417 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:49:22.180773 1495417 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 02:49:22.181278 1495417 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:49:22.181526 1495417 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0214 02:49:22.181580 1495417 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 02:49:22.183793 1495417 out.go:177] * Verifying Kubernetes components...
I0214 02:49:22.181629 1495417 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]
I0214 02:49:22.181766 1495417 config.go:182] Loaded profile config "addons-800005": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 02:49:22.185197 1495417 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 02:49:22.185221 1495417 addons.go:69] Setting cloud-spanner=true in profile "addons-800005"
I0214 02:49:22.185264 1495417 addons.go:69] Setting ingress-dns=true in profile "addons-800005"
I0214 02:49:22.185267 1495417 addons.go:69] Setting yakd=true in profile "addons-800005"
I0214 02:49:22.185292 1495417 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-800005"
I0214 02:49:22.185299 1495417 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-800005"
I0214 02:49:22.185300 1495417 addons.go:69] Setting ingress=true in profile "addons-800005"
I0214 02:49:22.185306 1495417 addons.go:234] Setting addon ingress-dns=true in "addons-800005"
I0214 02:49:22.185321 1495417 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-800005"
I0214 02:49:22.185356 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185367 1495417 addons.go:234] Setting addon yakd=true in "addons-800005"
I0214 02:49:22.185375 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185276 1495417 addons.go:234] Setting addon cloud-spanner=true in "addons-800005"
I0214 02:49:22.185414 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185283 1495417 addons.go:69] Setting registry=true in profile "addons-800005"
I0214 02:49:22.185441 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185321 1495417 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-800005"
I0214 02:49:22.185446 1495417 addons.go:234] Setting addon registry=true in "addons-800005"
I0214 02:49:22.185613 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185284 1495417 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-800005"
I0214 02:49:22.185293 1495417 addons.go:69] Setting helm-tiller=true in profile "addons-800005"
I0214 02:49:22.185726 1495417 addons.go:234] Setting addon helm-tiller=true in "addons-800005"
I0214 02:49:22.185739 1495417 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-800005"
I0214 02:49:22.185759 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185776 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185904 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.185906 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.185922 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.185961 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.185961 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.185981 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.185328 1495417 addons.go:234] Setting addon ingress=true in "addons-800005"
I0214 02:49:22.185960 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.185278 1495417 addons.go:69] Setting gcp-auth=true in profile "addons-800005"
I0214 02:49:22.186059 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.186065 1495417 mustload.go:65] Loading cluster: addons-800005
I0214 02:49:22.186104 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.186124 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.186134 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.186161 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.186162 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.185326 1495417 addons.go:69] Setting storage-provisioner=true in profile "addons-800005"
I0214 02:49:22.186183 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.186214 1495417 addons.go:234] Setting addon storage-provisioner=true in "addons-800005"
I0214 02:49:22.185311 1495417 addons.go:69] Setting metrics-server=true in profile "addons-800005"
I0214 02:49:22.186260 1495417 addons.go:234] Setting addon metrics-server=true in "addons-800005"
I0214 02:49:22.186262 1495417 config.go:182] Loaded profile config "addons-800005": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 02:49:22.186291 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.186296 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185322 1495417 addons.go:69] Setting inspektor-gadget=true in profile "addons-800005"
I0214 02:49:22.186370 1495417 addons.go:234] Setting addon inspektor-gadget=true in "addons-800005"
I0214 02:49:22.186416 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.186442 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.186625 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.186643 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.186652 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.186627 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.186655 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.186673 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.186683 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.186735 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.185337 1495417 addons.go:69] Setting volumesnapshots=true in profile "addons-800005"
I0214 02:49:22.187070 1495417 addons.go:234] Setting addon volumesnapshots=true in "addons-800005"
I0214 02:49:22.187101 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.185284 1495417 addons.go:69] Setting default-storageclass=true in profile "addons-800005"
I0214 02:49:22.187189 1495417 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-800005"
I0214 02:49:22.187452 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.187485 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.187566 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.187587 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.206336 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35127
I0214 02:49:22.206383 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34869
I0214 02:49:22.206343 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33883
I0214 02:49:22.206846 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.206902 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.206849 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.207443 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.207454 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.207473 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.207517 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.207603 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.207621 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.207899 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.207905 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.208520 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.208532 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.208571 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.208575 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.208870 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32817
I0214 02:49:22.208958 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.209848 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40797
I0214 02:49:22.213765 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.213809 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.213951 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.213984 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.214033 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.214071 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.214092 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.214648 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.214747 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.214727 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.216191 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.216210 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.216282 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.216858 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.216900 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.217176 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.217842 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.217880 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.221699 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35671
I0214 02:49:22.222064 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.222529 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.222550 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.222903 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.223427 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.223465 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.223764 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36949
I0214 02:49:22.224567 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.225471 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.225495 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.228908 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.229352 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.233845 1495417 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-800005"
I0214 02:49:22.233892 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.234248 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.234285 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.239916 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37667
I0214 02:49:22.240339 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.240859 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.240912 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.243423 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44939
I0214 02:49:22.244689 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34687
I0214 02:49:22.244714 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.245031 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.245293 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.245494 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.245548 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.245869 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.245889 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.246154 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.246174 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.246234 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.246801 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.246842 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.247357 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.247419 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33445
I0214 02:49:22.247838 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.248183 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.248224 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.248958 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.248980 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.249415 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.249657 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.250558 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45753
I0214 02:49:22.250963 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43435
I0214 02:49:22.251495 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.251599 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.253749 1495417 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.3
I0214 02:49:22.252492 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.252708 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.252943 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37485
I0214 02:49:22.255281 1495417 addons.go:426] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0214 02:49:22.255306 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0214 02:49:22.255330 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.255389 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.255500 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41857
I0214 02:49:22.255873 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.255879 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.256584 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.256671 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.256679 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.256694 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.256802 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.256814 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.257402 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.257425 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.257879 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.258091 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.259194 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.259727 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.260097 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.261707 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.261778 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.262277 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.264210 1495417 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.13
I0214 02:49:22.262804 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.263705 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.266230 1495417 addons.go:234] Setting addon default-storageclass=true in "addons-800005"
I0214 02:49:22.266929 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0214 02:49:22.266966 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.268281 1495417 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0214 02:49:22.268298 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0214 02:49:22.268318 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.266355 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.268446 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.266412 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42841
I0214 02:49:22.266802 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.266325 1495417 addons.go:426] installing /etc/kubernetes/addons/deployment.yaml
I0214 02:49:22.268602 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0214 02:49:22.268620 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.267183 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.267734 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37953
I0214 02:49:22.268714 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.268761 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.270535 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40391
I0214 02:49:22.272196 1495417 out.go:177] - Using image docker.io/registry:2.8.3
I0214 02:49:22.270734 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.271397 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.271401 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.271450 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.274903 1495417 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
I0214 02:49:22.273782 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.274335 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.274440 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.274469 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.274573 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.274633 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.275187 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.275619 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.276256 1495417 addons.go:426] installing /etc/kubernetes/addons/registry-rc.yaml
I0214 02:49:22.276268 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
I0214 02:49:22.276285 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.276418 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.276489 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.276536 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.276560 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.276582 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.276602 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.276615 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.276657 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.276697 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.277220 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.277237 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.277281 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.277468 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.277518 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.277671 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.277872 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.277940 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.278217 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.278687 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.279193 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.279879 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44731
I0214 02:49:22.280008 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.280128 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45759
I0214 02:49:22.282282 1495417 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
I0214 02:49:22.280807 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.280865 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:22.281281 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.281343 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.281843 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.281911 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35147
I0214 02:49:22.283593 1495417 addons.go:426] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0214 02:49:22.283611 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0214 02:49:22.283606 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.283631 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.283640 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.284007 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.286321 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.286332 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.286348 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.286404 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41427
I0214 02:49:22.286469 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.286508 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.286525 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.286549 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.286741 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.286787 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.286802 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.287060 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.287090 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.287159 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.287317 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.287330 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.287385 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.287827 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.287883 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.288009 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.288022 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.288098 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.288273 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.288301 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.288464 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.288709 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.288862 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.288927 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.289118 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.289632 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.289750 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.289860 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.291795 1495417 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.4
I0214 02:49:22.290544 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.290782 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.293123 1495417 addons.go:426] installing /etc/kubernetes/addons/yakd-ns.yaml
I0214 02:49:22.293144 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0214 02:49:22.293175 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.294783 1495417 out.go:177] - Using image ghcr.io/helm/tiller:v2.17.0
I0214 02:49:22.296074 1495417 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-dp.yaml
I0214 02:49:22.296089 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)
I0214 02:49:22.296106 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.297449 1495417 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.24.0
I0214 02:49:22.294347 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40667
I0214 02:49:22.295861 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45151
I0214 02:49:22.296626 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.296793 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43579
I0214 02:49:22.297370 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.298687 1495417 addons.go:426] installing /etc/kubernetes/addons/ig-namespace.yaml
I0214 02:49:22.298703 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0214 02:49:22.298720 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.298912 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.298939 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.299866 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32921
I0214 02:49:22.299962 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.300705 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.300829 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.300915 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.300994 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.301438 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.301454 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.301543 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.301577 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.301803 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.301863 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.302004 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.302003 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.302012 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.302413 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.302440 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.302522 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.302544 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.302628 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.302635 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.302745 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.302762 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.302931 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.302995 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.303169 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.303203 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.303225 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.303515 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.303542 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.303799 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.303823 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.303849 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.303895 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.303910 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.304029 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.304036 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.304164 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.304575 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:22.304616 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:22.304901 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.305310 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.307468 1495417 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 02:49:22.308889 1495417 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 02:49:22.308908 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 02:49:22.308926 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.311965 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38291
I0214 02:49:22.312152 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.312468 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.312579 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.312605 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.312785 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.312989 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.313143 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.313294 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.313836 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.313854 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.314187 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.314344 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.315719 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.317371 1495417 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.0
I0214 02:49:22.316271 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33203
I0214 02:49:22.317826 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.317863 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34037
I0214 02:49:22.318717 1495417 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 02:49:22.318896 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 02:49:22.318919 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.319202 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.319220 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.319277 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.319765 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.319856 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.319876 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.320032 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.320218 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.320454 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.322253 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.322694 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.322811 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.322835 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.322889 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.324578 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0214 02:49:22.323045 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.324374 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43303
I0214 02:49:22.326933 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0214 02:49:22.325916 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.326050 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.329178 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0214 02:49:22.328236 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.328490 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.329421 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41247
I0214 02:49:22.330467 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.331658 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0214 02:49:22.330846 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.331136 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.332769 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0214 02:49:22.332966 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.333299 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.334265 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0214 02:49:22.334267 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.335988 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0214 02:49:22.337364 1495417 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0214 02:49:22.335870 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.336357 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.338861 1495417 addons.go:426] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0214 02:49:22.338878 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0214 02:49:22.338896 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.337632 1495417 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 02:49:22.338962 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 02:49:22.338999 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.337664 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.341846 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.343568 1495417 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I0214 02:49:22.342160 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39905
I0214 02:49:22.342930 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.343165 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.343500 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.343690 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.345047 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.345070 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.345083 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.345095 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.346645 1495417 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I0214 02:49:22.345341 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.345361 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.345526 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:22.349360 1495417 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.9.5
I0214 02:49:22.348178 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.348177 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.348441 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:22.350572 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:22.350759 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.350788 1495417 addons.go:426] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0214 02:49:22.350802 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16103 bytes)
I0214 02:49:22.350791 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.350816 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.351316 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:22.351531 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:22.353633 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.354018 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.354048 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.354133 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.354629 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:22.354678 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.354836 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.356645 1495417 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0214 02:49:22.355052 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.359472 1495417 out.go:177] - Using image docker.io/busybox:stable
I0214 02:49:22.360902 1495417 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0214 02:49:22.360917 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0214 02:49:22.360931 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:22.363757 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.364131 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:22.364149 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:22.364295 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:22.364435 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:22.364567 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:22.364653 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:22.604912 1495417 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0214 02:49:22.667976 1495417 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 02:49:22.797857 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0214 02:49:22.839351 1495417 addons.go:426] installing /etc/kubernetes/addons/yakd-sa.yaml
I0214 02:49:22.839374 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0214 02:49:22.858314 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 02:49:22.906431 1495417 addons.go:426] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0214 02:49:22.906459 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0214 02:49:22.927784 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0214 02:49:22.950900 1495417 addons.go:426] installing /etc/kubernetes/addons/registry-svc.yaml
I0214 02:49:22.950926 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0214 02:49:23.063014 1495417 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0214 02:49:23.063051 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0214 02:49:23.074138 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 02:49:23.077715 1495417 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml
I0214 02:49:23.077736 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)
I0214 02:49:23.088099 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0214 02:49:23.102064 1495417 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 02:49:23.102085 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0214 02:49:23.112337 1495417 addons.go:426] installing /etc/kubernetes/addons/yakd-crb.yaml
I0214 02:49:23.112361 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0214 02:49:23.112828 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0214 02:49:23.119112 1495417 addons.go:426] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0214 02:49:23.119135 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0214 02:49:23.119763 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0214 02:49:23.131763 1495417 addons.go:426] installing /etc/kubernetes/addons/ig-role.yaml
I0214 02:49:23.131784 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0214 02:49:23.144577 1495417 addons.go:426] installing /etc/kubernetes/addons/registry-proxy.yaml
I0214 02:49:23.144595 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0214 02:49:23.280072 1495417 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0214 02:49:23.280099 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0214 02:49:23.383442 1495417 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-svc.yaml
I0214 02:49:23.383479 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)
I0214 02:49:23.390939 1495417 addons.go:426] installing /etc/kubernetes/addons/yakd-svc.yaml
I0214 02:49:23.390960 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0214 02:49:23.396401 1495417 addons.go:426] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0214 02:49:23.396414 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0214 02:49:23.402528 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0214 02:49:23.415880 1495417 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 02:49:23.415907 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 02:49:23.419214 1495417 addons.go:426] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0214 02:49:23.419239 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0214 02:49:23.430470 1495417 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0214 02:49:23.430508 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0214 02:49:23.458241 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml
I0214 02:49:23.515731 1495417 addons.go:426] installing /etc/kubernetes/addons/yakd-dp.yaml
I0214 02:49:23.515754 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0214 02:49:23.590065 1495417 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0214 02:49:23.590091 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0214 02:49:23.597899 1495417 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 02:49:23.597927 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 02:49:23.610140 1495417 addons.go:426] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0214 02:49:23.610163 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0214 02:49:23.613149 1495417 addons.go:426] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0214 02:49:23.613166 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0214 02:49:23.674556 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0214 02:49:23.727524 1495417 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0214 02:49:23.727554 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0214 02:49:23.780829 1495417 addons.go:426] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0214 02:49:23.780853 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0214 02:49:23.823422 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 02:49:23.840504 1495417 addons.go:426] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0214 02:49:23.840541 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0214 02:49:23.911082 1495417 addons.go:426] installing /etc/kubernetes/addons/ig-crd.yaml
I0214 02:49:23.911112 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0214 02:49:23.947883 1495417 addons.go:426] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0214 02:49:23.947925 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0214 02:49:23.958897 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0214 02:49:24.003004 1495417 addons.go:426] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0214 02:49:24.003032 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0214 02:49:24.046445 1495417 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0214 02:49:24.046469 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0214 02:49:24.072321 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0214 02:49:24.223953 1495417 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0214 02:49:24.223987 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0214 02:49:24.285811 1495417 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0214 02:49:24.285835 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0214 02:49:24.327638 1495417 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0214 02:49:24.327662 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0214 02:49:24.373226 1495417 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0214 02:49:24.373270 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0214 02:49:24.434629 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0214 02:49:27.782351 1495417 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (5.114337687s)
I0214 02:49:27.782355 1495417 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (5.177389311s)
I0214 02:49:27.782461 1495417 start.go:948] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I0214 02:49:27.798255 1495417 node_ready.go:35] waiting up to 6m0s for node "addons-800005" to be "Ready" ...
I0214 02:49:28.241935 1495417 node_ready.go:49] node "addons-800005" has status "Ready":"True"
I0214 02:49:28.241963 1495417 node_ready.go:38] duration metric: took 443.679722ms for node "addons-800005" to be "Ready" ...
I0214 02:49:28.241972 1495417 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 02:49:28.478915 1495417 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace to be "Ready" ...
I0214 02:49:28.643913 1495417 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-800005" context rescaled to 1 replicas
I0214 02:49:28.965542 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (6.167626521s)
I0214 02:49:28.965624 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:28.965641 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:28.965982 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:28.966008 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:28.966019 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:28.966023 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:28.966039 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:28.966348 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:28.966421 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:28.966456 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.151922 1495417 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0214 02:49:30.151976 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:30.155340 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:30.155848 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:30.155890 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:30.156069 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:30.156279 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:30.156467 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:30.156595 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:30.297547 1495417 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0214 02:49:30.321968 1495417 addons.go:234] Setting addon gcp-auth=true in "addons-800005"
I0214 02:49:30.322051 1495417 host.go:66] Checking if "addons-800005" exists ...
I0214 02:49:30.322417 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:30.322456 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:30.337635 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40845
I0214 02:49:30.338170 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:30.338788 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:30.338816 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:30.339194 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:30.339831 1495417 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 02:49:30.339875 1495417 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 02:49:30.354798 1495417 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42495
I0214 02:49:30.355335 1495417 main.go:141] libmachine: () Calling .GetVersion
I0214 02:49:30.355826 1495417 main.go:141] libmachine: Using API Version 1
I0214 02:49:30.355856 1495417 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 02:49:30.356199 1495417 main.go:141] libmachine: () Calling .GetMachineName
I0214 02:49:30.356372 1495417 main.go:141] libmachine: (addons-800005) Calling .GetState
I0214 02:49:30.358043 1495417 main.go:141] libmachine: (addons-800005) Calling .DriverName
I0214 02:49:30.358299 1495417 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0214 02:49:30.358328 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHHostname
I0214 02:49:30.361533 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:30.361962 1495417 main.go:141] libmachine: (addons-800005) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:89:94:78", ip: ""} in network mk-addons-800005: {Iface:virbr1 ExpiryTime:2024-02-14 03:48:42 +0000 UTC Type:0 Mac:52:54:00:89:94:78 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:addons-800005 Clientid:01:52:54:00:89:94:78}
I0214 02:49:30.361991 1495417 main.go:141] libmachine: (addons-800005) DBG | domain addons-800005 has defined IP address 192.168.39.41 and MAC address 52:54:00:89:94:78 in network mk-addons-800005
I0214 02:49:30.362144 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHPort
I0214 02:49:30.362332 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHKeyPath
I0214 02:49:30.362486 1495417 main.go:141] libmachine: (addons-800005) Calling .GetSSHUsername
I0214 02:49:30.362650 1495417 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/addons-800005/id_rsa Username:docker}
I0214 02:49:30.482631 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:30.843037 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (7.915200556s)
I0214 02:49:30.843101 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (7.754980833s)
I0214 02:49:30.843109 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.843123 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.843126 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.843136 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.843061 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.768895859s)
I0214 02:49:30.843409 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.843416 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.843430 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.843445 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.843447 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.843455 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.843466 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.843271 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (7.730411253s)
I0214 02:49:30.843455 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.843484 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.843494 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.843501 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.843512 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.843474 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.843319 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.984964825s)
I0214 02:49:30.843572 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.843581 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.843893 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.843903 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.843940 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.844005 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.844016 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.844027 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.844032 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.844059 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.844092 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.844099 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.844123 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.844130 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.844140 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.844147 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.843949 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.844360 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.844387 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.844395 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.845686 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.843969 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.845720 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.845743 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.843992 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.846014 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.846032 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.846043 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.846052 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.846382 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.846706 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.846725 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.972729 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.972759 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.973123 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:30.973123 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.973151 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:30.976925 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:30.976941 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:30.977279 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:30.977331 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
W0214 02:49:30.977428 1495417 out.go:239] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0214 02:49:32.323999 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.921422499s)
I0214 02:49:32.324035 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (8.865751173s)
I0214 02:49:32.324077 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324083 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324088 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.649493965s)
I0214 02:49:32.324103 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324122 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324137 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324150 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.500695551s)
I0214 02:49:32.324172 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324096 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324194 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324268 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.204447348s)
I0214 02:49:32.324296 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324309 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324345 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (8.365401446s)
W0214 02:49:32.324393 1495417 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0214 02:49:32.324420 1495417 retry.go:31] will retry after 282.706466ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0214 02:49:32.324422 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (8.252023081s)
I0214 02:49:32.324446 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324456 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324542 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.324574 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.324580 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.324595 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.324599 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.324605 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324613 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324641 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.324667 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.324675 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.324684 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324692 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324695 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.324741 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.324763 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.324773 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324783 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324854 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.324865 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.324876 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.324885 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.324970 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.324985 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.325000 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.325010 1495417 addons.go:470] Verifying addon metrics-server=true in "addons-800005"
I0214 02:49:32.325283 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.325297 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.325307 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.325316 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.325393 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.325412 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.325435 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.325442 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.328028 1495417 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-800005 service yakd-dashboard -n yakd-dashboard
I0214 02:49:32.326651 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.326681 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.326700 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.326696 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.326719 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.326777 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.326809 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.329740 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.329742 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.329766 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.329773 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:32.329819 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:32.329750 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.329833 1495417 addons.go:470] Verifying addon registry=true in "addons-800005"
I0214 02:49:32.331577 1495417 out.go:177] * Verifying registry addon...
I0214 02:49:32.330141 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:32.330179 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:32.333479 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:32.333499 1495417 addons.go:470] Verifying addon ingress=true in "addons-800005"
I0214 02:49:32.334895 1495417 out.go:177] * Verifying ingress addon...
I0214 02:49:32.334459 1495417 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0214 02:49:32.337289 1495417 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0214 02:49:32.365375 1495417 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0214 02:49:32.365404 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:32.375219 1495417 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0214 02:49:32.375239 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:32.498415 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:32.607699 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0214 02:49:32.971176 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:32.971545 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:33.114778 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (8.68010376s)
I0214 02:49:33.114830 1495417 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.756503487s)
I0214 02:49:33.117100 1495417 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
I0214 02:49:33.114833 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:33.118550 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:33.120110 1495417 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
I0214 02:49:33.118918 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:33.118957 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:33.121796 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:33.121820 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:33.121829 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:33.121841 1495417 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0214 02:49:33.121858 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0214 02:49:33.122194 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:33.122208 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:33.122221 1495417 addons.go:470] Verifying addon csi-hostpath-driver=true in "addons-800005"
I0214 02:49:33.123739 1495417 out.go:177] * Verifying csi-hostpath-driver addon...
I0214 02:49:33.126422 1495417 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0214 02:49:33.164003 1495417 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0214 02:49:33.164031 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0214 02:49:33.183646 1495417 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0214 02:49:33.183671 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:33.292207 1495417 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0214 02:49:33.292244 1495417 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5432 bytes)
I0214 02:49:33.353723 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:33.377076 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:33.415065 1495417 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0214 02:49:33.700465 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:33.843854 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:33.846610 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:34.157577 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:34.354180 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:34.355265 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:34.512896 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:34.649683 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:34.881509 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:34.908472 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:35.144380 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:35.317730 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.709978872s)
I0214 02:49:35.317800 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:35.317816 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:35.318203 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:35.318299 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:35.318320 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:35.318339 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:35.318352 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:35.318691 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:35.318746 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:35.318717 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:35.366498 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:35.406776 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:35.507949 1495417 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (2.092832178s)
I0214 02:49:35.508018 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:35.508034 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:35.508456 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:35.508554 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:35.508578 1495417 main.go:141] libmachine: Making call to close driver server
I0214 02:49:35.508589 1495417 main.go:141] libmachine: (addons-800005) Calling .Close
I0214 02:49:35.508529 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:35.508901 1495417 main.go:141] libmachine: Successfully made call to close driver server
I0214 02:49:35.508921 1495417 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 02:49:35.508947 1495417 main.go:141] libmachine: (addons-800005) DBG | Closing plugin on server side
I0214 02:49:35.510184 1495417 addons.go:470] Verifying addon gcp-auth=true in "addons-800005"
I0214 02:49:35.511874 1495417 out.go:177] * Verifying gcp-auth addon...
I0214 02:49:35.514014 1495417 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0214 02:49:35.566841 1495417 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0214 02:49:35.566869 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:35.640568 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:35.850888 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:35.851051 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:36.021614 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:36.135560 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:36.365103 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:36.369363 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:36.518985 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:36.634376 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:36.844984 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:36.852319 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:36.992400 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:37.021068 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:37.134333 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:37.345667 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:37.346344 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:37.518792 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:37.633527 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:37.845748 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:37.850162 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:38.031088 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:38.131935 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:38.344309 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:38.344518 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:38.517715 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:38.634946 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:38.843627 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:38.845728 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:39.018160 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:39.165856 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:39.350445 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:39.351272 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:39.507171 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:39.535509 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:39.633992 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:39.867585 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:39.867639 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:40.024161 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:40.132586 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:40.349885 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:40.353855 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:40.523078 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:40.635123 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:40.845981 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:40.846578 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:41.024277 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:41.157413 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:41.349515 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:41.351139 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:41.530067 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:41.632773 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:41.845970 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:41.867399 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:42.010793 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:42.024093 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:42.132885 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:42.342142 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:42.344792 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:42.522669 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:42.637028 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:42.845202 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:42.845564 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:43.022160 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:43.132428 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:43.579191 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:43.581575 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:43.581722 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:43.642826 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:43.850042 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:43.850456 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:44.018771 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:44.131257 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:44.342884 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:44.343853 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:44.488703 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:44.518795 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:44.637962 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:44.845065 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:44.855012 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:45.019442 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:45.133475 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:45.346477 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:45.356673 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:45.519173 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:45.634356 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:45.845515 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:45.845690 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:46.022186 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:46.132947 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:46.342052 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:46.342289 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:46.492494 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:46.529183 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:46.632850 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:46.843557 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:46.845922 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:47.024722 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:47.465051 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:47.465415 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:47.466135 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:47.519998 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:47.632463 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:47.841592 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:47.843264 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:48.023194 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:48.136692 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:48.343771 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:48.349443 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:48.495966 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:48.529212 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:48.633592 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:48.847635 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:48.848478 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:49.018287 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:49.135338 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:49.342420 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:49.344118 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:49.518184 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:49.632833 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:49.844085 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:49.844110 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:50.018260 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:50.132693 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:50.345502 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:50.345673 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:50.518285 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:50.633369 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:50.842681 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:50.846949 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:50.988349 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:51.020391 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:51.133055 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:51.342648 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:51.342693 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:51.518824 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:51.632014 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:51.842548 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:51.842967 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:52.041600 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:52.133040 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:52.347963 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:52.348573 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:52.518581 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:52.634127 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:52.842761 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:52.842886 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:53.018258 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:53.133476 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:53.342096 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:53.343287 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:53.485630 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:53.518318 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:53.633045 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:53.844089 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:53.848478 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:54.018393 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:54.132738 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:54.344037 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:54.344343 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:54.518236 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:54.634069 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:54.842540 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:54.847677 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:55.017905 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:55.146590 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:55.345685 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:55.346069 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:55.486717 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:55.519512 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:55.632923 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:55.846638 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:55.847006 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:56.018099 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:56.135076 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:56.342723 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:56.345006 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:56.518217 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:56.634520 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:56.843237 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:56.844903 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:57.019413 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:57.137137 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:57.344712 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:57.345798 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:57.519900 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:57.634371 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:57.842877 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:57.843450 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:57.985456 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:49:58.017870 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:58.132174 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:58.343530 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:58.345309 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:58.517834 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:58.633154 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:58.844955 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:58.845104 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:59.017762 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:59.132027 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:59.342960 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:59.343191 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:59.526767 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:49:59.632511 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:49:59.841655 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:49:59.843445 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:49:59.985616 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:50:00.018423 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:00.133159 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:00.341666 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:00.343078 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:00.519087 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:00.632840 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:00.843579 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:00.843976 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:01.018850 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:01.136251 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:01.341768 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:01.344509 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:01.518178 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:01.638060 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:01.845309 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:01.848969 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:01.989225 1495417 pod_ready.go:102] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"False"
I0214 02:50:02.018402 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:02.133697 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:02.341540 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:02.342844 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:02.517949 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:02.632321 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:02.842724 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:02.843481 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:03.018069 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:03.132350 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:03.343105 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:03.345672 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:03.518405 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:03.632500 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:03.842031 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:03.844047 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:04.018787 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:04.139219 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:04.351736 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:04.352335 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:04.486614 1495417 pod_ready.go:92] pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace has status "Ready":"True"
I0214 02:50:04.486642 1495417 pod_ready.go:81] duration metric: took 36.007695542s for pod "coredns-5dd5756b68-4tdjv" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.486654 1495417 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-xbw45" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.491640 1495417 pod_ready.go:97] error getting pod "coredns-5dd5756b68-xbw45" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-xbw45" not found
I0214 02:50:04.491666 1495417 pod_ready.go:81] duration metric: took 5.005131ms for pod "coredns-5dd5756b68-xbw45" in "kube-system" namespace to be "Ready" ...
E0214 02:50:04.491677 1495417 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5dd5756b68-xbw45" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-xbw45" not found
I0214 02:50:04.491685 1495417 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-800005" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.496803 1495417 pod_ready.go:92] pod "etcd-addons-800005" in "kube-system" namespace has status "Ready":"True"
I0214 02:50:04.496822 1495417 pod_ready.go:81] duration metric: took 5.129083ms for pod "etcd-addons-800005" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.496831 1495417 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-800005" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.502707 1495417 pod_ready.go:92] pod "kube-apiserver-addons-800005" in "kube-system" namespace has status "Ready":"True"
I0214 02:50:04.502734 1495417 pod_ready.go:81] duration metric: took 5.890078ms for pod "kube-apiserver-addons-800005" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.502743 1495417 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-800005" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.508516 1495417 pod_ready.go:92] pod "kube-controller-manager-addons-800005" in "kube-system" namespace has status "Ready":"True"
I0214 02:50:04.508535 1495417 pod_ready.go:81] duration metric: took 5.786806ms for pod "kube-controller-manager-addons-800005" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.508544 1495417 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-lgvtv" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.517817 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:04.632225 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:04.683705 1495417 pod_ready.go:92] pod "kube-proxy-lgvtv" in "kube-system" namespace has status "Ready":"True"
I0214 02:50:04.683733 1495417 pod_ready.go:81] duration metric: took 175.181296ms for pod "kube-proxy-lgvtv" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.683744 1495417 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-800005" in "kube-system" namespace to be "Ready" ...
I0214 02:50:04.842570 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:04.844388 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:05.020120 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:05.082943 1495417 pod_ready.go:92] pod "kube-scheduler-addons-800005" in "kube-system" namespace has status "Ready":"True"
I0214 02:50:05.082970 1495417 pod_ready.go:81] duration metric: took 399.217181ms for pod "kube-scheduler-addons-800005" in "kube-system" namespace to be "Ready" ...
I0214 02:50:05.082980 1495417 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-5t56m" in "kube-system" namespace to be "Ready" ...
I0214 02:50:05.132236 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:05.342069 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:05.342462 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:05.517885 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:05.631962 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:05.842289 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:05.842832 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:06.018234 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:06.133194 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:06.343110 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:06.343166 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:06.528001 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:06.634195 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:06.845824 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:06.846439 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:07.022410 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:07.098629 1495417 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-5t56m" in "kube-system" namespace has status "Ready":"False"
I0214 02:50:07.136598 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:07.348841 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:07.351012 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:07.518938 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:07.633025 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:07.842842 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:07.843188 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:08.019859 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:08.133114 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:08.342465 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:08.344103 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:08.518775 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:08.633427 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:08.844244 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:08.844556 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:09.018641 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:09.132458 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:09.341710 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:09.342417 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:09.518898 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:09.591948 1495417 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-5t56m" in "kube-system" namespace has status "Ready":"False"
I0214 02:50:09.632664 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:09.843799 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:09.847507 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:10.018193 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:10.131561 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:10.343597 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:10.347682 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:10.524538 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:10.633683 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:10.841932 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:10.842636 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:11.017937 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:11.133019 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:11.342677 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:11.344518 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:11.519524 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:11.633691 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:11.844994 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:11.850766 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:12.019551 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:12.090212 1495417 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-5t56m" in "kube-system" namespace has status "Ready":"False"
I0214 02:50:12.133268 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:12.342753 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:12.343656 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:12.518234 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:12.632450 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:12.841878 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:12.844951 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:13.018345 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:13.132819 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:13.342938 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:13.343212 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:13.518337 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:13.632940 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:13.842367 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:13.842850 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:14.018727 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:14.143149 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:14.344506 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:14.344567 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:14.517824 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:14.590531 1495417 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-5t56m" in "kube-system" namespace has status "Ready":"False"
I0214 02:50:14.632997 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:14.843102 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:14.843340 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:15.020174 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:15.132711 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:15.342472 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:15.344500 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:15.518069 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:15.637661 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:15.842619 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:15.843837 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:16.020599 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:16.139364 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:16.342246 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:16.343150 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:16.519666 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:16.633902 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:16.849619 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:16.849619 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:17.018000 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:17.090231 1495417 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-5t56m" in "kube-system" namespace has status "Ready":"False"
I0214 02:50:17.132705 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:17.343018 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:17.343094 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:17.519347 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:17.636250 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:17.842115 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:17.843279 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:18.017557 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:18.144004 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:18.346420 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:18.346524 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:18.518326 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:18.588646 1495417 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-5t56m" in "kube-system" namespace has status "Ready":"True"
I0214 02:50:18.588671 1495417 pod_ready.go:81] duration metric: took 13.505684098s for pod "nvidia-device-plugin-daemonset-5t56m" in "kube-system" namespace to be "Ready" ...
I0214 02:50:18.588679 1495417 pod_ready.go:38] duration metric: took 50.346697246s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 02:50:18.588696 1495417 api_server.go:52] waiting for apiserver process to appear ...
I0214 02:50:18.588748 1495417 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 02:50:18.607529 1495417 api_server.go:72] duration metric: took 56.425899362s to wait for apiserver process to appear ...
I0214 02:50:18.607561 1495417 api_server.go:88] waiting for apiserver healthz status ...
I0214 02:50:18.607586 1495417 api_server.go:253] Checking apiserver healthz at https://192.168.39.41:8443/healthz ...
I0214 02:50:18.612384 1495417 api_server.go:279] https://192.168.39.41:8443/healthz returned 200:
ok
I0214 02:50:18.613699 1495417 api_server.go:141] control plane version: v1.28.4
I0214 02:50:18.613727 1495417 api_server.go:131] duration metric: took 6.15777ms to wait for apiserver health ...
I0214 02:50:18.613741 1495417 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 02:50:18.625769 1495417 system_pods.go:59] 18 kube-system pods found
I0214 02:50:18.625797 1495417 system_pods.go:61] "coredns-5dd5756b68-4tdjv" [96e92795-8fe2-4382-836d-a7ac67627184] Running
I0214 02:50:18.625805 1495417 system_pods.go:61] "csi-hostpath-attacher-0" [a46853f8-1a21-4be0-859e-bd23c8a1c2d0] Running
I0214 02:50:18.625811 1495417 system_pods.go:61] "csi-hostpath-resizer-0" [82ffa8d2-9abc-4a0b-87f0-ebe5405cfe0d] Running
I0214 02:50:18.625822 1495417 system_pods.go:61] "csi-hostpathplugin-72l94" [efe673db-f6f8-479a-826b-5ec639dce531] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0214 02:50:18.625829 1495417 system_pods.go:61] "etcd-addons-800005" [caf58dcc-b8f0-4747-9872-872cd8c58eb0] Running
I0214 02:50:18.625841 1495417 system_pods.go:61] "kube-apiserver-addons-800005" [bc6f0bc8-41c3-4b1f-9bf1-be19190c1a53] Running
I0214 02:50:18.625851 1495417 system_pods.go:61] "kube-controller-manager-addons-800005" [c564580c-c1a5-4529-9c90-037a67350122] Running
I0214 02:50:18.625862 1495417 system_pods.go:61] "kube-ingress-dns-minikube" [4def4bc5-0d41-4dd3-8875-89a4f91cd3bc] Running
I0214 02:50:18.625869 1495417 system_pods.go:61] "kube-proxy-lgvtv" [77b3a828-e815-446c-aee0-fb73ad5f54c1] Running
I0214 02:50:18.625877 1495417 system_pods.go:61] "kube-scheduler-addons-800005" [0b073ec2-0edf-45bd-94bb-7117cab34f5c] Running
I0214 02:50:18.625884 1495417 system_pods.go:61] "metrics-server-69cf46c98-7kp75" [8b154b19-9591-4cfb-9f09-8a99b2264cd7] Running
I0214 02:50:18.625892 1495417 system_pods.go:61] "nvidia-device-plugin-daemonset-5t56m" [f3b002e8-3ac8-43bf-bc29-715a94af0bd6] Running
I0214 02:50:18.625910 1495417 system_pods.go:61] "registry-9l6tm" [ccff4ebf-39ee-4847-a92d-b8ee82c5c63b] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0214 02:50:18.625920 1495417 system_pods.go:61] "registry-proxy-vrqqj" [689ae998-6ed9-4bf5-82b9-cba2b81a3011] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0214 02:50:18.625938 1495417 system_pods.go:61] "snapshot-controller-58dbcc7b99-2mqg2" [4d4521b5-7997-4dc7-9e3a-a2b394a761a5] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0214 02:50:18.625950 1495417 system_pods.go:61] "snapshot-controller-58dbcc7b99-wcnjg" [89f2d0db-f1fd-4218-a8d4-aafb3181c2ca] Running
I0214 02:50:18.625961 1495417 system_pods.go:61] "storage-provisioner" [d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 02:50:18.625971 1495417 system_pods.go:61] "tiller-deploy-7b677967b9-gxlps" [4737926a-4232-4741-b94d-5dc60bd19e71] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
I0214 02:50:18.625980 1495417 system_pods.go:74] duration metric: took 12.232455ms to wait for pod list to return data ...
I0214 02:50:18.625991 1495417 default_sa.go:34] waiting for default service account to be created ...
I0214 02:50:18.630615 1495417 default_sa.go:45] found service account: "default"
I0214 02:50:18.630642 1495417 default_sa.go:55] duration metric: took 4.639784ms for default service account to be created ...
I0214 02:50:18.630652 1495417 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 02:50:18.634557 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:18.641869 1495417 system_pods.go:86] 18 kube-system pods found
I0214 02:50:18.641891 1495417 system_pods.go:89] "coredns-5dd5756b68-4tdjv" [96e92795-8fe2-4382-836d-a7ac67627184] Running
I0214 02:50:18.641896 1495417 system_pods.go:89] "csi-hostpath-attacher-0" [a46853f8-1a21-4be0-859e-bd23c8a1c2d0] Running
I0214 02:50:18.641901 1495417 system_pods.go:89] "csi-hostpath-resizer-0" [82ffa8d2-9abc-4a0b-87f0-ebe5405cfe0d] Running
I0214 02:50:18.641911 1495417 system_pods.go:89] "csi-hostpathplugin-72l94" [efe673db-f6f8-479a-826b-5ec639dce531] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0214 02:50:18.641918 1495417 system_pods.go:89] "etcd-addons-800005" [caf58dcc-b8f0-4747-9872-872cd8c58eb0] Running
I0214 02:50:18.641926 1495417 system_pods.go:89] "kube-apiserver-addons-800005" [bc6f0bc8-41c3-4b1f-9bf1-be19190c1a53] Running
I0214 02:50:18.641931 1495417 system_pods.go:89] "kube-controller-manager-addons-800005" [c564580c-c1a5-4529-9c90-037a67350122] Running
I0214 02:50:18.641939 1495417 system_pods.go:89] "kube-ingress-dns-minikube" [4def4bc5-0d41-4dd3-8875-89a4f91cd3bc] Running
I0214 02:50:18.641944 1495417 system_pods.go:89] "kube-proxy-lgvtv" [77b3a828-e815-446c-aee0-fb73ad5f54c1] Running
I0214 02:50:18.641951 1495417 system_pods.go:89] "kube-scheduler-addons-800005" [0b073ec2-0edf-45bd-94bb-7117cab34f5c] Running
I0214 02:50:18.641960 1495417 system_pods.go:89] "metrics-server-69cf46c98-7kp75" [8b154b19-9591-4cfb-9f09-8a99b2264cd7] Running
I0214 02:50:18.641970 1495417 system_pods.go:89] "nvidia-device-plugin-daemonset-5t56m" [f3b002e8-3ac8-43bf-bc29-715a94af0bd6] Running
I0214 02:50:18.641982 1495417 system_pods.go:89] "registry-9l6tm" [ccff4ebf-39ee-4847-a92d-b8ee82c5c63b] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0214 02:50:18.641997 1495417 system_pods.go:89] "registry-proxy-vrqqj" [689ae998-6ed9-4bf5-82b9-cba2b81a3011] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0214 02:50:18.642007 1495417 system_pods.go:89] "snapshot-controller-58dbcc7b99-2mqg2" [4d4521b5-7997-4dc7-9e3a-a2b394a761a5] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0214 02:50:18.642015 1495417 system_pods.go:89] "snapshot-controller-58dbcc7b99-wcnjg" [89f2d0db-f1fd-4218-a8d4-aafb3181c2ca] Running
I0214 02:50:18.642024 1495417 system_pods.go:89] "storage-provisioner" [d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 02:50:18.642037 1495417 system_pods.go:89] "tiller-deploy-7b677967b9-gxlps" [4737926a-4232-4741-b94d-5dc60bd19e71] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
I0214 02:50:18.642048 1495417 system_pods.go:126] duration metric: took 11.389772ms to wait for k8s-apps to be running ...
I0214 02:50:18.642061 1495417 system_svc.go:44] waiting for kubelet service to be running ....
I0214 02:50:18.642113 1495417 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 02:50:18.656509 1495417 system_svc.go:56] duration metric: took 14.44168ms WaitForService to wait for kubelet
I0214 02:50:18.656533 1495417 kubeadm.go:576] duration metric: took 56.474911498s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 02:50:18.656557 1495417 node_conditions.go:102] verifying NodePressure condition ...
I0214 02:50:18.661335 1495417 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 02:50:18.661363 1495417 node_conditions.go:123] node cpu capacity is 2
I0214 02:50:18.661381 1495417 node_conditions.go:105] duration metric: took 4.818906ms to run NodePressure ...
I0214 02:50:18.661398 1495417 start.go:240] waiting for startup goroutines ...
I0214 02:50:18.843272 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:18.843288 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:19.018799 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:19.132796 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:19.351483 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:19.352380 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:19.518610 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:19.632602 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:19.842150 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:19.843581 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:20.022111 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:20.134854 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:20.359766 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:20.360202 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:20.518616 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:20.637843 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:20.843907 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:20.847000 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:21.018332 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:21.133132 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:21.342750 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:21.343977 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:21.518382 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:21.635104 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:21.856166 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:21.861919 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:22.019911 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:22.134868 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:22.343256 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:22.343751 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:22.526272 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:22.633285 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:22.842031 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:22.842574 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:23.018182 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:23.132182 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:23.345066 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:23.345624 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:23.518734 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:23.632240 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:23.849805 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:23.849928 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:24.018364 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:24.138497 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:24.344348 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:24.348084 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:24.518842 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:24.631942 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:24.844896 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:24.845383 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:25.018644 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:25.133170 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:25.351283 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:25.351990 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:25.518220 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:25.636092 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:25.843416 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:25.851071 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:26.018271 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:26.133615 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:26.342329 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:26.342553 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:26.518610 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:26.633035 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:26.846042 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:26.846252 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:27.018837 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:27.132629 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:27.342475 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:27.345146 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:27.524090 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:27.632907 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:27.842406 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:27.848647 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:28.018030 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:28.133208 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:28.344023 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:28.344584 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:28.526248 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:29.020698 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:29.022684 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:29.022760 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:29.024360 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:29.134005 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:29.374857 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:29.375022 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:29.522431 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:29.636034 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:29.842944 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:29.843480 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:30.018959 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:30.136555 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:30.341476 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:30.343747 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:30.538991 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:30.632695 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:30.844617 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:30.845315 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:31.018759 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:31.132520 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:31.342358 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:31.344240 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:31.522166 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:31.635593 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:31.842184 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:31.848001 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:32.018962 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:32.133530 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:32.342353 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:32.344872 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:32.517914 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:32.632774 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:32.848021 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:32.848368 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:33.021358 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:33.132921 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:33.344288 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:33.345036 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:33.519013 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:33.636260 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:33.848204 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:33.880142 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:34.018362 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:34.133291 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:34.342079 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:34.342864 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:34.533146 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:34.633475 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:34.847015 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:34.847572 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:35.018947 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:35.132598 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:35.344394 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:35.344564 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:35.517745 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:35.632690 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:35.842366 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:35.843780 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:36.018405 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:36.132702 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:36.343267 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:36.343422 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:36.517874 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:36.632724 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:36.869891 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:36.875573 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:37.019277 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:37.132514 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:37.349056 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:37.352199 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0214 02:50:37.518695 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:37.640501 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:37.845295 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:37.848710 1495417 kapi.go:107] duration metric: took 1m5.514249912s to wait for kubernetes.io/minikube-addons=registry ...
I0214 02:50:38.032593 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:38.133400 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:38.342981 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:38.518398 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:38.632533 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:38.842562 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:39.020798 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:39.131842 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:39.353060 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:39.520190 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:39.646557 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:39.844606 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:40.019876 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:40.145632 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:40.343970 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:40.518467 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:40.635702 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:40.842257 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:41.032170 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:41.132409 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:41.341726 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:41.518080 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:41.633653 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:41.842083 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:42.018114 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:42.131898 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:42.341927 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:42.518936 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:42.639742 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:42.842543 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:43.019357 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:43.133836 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:43.342954 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:43.518079 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:43.632521 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:43.842232 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:44.019014 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:44.132343 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:44.343440 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:44.862660 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:44.864249 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:44.868464 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:45.018422 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:45.132922 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:45.343438 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:45.519793 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:45.632243 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:45.842083 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:46.018423 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:46.133950 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:46.342578 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:46.518017 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:46.632571 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:46.845672 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:47.017804 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:47.148617 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:47.349349 1495417 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0214 02:50:47.518361 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:47.635796 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:47.842366 1495417 kapi.go:107] duration metric: took 1m15.505074123s to wait for app.kubernetes.io/name=ingress-nginx ...
I0214 02:50:48.018445 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:48.132800 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:48.676177 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:48.688618 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:49.019335 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:49.135306 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:49.519400 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:49.655059 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:50.021883 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:50.132462 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:50.524704 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:50.637702 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:51.017581 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:51.133599 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:51.518963 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0214 02:50:51.634103 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:52.018977 1495417 kapi.go:107] duration metric: took 1m16.504962111s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0214 02:50:52.020811 1495417 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-800005 cluster.
I0214 02:50:52.022356 1495417 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0214 02:50:52.023523 1495417 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0214 02:50:52.147773 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:52.632924 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:53.133158 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:53.637701 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:54.132785 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:54.637012 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:55.132974 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:55.632869 1495417 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0214 02:50:56.147929 1495417 kapi.go:107] duration metric: took 1m23.021506588s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0214 02:50:56.149492 1495417 out.go:177] * Enabled addons: cloud-spanner, ingress-dns, nvidia-device-plugin, storage-provisioner, storage-provisioner-rancher, metrics-server, yakd, inspektor-gadget, helm-tiller, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver
I0214 02:50:56.151003 1495417 addons.go:505] duration metric: took 1m33.969369125s for enable addons: enabled=[cloud-spanner ingress-dns nvidia-device-plugin storage-provisioner storage-provisioner-rancher metrics-server yakd inspektor-gadget helm-tiller volumesnapshots registry ingress gcp-auth csi-hostpath-driver]
I0214 02:50:56.151083 1495417 start.go:245] waiting for cluster config update ...
I0214 02:50:56.152516 1495417 start.go:254] writing updated cluster config ...
I0214 02:50:56.152885 1495417 ssh_runner.go:195] Run: rm -f paused
I0214 02:50:56.206647 1495417 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 02:50:56.208562 1495417 out.go:177] * Done! kubectl is now configured to use "addons-800005" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 02:48:38 UTC, ends at Wed 2024-02-14 02:54:14 UTC. --
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.883194832Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707879253883175945,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:578451,},InodesUsed:&UInt64Value{Value:233,},},},}" file="go-grpc-middleware/chain.go:25" id=2013f47a-87b2-4591-bf62-a582a92e8593 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.884139318Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=a24dab95-8ba2-4802-b8e0-0652964209e3 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.884193664Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=a24dab95-8ba2-4802-b8e0-0652964209e3 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.884513601Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6bb6d299811b6c73d3d4c6b7ff39446c29e506f5cdc3af39b7d78a1258f75f2c,PodSandboxId:24d85f39313570ef79b43c91dc31435ddc61b81f160973c22f219edae7d7f67b,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1707879245985044683,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5d77478584-wwkqr,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 83c25319-af17-469d-bf0f-b8f765dfe044,},Annotations:map[string]string{io.kubernetes.container.hash: 4a25dc60,io.kubernetes.conta
iner.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c4de87214b88c95de5c3adb0107d0c44bc3b13a70651f3aeac974c82a22667f,PodSandboxId:e01a21a8c9291d170f37a6246cbb5c8539e9c1e121961efa7c9b340611ac95eb,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,State:CONTAINER_RUNNING,CreatedAt:1707879104990163869,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 4b693d7f-0b6e-4400-b5a4-bfbad8002db8,},Annotations:map[string]string{io.kubernet
es.container.hash: 51d24c75,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:915f917879e36a446ae7c565e053dcbdcbb34eec77255140d8d17797ff341de2,PodSandboxId:cd38b46809a9258cb11db4933f8b74b55716cb5bf7f366611dbea993a9e620f1,Metadata:&ContainerMetadata{Name:headlamp,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67,Annotations:map[string]string{},},ImageRef:ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67,State:CONTAINER_RUNNING,CreatedAt:1707879078636535014,Labels:map[string]string{io.kubernetes.container.name: headlamp,io.kubernetes.pod.name: headlamp-7ddfbb94ff-27l8v,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.u
id: ff0d4656-0f01-425c-8d71-a7615010290e,},Annotations:map[string]string{io.kubernetes.container.hash: 8cac3219,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":4466,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1ef156ece6b010e2e6bf90cd317aab1a8eb0d0718cf23488c1b6b40f2a6e9f2b,PodSandboxId:472ff2757e80d7028a765edda040eedb44097b97d44b177a8a59178770411561,Metadata:&ContainerMetadata{Name:gcp-auth,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,State:CONTAINER_RUNNING,CreatedAt:1707879050593793757,Labels:map[string]string{io.kubernetes.container.name
: gcp-auth,io.kubernetes.pod.name: gcp-auth-d4c87556c-8jgpk,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: ffe1e8dd-44b2-4bae-8ad1-b5a4c9dfa5a1,},Annotations:map[string]string{io.kubernetes.container.hash: 954d453,io.kubernetes.container.ports: [{\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0e9aa70b88ba35f23e8eece6a81caa853fe0954f2cab4a183fd674dc31a32c63,PodSandboxId:1762dfe67e0d1ac14769923f3bd3a9b3aa728cb2d44c0eed6b96d691efbd785c,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:17078
79018141762287,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d,},Annotations:map[string]string{io.kubernetes.container.hash: 2760b640,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d0b7cc071fd10fa7ce65ab9d6cf70b856b5f85f463f4f73114cc280a17042bb,PodSandboxId:1762dfe67e0d1ac14769923f3bd3a9b3aa728cb2d44c0eed6b96d691efbd785c,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707878
984606215219,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d,},Annotations:map[string]string{io.kubernetes.container.hash: 2760b640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7d5eccc3b4b644dbddf471753762f7d2204f83e474ee0b4d3a6114409da590dc,PodSandboxId:92fe96b47ac6e0e519a4d85287f8311edae14699dd42b07e9e0db1cface0c372,Metadata:&ContainerMetadata{Name:yakd,Attempt:0,},Image:&ImageSpec{Image:docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310,Annotations:map[string]string{},},ImageRef:docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310,State:CONTAINER_RUNNING,CreatedAt:17078789
84721560627,Labels:map[string]string{io.kubernetes.container.name: yakd,io.kubernetes.pod.name: yakd-dashboard-9947fc6bf-25wdd,io.kubernetes.pod.namespace: yakd-dashboard,io.kubernetes.pod.uid: a090bbba-8f13-4795-8059-30eab25731d8,},Annotations:map[string]string{io.kubernetes.container.hash: f5104526,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1ea32232943093ac655208788bbef6a58272eccfb4c010fc3b3c79be8109c06f,PodSandboxId:bd790284cbffc9a243999b47ed9b6e1e53e7b93cb528ffbee6fbfb95c0979297,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab93
13c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707878981953918773,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lgvtv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 77b3a828-e815-446c-aee0-fb73ad5f54c1,},Annotations:map[string]string{io.kubernetes.container.hash: 72ff4b00,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bf5848381e6382c01816f92640854abd34d3831e0f4d3671ed68be89eff012ab,PodSandboxId:6e3223e6da6b1ccf033be9742d4722d2228a8e356057ecbb9554eba2cf6a60c5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,St
ate:CONTAINER_RUNNING,CreatedAt:1707878965806278538,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-4tdjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 96e92795-8fe2-4382-836d-a7ac67627184,},Annotations:map[string]string{io.kubernetes.container.hash: a1235947,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f216c982a4d6f234267c8cf0f081dda3c81a53f0c20fcfb1716cf18485c350f1,PodSandboxId:9afe98eee88a1ff47c8cd92efa7b75268b915abae285f9815a85b4179021b57a,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6
dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707878943535933112,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1f894b839d6df7fd3a4d6ff47174b6b8,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:566caa8985e9ad91783c75a26d8bbeb271276a73db41e74bb8c9c72de7fba5c7,PodSandboxId:83d71198c86f95ceaf032af328ceb8b81881a7c83e0d04ab6b9308630162b0c5,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7
b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707878943216469990,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f57d61c376ba07d24ae6f1ecca352a41,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8a3657a512b560ab0f1bd7610d3db87e91d0e00bab5eb99afb408244a91f9021,PodSandboxId:4182e698e1ba72bbab4881b0f6ff2c59dc909a3bcc0b03c70d2b76f3378dd026,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f7025
32592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707878942953970257,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c9c89ea57cb88f3dca3a324551d417ae,},Annotations:map[string]string{io.kubernetes.container.hash: bab76161,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:573fd82196a30ccc99d2c0941aa1a00bb488d02644f1a522be4cc865fd932421,PodSandboxId:8ef355b5eeca93728f23cf17313d65fbbbecb4ab4c22c1cc8f4511ace9675137,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db63
50c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707878942801209895,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 37d713291e07933cf01f9c2ee061b35a,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=a24dab95-8ba2-4802-b8e0-0652964209e3 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.925938756Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=a693f439-c3e6-42e5-8b5c-4fe52423b522 name=/runtime.v1.RuntimeService/Version
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.926022148Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=a693f439-c3e6-42e5-8b5c-4fe52423b522 name=/runtime.v1.RuntimeService/Version
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.928304878Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=97344aea-25cf-46a4-bfca-f49c309e3acf name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.929678142Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707879253929591678,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:578451,},InodesUsed:&UInt64Value{Value:233,},},},}" file="go-grpc-middleware/chain.go:25" id=97344aea-25cf-46a4-bfca-f49c309e3acf name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.930487810Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=c73dade8-a23c-4bde-a081-e007ef2098b0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.930534416Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=c73dade8-a23c-4bde-a081-e007ef2098b0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.930875885Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6bb6d299811b6c73d3d4c6b7ff39446c29e506f5cdc3af39b7d78a1258f75f2c,PodSandboxId:24d85f39313570ef79b43c91dc31435ddc61b81f160973c22f219edae7d7f67b,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1707879245985044683,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5d77478584-wwkqr,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 83c25319-af17-469d-bf0f-b8f765dfe044,},Annotations:map[string]string{io.kubernetes.container.hash: 4a25dc60,io.kubernetes.conta
iner.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c4de87214b88c95de5c3adb0107d0c44bc3b13a70651f3aeac974c82a22667f,PodSandboxId:e01a21a8c9291d170f37a6246cbb5c8539e9c1e121961efa7c9b340611ac95eb,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,State:CONTAINER_RUNNING,CreatedAt:1707879104990163869,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 4b693d7f-0b6e-4400-b5a4-bfbad8002db8,},Annotations:map[string]string{io.kubernet
es.container.hash: 51d24c75,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:915f917879e36a446ae7c565e053dcbdcbb34eec77255140d8d17797ff341de2,PodSandboxId:cd38b46809a9258cb11db4933f8b74b55716cb5bf7f366611dbea993a9e620f1,Metadata:&ContainerMetadata{Name:headlamp,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67,Annotations:map[string]string{},},ImageRef:ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67,State:CONTAINER_RUNNING,CreatedAt:1707879078636535014,Labels:map[string]string{io.kubernetes.container.name: headlamp,io.kubernetes.pod.name: headlamp-7ddfbb94ff-27l8v,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.u
id: ff0d4656-0f01-425c-8d71-a7615010290e,},Annotations:map[string]string{io.kubernetes.container.hash: 8cac3219,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":4466,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1ef156ece6b010e2e6bf90cd317aab1a8eb0d0718cf23488c1b6b40f2a6e9f2b,PodSandboxId:472ff2757e80d7028a765edda040eedb44097b97d44b177a8a59178770411561,Metadata:&ContainerMetadata{Name:gcp-auth,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,State:CONTAINER_RUNNING,CreatedAt:1707879050593793757,Labels:map[string]string{io.kubernetes.container.name
: gcp-auth,io.kubernetes.pod.name: gcp-auth-d4c87556c-8jgpk,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: ffe1e8dd-44b2-4bae-8ad1-b5a4c9dfa5a1,},Annotations:map[string]string{io.kubernetes.container.hash: 954d453,io.kubernetes.container.ports: [{\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0e9aa70b88ba35f23e8eece6a81caa853fe0954f2cab4a183fd674dc31a32c63,PodSandboxId:1762dfe67e0d1ac14769923f3bd3a9b3aa728cb2d44c0eed6b96d691efbd785c,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:17078
79018141762287,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d,},Annotations:map[string]string{io.kubernetes.container.hash: 2760b640,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d0b7cc071fd10fa7ce65ab9d6cf70b856b5f85f463f4f73114cc280a17042bb,PodSandboxId:1762dfe67e0d1ac14769923f3bd3a9b3aa728cb2d44c0eed6b96d691efbd785c,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707878
984606215219,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d,},Annotations:map[string]string{io.kubernetes.container.hash: 2760b640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7d5eccc3b4b644dbddf471753762f7d2204f83e474ee0b4d3a6114409da590dc,PodSandboxId:92fe96b47ac6e0e519a4d85287f8311edae14699dd42b07e9e0db1cface0c372,Metadata:&ContainerMetadata{Name:yakd,Attempt:0,},Image:&ImageSpec{Image:docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310,Annotations:map[string]string{},},ImageRef:docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310,State:CONTAINER_RUNNING,CreatedAt:17078789
84721560627,Labels:map[string]string{io.kubernetes.container.name: yakd,io.kubernetes.pod.name: yakd-dashboard-9947fc6bf-25wdd,io.kubernetes.pod.namespace: yakd-dashboard,io.kubernetes.pod.uid: a090bbba-8f13-4795-8059-30eab25731d8,},Annotations:map[string]string{io.kubernetes.container.hash: f5104526,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1ea32232943093ac655208788bbef6a58272eccfb4c010fc3b3c79be8109c06f,PodSandboxId:bd790284cbffc9a243999b47ed9b6e1e53e7b93cb528ffbee6fbfb95c0979297,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab93
13c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707878981953918773,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lgvtv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 77b3a828-e815-446c-aee0-fb73ad5f54c1,},Annotations:map[string]string{io.kubernetes.container.hash: 72ff4b00,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bf5848381e6382c01816f92640854abd34d3831e0f4d3671ed68be89eff012ab,PodSandboxId:6e3223e6da6b1ccf033be9742d4722d2228a8e356057ecbb9554eba2cf6a60c5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,St
ate:CONTAINER_RUNNING,CreatedAt:1707878965806278538,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-4tdjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 96e92795-8fe2-4382-836d-a7ac67627184,},Annotations:map[string]string{io.kubernetes.container.hash: a1235947,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f216c982a4d6f234267c8cf0f081dda3c81a53f0c20fcfb1716cf18485c350f1,PodSandboxId:9afe98eee88a1ff47c8cd92efa7b75268b915abae285f9815a85b4179021b57a,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6
dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707878943535933112,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1f894b839d6df7fd3a4d6ff47174b6b8,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:566caa8985e9ad91783c75a26d8bbeb271276a73db41e74bb8c9c72de7fba5c7,PodSandboxId:83d71198c86f95ceaf032af328ceb8b81881a7c83e0d04ab6b9308630162b0c5,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7
b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707878943216469990,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f57d61c376ba07d24ae6f1ecca352a41,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8a3657a512b560ab0f1bd7610d3db87e91d0e00bab5eb99afb408244a91f9021,PodSandboxId:4182e698e1ba72bbab4881b0f6ff2c59dc909a3bcc0b03c70d2b76f3378dd026,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f7025
32592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707878942953970257,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c9c89ea57cb88f3dca3a324551d417ae,},Annotations:map[string]string{io.kubernetes.container.hash: bab76161,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:573fd82196a30ccc99d2c0941aa1a00bb488d02644f1a522be4cc865fd932421,PodSandboxId:8ef355b5eeca93728f23cf17313d65fbbbecb4ab4c22c1cc8f4511ace9675137,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db63
50c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707878942801209895,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 37d713291e07933cf01f9c2ee061b35a,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=c73dade8-a23c-4bde-a081-e007ef2098b0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.966441567Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=02b60db5-5134-45a4-b782-1c9a0d835574 name=/runtime.v1.RuntimeService/Version
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.966524345Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=02b60db5-5134-45a4-b782-1c9a0d835574 name=/runtime.v1.RuntimeService/Version
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.967724928Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=2af46aaf-481b-44e4-829a-9bff24ffaf80 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.968955319Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707879253968939005,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:578451,},InodesUsed:&UInt64Value{Value:233,},},},}" file="go-grpc-middleware/chain.go:25" id=2af46aaf-481b-44e4-829a-9bff24ffaf80 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.969855818Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=8676f7b6-8965-4de3-9b25-ac45a341d08b name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.969926601Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=8676f7b6-8965-4de3-9b25-ac45a341d08b name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:13 addons-800005 crio[718]: time="2024-02-14 02:54:13.970255826Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6bb6d299811b6c73d3d4c6b7ff39446c29e506f5cdc3af39b7d78a1258f75f2c,PodSandboxId:24d85f39313570ef79b43c91dc31435ddc61b81f160973c22f219edae7d7f67b,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1707879245985044683,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5d77478584-wwkqr,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 83c25319-af17-469d-bf0f-b8f765dfe044,},Annotations:map[string]string{io.kubernetes.container.hash: 4a25dc60,io.kubernetes.conta
iner.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c4de87214b88c95de5c3adb0107d0c44bc3b13a70651f3aeac974c82a22667f,PodSandboxId:e01a21a8c9291d170f37a6246cbb5c8539e9c1e121961efa7c9b340611ac95eb,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,State:CONTAINER_RUNNING,CreatedAt:1707879104990163869,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 4b693d7f-0b6e-4400-b5a4-bfbad8002db8,},Annotations:map[string]string{io.kubernet
es.container.hash: 51d24c75,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:915f917879e36a446ae7c565e053dcbdcbb34eec77255140d8d17797ff341de2,PodSandboxId:cd38b46809a9258cb11db4933f8b74b55716cb5bf7f366611dbea993a9e620f1,Metadata:&ContainerMetadata{Name:headlamp,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67,Annotations:map[string]string{},},ImageRef:ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67,State:CONTAINER_RUNNING,CreatedAt:1707879078636535014,Labels:map[string]string{io.kubernetes.container.name: headlamp,io.kubernetes.pod.name: headlamp-7ddfbb94ff-27l8v,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.u
id: ff0d4656-0f01-425c-8d71-a7615010290e,},Annotations:map[string]string{io.kubernetes.container.hash: 8cac3219,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":4466,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1ef156ece6b010e2e6bf90cd317aab1a8eb0d0718cf23488c1b6b40f2a6e9f2b,PodSandboxId:472ff2757e80d7028a765edda040eedb44097b97d44b177a8a59178770411561,Metadata:&ContainerMetadata{Name:gcp-auth,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,State:CONTAINER_RUNNING,CreatedAt:1707879050593793757,Labels:map[string]string{io.kubernetes.container.name
: gcp-auth,io.kubernetes.pod.name: gcp-auth-d4c87556c-8jgpk,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: ffe1e8dd-44b2-4bae-8ad1-b5a4c9dfa5a1,},Annotations:map[string]string{io.kubernetes.container.hash: 954d453,io.kubernetes.container.ports: [{\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0e9aa70b88ba35f23e8eece6a81caa853fe0954f2cab4a183fd674dc31a32c63,PodSandboxId:1762dfe67e0d1ac14769923f3bd3a9b3aa728cb2d44c0eed6b96d691efbd785c,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:17078
79018141762287,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d,},Annotations:map[string]string{io.kubernetes.container.hash: 2760b640,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d0b7cc071fd10fa7ce65ab9d6cf70b856b5f85f463f4f73114cc280a17042bb,PodSandboxId:1762dfe67e0d1ac14769923f3bd3a9b3aa728cb2d44c0eed6b96d691efbd785c,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707878
984606215219,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d,},Annotations:map[string]string{io.kubernetes.container.hash: 2760b640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7d5eccc3b4b644dbddf471753762f7d2204f83e474ee0b4d3a6114409da590dc,PodSandboxId:92fe96b47ac6e0e519a4d85287f8311edae14699dd42b07e9e0db1cface0c372,Metadata:&ContainerMetadata{Name:yakd,Attempt:0,},Image:&ImageSpec{Image:docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310,Annotations:map[string]string{},},ImageRef:docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310,State:CONTAINER_RUNNING,CreatedAt:17078789
84721560627,Labels:map[string]string{io.kubernetes.container.name: yakd,io.kubernetes.pod.name: yakd-dashboard-9947fc6bf-25wdd,io.kubernetes.pod.namespace: yakd-dashboard,io.kubernetes.pod.uid: a090bbba-8f13-4795-8059-30eab25731d8,},Annotations:map[string]string{io.kubernetes.container.hash: f5104526,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1ea32232943093ac655208788bbef6a58272eccfb4c010fc3b3c79be8109c06f,PodSandboxId:bd790284cbffc9a243999b47ed9b6e1e53e7b93cb528ffbee6fbfb95c0979297,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab93
13c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707878981953918773,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lgvtv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 77b3a828-e815-446c-aee0-fb73ad5f54c1,},Annotations:map[string]string{io.kubernetes.container.hash: 72ff4b00,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bf5848381e6382c01816f92640854abd34d3831e0f4d3671ed68be89eff012ab,PodSandboxId:6e3223e6da6b1ccf033be9742d4722d2228a8e356057ecbb9554eba2cf6a60c5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,St
ate:CONTAINER_RUNNING,CreatedAt:1707878965806278538,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-4tdjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 96e92795-8fe2-4382-836d-a7ac67627184,},Annotations:map[string]string{io.kubernetes.container.hash: a1235947,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f216c982a4d6f234267c8cf0f081dda3c81a53f0c20fcfb1716cf18485c350f1,PodSandboxId:9afe98eee88a1ff47c8cd92efa7b75268b915abae285f9815a85b4179021b57a,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6
dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707878943535933112,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1f894b839d6df7fd3a4d6ff47174b6b8,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:566caa8985e9ad91783c75a26d8bbeb271276a73db41e74bb8c9c72de7fba5c7,PodSandboxId:83d71198c86f95ceaf032af328ceb8b81881a7c83e0d04ab6b9308630162b0c5,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7
b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707878943216469990,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f57d61c376ba07d24ae6f1ecca352a41,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8a3657a512b560ab0f1bd7610d3db87e91d0e00bab5eb99afb408244a91f9021,PodSandboxId:4182e698e1ba72bbab4881b0f6ff2c59dc909a3bcc0b03c70d2b76f3378dd026,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f7025
32592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707878942953970257,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c9c89ea57cb88f3dca3a324551d417ae,},Annotations:map[string]string{io.kubernetes.container.hash: bab76161,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:573fd82196a30ccc99d2c0941aa1a00bb488d02644f1a522be4cc865fd932421,PodSandboxId:8ef355b5eeca93728f23cf17313d65fbbbecb4ab4c22c1cc8f4511ace9675137,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db63
50c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707878942801209895,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 37d713291e07933cf01f9c2ee061b35a,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=8676f7b6-8965-4de3-9b25-ac45a341d08b name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:14 addons-800005 crio[718]: time="2024-02-14 02:54:14.014158006Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=52f34ef0-0aac-4318-99f8-aad5861f1e0c name=/runtime.v1.RuntimeService/Version
Feb 14 02:54:14 addons-800005 crio[718]: time="2024-02-14 02:54:14.014241806Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=52f34ef0-0aac-4318-99f8-aad5861f1e0c name=/runtime.v1.RuntimeService/Version
Feb 14 02:54:14 addons-800005 crio[718]: time="2024-02-14 02:54:14.015521607Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=02e46656-992b-4b13-96f8-2891a23a8020 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 02:54:14 addons-800005 crio[718]: time="2024-02-14 02:54:14.016958011Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707879254016942267,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:578451,},InodesUsed:&UInt64Value{Value:233,},},},}" file="go-grpc-middleware/chain.go:25" id=02e46656-992b-4b13-96f8-2891a23a8020 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 02:54:14 addons-800005 crio[718]: time="2024-02-14 02:54:14.017488253Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=e7e0e9e5-6a6f-4942-9c35-8d32a1ea925c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:14 addons-800005 crio[718]: time="2024-02-14 02:54:14.017542499Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=e7e0e9e5-6a6f-4942-9c35-8d32a1ea925c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 02:54:14 addons-800005 crio[718]: time="2024-02-14 02:54:14.017983117Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6bb6d299811b6c73d3d4c6b7ff39446c29e506f5cdc3af39b7d78a1258f75f2c,PodSandboxId:24d85f39313570ef79b43c91dc31435ddc61b81f160973c22f219edae7d7f67b,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1707879245985044683,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5d77478584-wwkqr,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 83c25319-af17-469d-bf0f-b8f765dfe044,},Annotations:map[string]string{io.kubernetes.container.hash: 4a25dc60,io.kubernetes.conta
iner.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c4de87214b88c95de5c3adb0107d0c44bc3b13a70651f3aeac974c82a22667f,PodSandboxId:e01a21a8c9291d170f37a6246cbb5c8539e9c1e121961efa7c9b340611ac95eb,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,State:CONTAINER_RUNNING,CreatedAt:1707879104990163869,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 4b693d7f-0b6e-4400-b5a4-bfbad8002db8,},Annotations:map[string]string{io.kubernet
es.container.hash: 51d24c75,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:915f917879e36a446ae7c565e053dcbdcbb34eec77255140d8d17797ff341de2,PodSandboxId:cd38b46809a9258cb11db4933f8b74b55716cb5bf7f366611dbea993a9e620f1,Metadata:&ContainerMetadata{Name:headlamp,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67,Annotations:map[string]string{},},ImageRef:ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67,State:CONTAINER_RUNNING,CreatedAt:1707879078636535014,Labels:map[string]string{io.kubernetes.container.name: headlamp,io.kubernetes.pod.name: headlamp-7ddfbb94ff-27l8v,io.kubernetes.pod.namespace: headlamp,io.kubernetes.pod.u
id: ff0d4656-0f01-425c-8d71-a7615010290e,},Annotations:map[string]string{io.kubernetes.container.hash: 8cac3219,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":4466,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1ef156ece6b010e2e6bf90cd317aab1a8eb0d0718cf23488c1b6b40f2a6e9f2b,PodSandboxId:472ff2757e80d7028a765edda040eedb44097b97d44b177a8a59178770411561,Metadata:&ContainerMetadata{Name:gcp-auth,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06,State:CONTAINER_RUNNING,CreatedAt:1707879050593793757,Labels:map[string]string{io.kubernetes.container.name
: gcp-auth,io.kubernetes.pod.name: gcp-auth-d4c87556c-8jgpk,io.kubernetes.pod.namespace: gcp-auth,io.kubernetes.pod.uid: ffe1e8dd-44b2-4bae-8ad1-b5a4c9dfa5a1,},Annotations:map[string]string{io.kubernetes.container.hash: 954d453,io.kubernetes.container.ports: [{\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0e9aa70b88ba35f23e8eece6a81caa853fe0954f2cab4a183fd674dc31a32c63,PodSandboxId:1762dfe67e0d1ac14769923f3bd3a9b3aa728cb2d44c0eed6b96d691efbd785c,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:17078
79018141762287,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d,},Annotations:map[string]string{io.kubernetes.container.hash: 2760b640,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d0b7cc071fd10fa7ce65ab9d6cf70b856b5f85f463f4f73114cc280a17042bb,PodSandboxId:1762dfe67e0d1ac14769923f3bd3a9b3aa728cb2d44c0eed6b96d691efbd785c,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707878
984606215219,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d4c67329-a6a2-4a7d-a6f7-e8f156a39f0d,},Annotations:map[string]string{io.kubernetes.container.hash: 2760b640,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7d5eccc3b4b644dbddf471753762f7d2204f83e474ee0b4d3a6114409da590dc,PodSandboxId:92fe96b47ac6e0e519a4d85287f8311edae14699dd42b07e9e0db1cface0c372,Metadata:&ContainerMetadata{Name:yakd,Attempt:0,},Image:&ImageSpec{Image:docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310,Annotations:map[string]string{},},ImageRef:docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310,State:CONTAINER_RUNNING,CreatedAt:17078789
84721560627,Labels:map[string]string{io.kubernetes.container.name: yakd,io.kubernetes.pod.name: yakd-dashboard-9947fc6bf-25wdd,io.kubernetes.pod.namespace: yakd-dashboard,io.kubernetes.pod.uid: a090bbba-8f13-4795-8059-30eab25731d8,},Annotations:map[string]string{io.kubernetes.container.hash: f5104526,io.kubernetes.container.ports: [{\"name\":\"http\",\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1ea32232943093ac655208788bbef6a58272eccfb4c010fc3b3c79be8109c06f,PodSandboxId:bd790284cbffc9a243999b47ed9b6e1e53e7b93cb528ffbee6fbfb95c0979297,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab93
13c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707878981953918773,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lgvtv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 77b3a828-e815-446c-aee0-fb73ad5f54c1,},Annotations:map[string]string{io.kubernetes.container.hash: 72ff4b00,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bf5848381e6382c01816f92640854abd34d3831e0f4d3671ed68be89eff012ab,PodSandboxId:6e3223e6da6b1ccf033be9742d4722d2228a8e356057ecbb9554eba2cf6a60c5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,St
ate:CONTAINER_RUNNING,CreatedAt:1707878965806278538,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-4tdjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 96e92795-8fe2-4382-836d-a7ac67627184,},Annotations:map[string]string{io.kubernetes.container.hash: a1235947,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f216c982a4d6f234267c8cf0f081dda3c81a53f0c20fcfb1716cf18485c350f1,PodSandboxId:9afe98eee88a1ff47c8cd92efa7b75268b915abae285f9815a85b4179021b57a,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6
dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707878943535933112,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1f894b839d6df7fd3a4d6ff47174b6b8,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:566caa8985e9ad91783c75a26d8bbeb271276a73db41e74bb8c9c72de7fba5c7,PodSandboxId:83d71198c86f95ceaf032af328ceb8b81881a7c83e0d04ab6b9308630162b0c5,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7
b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707878943216469990,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f57d61c376ba07d24ae6f1ecca352a41,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8a3657a512b560ab0f1bd7610d3db87e91d0e00bab5eb99afb408244a91f9021,PodSandboxId:4182e698e1ba72bbab4881b0f6ff2c59dc909a3bcc0b03c70d2b76f3378dd026,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f7025
32592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707878942953970257,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c9c89ea57cb88f3dca3a324551d417ae,},Annotations:map[string]string{io.kubernetes.container.hash: bab76161,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:573fd82196a30ccc99d2c0941aa1a00bb488d02644f1a522be4cc865fd932421,PodSandboxId:8ef355b5eeca93728f23cf17313d65fbbbecb4ab4c22c1cc8f4511ace9675137,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db63
50c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707878942801209895,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-addons-800005,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 37d713291e07933cf01f9c2ee061b35a,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=e7e0e9e5-6a6f-4942-9c35-8d32a1ea925c name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
6bb6d299811b6 gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7 8 seconds ago Running hello-world-app 0 24d85f3931357 hello-world-app-5d77478584-wwkqr
3c4de87214b88 docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027 2 minutes ago Running nginx 0 e01a21a8c9291 nginx
915f917879e36 ghcr.io/headlamp-k8s/headlamp@sha256:3c6da859a989f285b2fd2ac2f4763d1884d54a51e4405301e5324e0b2b70bd67 2 minutes ago Running headlamp 0 cd38b46809a92 headlamp-7ddfbb94ff-27l8v
1ef156ece6b01 gcr.io/k8s-minikube/gcp-auth-webhook@sha256:3e92b3d1c15220ae0f2f3505fb3a88899a1e48ec85fb777a1a4945ae9db2ce06 3 minutes ago Running gcp-auth 0 472ff2757e80d gcp-auth-d4c87556c-8jgpk
0e9aa70b88ba3 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 3 minutes ago Running storage-provisioner 1 1762dfe67e0d1 storage-provisioner
7d5eccc3b4b64 docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310 4 minutes ago Running yakd 0 92fe96b47ac6e yakd-dashboard-9947fc6bf-25wdd
2d0b7cc071fd1 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 4 minutes ago Exited storage-provisioner 0 1762dfe67e0d1 storage-provisioner
1ea3223294309 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 4 minutes ago Running kube-proxy 0 bd790284cbffc kube-proxy-lgvtv
bf5848381e638 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 4 minutes ago Running coredns 0 6e3223e6da6b1 coredns-5dd5756b68-4tdjv
f216c982a4d6f e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 5 minutes ago Running kube-scheduler 0 9afe98eee88a1 kube-scheduler-addons-800005
566caa8985e9a d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 5 minutes ago Running kube-controller-manager 0 83d71198c86f9 kube-controller-manager-addons-800005
8a3657a512b56 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 5 minutes ago Running etcd 0 4182e698e1ba7 etcd-addons-800005
573fd82196a30 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 5 minutes ago Running kube-apiserver 0 8ef355b5eeca9 kube-apiserver-addons-800005
==> coredns [bf5848381e6382c01816f92640854abd34d3831e0f4d3671ed68be89eff012ab] <==
[INFO] 10.244.0.10:43350 - 15108 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000088351s
[INFO] 10.244.0.10:36216 - 48173 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000077409s
[INFO] 10.244.0.10:36216 - 13619 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000059965s
[INFO] 10.244.0.10:39648 - 44989 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000196923s
[INFO] 10.244.0.10:39648 - 45243 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.00006535s
[INFO] 10.244.0.10:56408 - 53315 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000097517s
[INFO] 10.244.0.10:56408 - 6722 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000062782s
[INFO] 10.244.0.10:41909 - 7925 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000080294s
[INFO] 10.244.0.10:41909 - 27641 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000028435s
[INFO] 10.244.0.10:48145 - 43960 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000027281s
[INFO] 10.244.0.10:48145 - 62138 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00002142s
[INFO] 10.244.0.10:59417 - 35466 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000036117s
[INFO] 10.244.0.10:59417 - 14989 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000053554s
[INFO] 10.244.0.10:55412 - 9664 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000102656s
[INFO] 10.244.0.10:55412 - 35009 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000031766s
[INFO] 10.244.0.22:56753 - 32158 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000331331s
[INFO] 10.244.0.22:41282 - 56103 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000105894s
[INFO] 10.244.0.22:34053 - 37828 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000135884s
[INFO] 10.244.0.22:54805 - 43866 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000172477s
[INFO] 10.244.0.22:56980 - 20315 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000235683s
[INFO] 10.244.0.22:35990 - 24287 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.00019254s
[INFO] 10.244.0.22:51534 - 37265 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.000978445s
[INFO] 10.244.0.22:33308 - 22432 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000960858s
[INFO] 10.244.0.26:53676 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000471842s
[INFO] 10.244.0.26:35910 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.0002296s
==> describe nodes <==
Name: addons-800005
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-800005
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=addons-800005
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T02_49_10_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-800005
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 02:49:06 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-800005
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 02:54:06 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 02:52:14 +0000 Wed, 14 Feb 2024 02:49:04 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 02:52:14 +0000 Wed, 14 Feb 2024 02:49:04 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 02:52:14 +0000 Wed, 14 Feb 2024 02:49:04 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 02:52:14 +0000 Wed, 14 Feb 2024 02:49:11 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.41
Hostname: addons-800005
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 3914496Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 3914496Ki
pods: 110
System Info:
Machine ID: ff6efe7f68eb446e831ccdc8c925d0f7
System UUID: ff6efe7f-68eb-446e-831c-cdc8c925d0f7
Boot ID: 74479283-c584-4f10-ac1d-5f1d17cf986b
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default hello-world-app-5d77478584-wwkqr 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11s
default nginx 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 2m37s
gcp-auth gcp-auth-d4c87556c-8jgpk 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m39s
headlamp headlamp-7ddfbb94ff-27l8v 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m3s
kube-system coredns-5dd5756b68-4tdjv 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (1%!)(MISSING) 170Mi (4%!)(MISSING) 4m52s
kube-system etcd-addons-800005 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (2%!)(MISSING) 0 (0%!)(MISSING) 5m5s
kube-system kube-apiserver-addons-800005 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m4s
kube-system kube-controller-manager-addons-800005 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m4s
kube-system kube-proxy-lgvtv 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m52s
kube-system kube-scheduler-addons-800005 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m4s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m44s
yakd-dashboard yakd-dashboard-9947fc6bf-25wdd 0 (0%!)(MISSING) 0 (0%!)(MISSING) 128Mi (3%!)(MISSING) 256Mi (6%!)(MISSING) 4m44s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 0 (0%!)(MISSING)
memory 298Mi (7%!)(MISSING) 426Mi (11%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4m28s kube-proxy
Normal Starting 5m4s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m4s kubelet Node addons-800005 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m4s kubelet Node addons-800005 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m4s kubelet Node addons-800005 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m4s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 5m3s kubelet Node addons-800005 status is now: NodeReady
Normal RegisteredNode 4m53s node-controller Node addons-800005 event: Registered Node addons-800005 in Controller
==> dmesg <==
[ +5.068712] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000008] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +6.468361] systemd-fstab-generator[644]: Ignoring "noauto" for root device
[ +0.117328] systemd-fstab-generator[655]: Ignoring "noauto" for root device
[ +0.143670] systemd-fstab-generator[668]: Ignoring "noauto" for root device
[ +0.110858] systemd-fstab-generator[679]: Ignoring "noauto" for root device
[ +0.211594] systemd-fstab-generator[703]: Ignoring "noauto" for root device
[ +5.508129] systemd-fstab-generator[800]: Ignoring "noauto" for root device
[Feb14 02:49] systemd-fstab-generator[973]: Ignoring "noauto" for root device
[ +8.770130] systemd-fstab-generator[1311]: Ignoring "noauto" for root device
[ +12.416442] systemd-fstab-generator[1527]: Ignoring "noauto" for root device
[ +11.895668] kauditd_printk_skb: 65 callbacks suppressed
[ +5.397635] kauditd_printk_skb: 4 callbacks suppressed
[Feb14 02:50] kauditd_printk_skb: 16 callbacks suppressed
[ +18.613347] kauditd_printk_skb: 20 callbacks suppressed
[ +21.304402] kauditd_printk_skb: 25 callbacks suppressed
[Feb14 02:51] kauditd_printk_skb: 3 callbacks suppressed
[ +5.962732] kauditd_printk_skb: 35 callbacks suppressed
[ +5.473403] kauditd_printk_skb: 25 callbacks suppressed
[ +5.709665] kauditd_printk_skb: 3 callbacks suppressed
[ +24.273181] kauditd_printk_skb: 3 callbacks suppressed
[Feb14 02:52] kauditd_printk_skb: 8 callbacks suppressed
[ +16.394404] kauditd_printk_skb: 12 callbacks suppressed
[Feb14 02:54] kauditd_printk_skb: 5 callbacks suppressed
==> etcd [8a3657a512b560ab0f1bd7610d3db87e91d0e00bab5eb99afb408244a91f9021] <==
{"level":"warn","ts":"2024-02-14T02:50:44.856889Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"343.015699ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/gcp-auth/\" range_end:\"/registry/pods/gcp-auth0\" ","response":"range_response_count:3 size:10948"}
{"level":"info","ts":"2024-02-14T02:50:44.856936Z","caller":"traceutil/trace.go:171","msg":"trace[2103843308] range","detail":"{range_begin:/registry/pods/gcp-auth/; range_end:/registry/pods/gcp-auth0; response_count:3; response_revision:1102; }","duration":"343.078267ms","start":"2024-02-14T02:50:44.51385Z","end":"2024-02-14T02:50:44.856928Z","steps":["trace[2103843308] 'agreement among raft nodes before linearized reading' (duration: 342.976174ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T02:50:44.856969Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T02:50:44.513837Z","time spent":"343.125731ms","remote":"127.0.0.1:39584","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":3,"response size":10972,"request content":"key:\"/registry/pods/gcp-auth/\" range_end:\"/registry/pods/gcp-auth0\" "}
{"level":"warn","ts":"2024-02-14T02:50:44.857062Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"236.565022ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1113"}
{"level":"info","ts":"2024-02-14T02:50:44.857116Z","caller":"traceutil/trace.go:171","msg":"trace[472864866] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:1102; }","duration":"236.623713ms","start":"2024-02-14T02:50:44.620481Z","end":"2024-02-14T02:50:44.857105Z","steps":["trace[472864866] 'agreement among raft nodes before linearized reading' (duration: 236.487081ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T02:50:44.857484Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"230.630195ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" ","response":"range_response_count:18 size:82439"}
{"level":"info","ts":"2024-02-14T02:50:44.857553Z","caller":"traceutil/trace.go:171","msg":"trace[309378520] range","detail":"{range_begin:/registry/pods/kube-system/; range_end:/registry/pods/kube-system0; response_count:18; response_revision:1102; }","duration":"230.70133ms","start":"2024-02-14T02:50:44.626845Z","end":"2024-02-14T02:50:44.857546Z","steps":["trace[309378520] 'agreement among raft nodes before linearized reading' (duration: 230.495244ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T02:50:44.862328Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"173.616533ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/snapshot.storage.k8s.io/volumesnapshotclasses/\" range_end:\"/registry/snapshot.storage.k8s.io/volumesnapshotclasses0\" count_only:true ","response":"range_response_count:0 size:7"}
{"level":"info","ts":"2024-02-14T02:50:44.862417Z","caller":"traceutil/trace.go:171","msg":"trace[1804545384] range","detail":"{range_begin:/registry/snapshot.storage.k8s.io/volumesnapshotclasses/; range_end:/registry/snapshot.storage.k8s.io/volumesnapshotclasses0; response_count:0; response_revision:1102; }","duration":"173.710049ms","start":"2024-02-14T02:50:44.688696Z","end":"2024-02-14T02:50:44.862406Z","steps":["trace[1804545384] 'agreement among raft nodes before linearized reading' (duration: 168.831355ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T02:50:48.670182Z","caller":"traceutil/trace.go:171","msg":"trace[1917397480] transaction","detail":"{read_only:false; response_revision:1117; number_of_response:1; }","duration":"177.763501ms","start":"2024-02-14T02:50:48.492357Z","end":"2024-02-14T02:50:48.67012Z","steps":["trace[1917397480] 'process raft request' (duration: 177.464153ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T02:50:48.67115Z","caller":"traceutil/trace.go:171","msg":"trace[1349854368] linearizableReadLoop","detail":"{readStateIndex:1147; appliedIndex:1147; }","duration":"158.158535ms","start":"2024-02-14T02:50:48.512983Z","end":"2024-02-14T02:50:48.671141Z","steps":["trace[1349854368] 'read index received' (duration: 158.154823ms)","trace[1349854368] 'applied index is now lower than readState.Index' (duration: 2.965µs)"],"step_count":2}
{"level":"warn","ts":"2024-02-14T02:50:48.671332Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"158.355091ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/gcp-auth/\" range_end:\"/registry/pods/gcp-auth0\" ","response":"range_response_count:3 size:10948"}
{"level":"info","ts":"2024-02-14T02:50:48.671426Z","caller":"traceutil/trace.go:171","msg":"trace[663899873] range","detail":"{range_begin:/registry/pods/gcp-auth/; range_end:/registry/pods/gcp-auth0; response_count:3; response_revision:1117; }","duration":"158.459237ms","start":"2024-02-14T02:50:48.512959Z","end":"2024-02-14T02:50:48.671418Z","steps":["trace[663899873] 'agreement among raft nodes before linearized reading' (duration: 158.264083ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T02:50:48.676761Z","caller":"traceutil/trace.go:171","msg":"trace[1057158275] transaction","detail":"{read_only:false; response_revision:1118; number_of_response:1; }","duration":"100.593772ms","start":"2024-02-14T02:50:48.576153Z","end":"2024-02-14T02:50:48.676747Z","steps":["trace[1057158275] 'process raft request' (duration: 99.403052ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T02:50:48.677243Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"113.126674ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/192.168.39.41\" ","response":"range_response_count:1 size:133"}
{"level":"info","ts":"2024-02-14T02:50:48.677314Z","caller":"traceutil/trace.go:171","msg":"trace[1501521467] range","detail":"{range_begin:/registry/masterleases/192.168.39.41; range_end:; response_count:1; response_revision:1118; }","duration":"113.190873ms","start":"2024-02-14T02:50:48.564099Z","end":"2024-02-14T02:50:48.67729Z","steps":["trace[1501521467] 'agreement among raft nodes before linearized reading' (duration: 112.836782ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T02:51:15.688488Z","caller":"traceutil/trace.go:171","msg":"trace[489643107] transaction","detail":"{read_only:false; response_revision:1388; number_of_response:1; }","duration":"463.90718ms","start":"2024-02-14T02:51:15.22456Z","end":"2024-02-14T02:51:15.688467Z","steps":["trace[489643107] 'process raft request' (duration: 463.804355ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T02:51:15.688907Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T02:51:15.224546Z","time spent":"464.295516ms","remote":"127.0.0.1:39580","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1098,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:1350 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1025 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
{"level":"info","ts":"2024-02-14T02:51:15.689368Z","caller":"traceutil/trace.go:171","msg":"trace[1585384537] linearizableReadLoop","detail":"{readStateIndex:1427; appliedIndex:1427; }","duration":"343.618554ms","start":"2024-02-14T02:51:15.345739Z","end":"2024-02-14T02:51:15.689357Z","steps":["trace[1585384537] 'read index received' (duration: 343.614284ms)","trace[1585384537] 'applied index is now lower than readState.Index' (duration: 3.459µs)"],"step_count":2}
{"level":"warn","ts":"2024-02-14T02:51:15.689554Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"343.984164ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/registry-proxy-vrqqj\" ","response":"range_response_count:1 size:3870"}
{"level":"info","ts":"2024-02-14T02:51:15.690138Z","caller":"traceutil/trace.go:171","msg":"trace[1144715156] range","detail":"{range_begin:/registry/pods/kube-system/registry-proxy-vrqqj; range_end:; response_count:1; response_revision:1388; }","duration":"344.577154ms","start":"2024-02-14T02:51:15.345552Z","end":"2024-02-14T02:51:15.69013Z","steps":["trace[1144715156] 'agreement among raft nodes before linearized reading' (duration: 343.929773ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T02:51:15.690201Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T02:51:15.345535Z","time spent":"344.655714ms","remote":"127.0.0.1:39584","response type":"/etcdserverpb.KV/Range","request count":0,"request size":49,"response count":1,"response size":3894,"request content":"key:\"/registry/pods/kube-system/registry-proxy-vrqqj\" "}
{"level":"warn","ts":"2024-02-14T02:51:15.689948Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"226.926285ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumeclaims/default/hpvc\" ","response":"range_response_count:1 size:822"}
{"level":"info","ts":"2024-02-14T02:51:15.690385Z","caller":"traceutil/trace.go:171","msg":"trace[1642699387] range","detail":"{range_begin:/registry/persistentvolumeclaims/default/hpvc; range_end:; response_count:1; response_revision:1388; }","duration":"227.371623ms","start":"2024-02-14T02:51:15.463008Z","end":"2024-02-14T02:51:15.69038Z","steps":["trace[1642699387] 'agreement among raft nodes before linearized reading' (duration: 226.896863ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T02:51:44.856902Z","caller":"traceutil/trace.go:171","msg":"trace[1015640717] transaction","detail":"{read_only:false; response_revision:1541; number_of_response:1; }","duration":"259.465779ms","start":"2024-02-14T02:51:44.597411Z","end":"2024-02-14T02:51:44.856877Z","steps":["trace[1015640717] 'process raft request' (duration: 259.016091ms)"],"step_count":1}
==> gcp-auth [1ef156ece6b010e2e6bf90cd317aab1a8eb0d0718cf23488c1b6b40f2a6e9f2b] <==
2024/02/14 02:50:50 GCP Auth Webhook started!
2024/02/14 02:50:56 Ready to marshal response ...
2024/02/14 02:50:56 Ready to write response ...
2024/02/14 02:50:56 Ready to marshal response ...
2024/02/14 02:50:56 Ready to write response ...
2024/02/14 02:51:08 Ready to marshal response ...
2024/02/14 02:51:08 Ready to write response ...
2024/02/14 02:51:08 Ready to marshal response ...
2024/02/14 02:51:08 Ready to write response ...
2024/02/14 02:51:10 Ready to marshal response ...
2024/02/14 02:51:10 Ready to write response ...
2024/02/14 02:51:11 Ready to marshal response ...
2024/02/14 02:51:11 Ready to write response ...
2024/02/14 02:51:11 Ready to marshal response ...
2024/02/14 02:51:11 Ready to write response ...
2024/02/14 02:51:30 Ready to marshal response ...
2024/02/14 02:51:30 Ready to write response ...
2024/02/14 02:51:31 Ready to marshal response ...
2024/02/14 02:51:31 Ready to write response ...
2024/02/14 02:51:37 Ready to marshal response ...
2024/02/14 02:51:37 Ready to write response ...
2024/02/14 02:52:05 Ready to marshal response ...
2024/02/14 02:52:05 Ready to write response ...
2024/02/14 02:54:03 Ready to marshal response ...
2024/02/14 02:54:03 Ready to write response ...
==> kernel <==
02:54:14 up 5 min, 0 users, load average: 0.90, 1.96, 1.06
Linux addons-800005 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [573fd82196a30ccc99d2c0941aa1a00bb488d02644f1a522be4cc865fd932421] <==
I0214 02:51:30.695681 1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
W0214 02:51:31.744536 1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
I0214 02:51:36.890997 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
I0214 02:51:37.172237 1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.109.78.84"}
I0214 02:51:45.637485 1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I0214 02:52:21.906543 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0214 02:52:21.907242 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0214 02:52:21.923588 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0214 02:52:21.923747 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0214 02:52:21.941769 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0214 02:52:21.941874 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0214 02:52:21.954439 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0214 02:52:21.954529 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0214 02:52:21.959528 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0214 02:52:21.959664 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0214 02:52:21.975504 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0214 02:52:21.975594 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0214 02:52:21.984467 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0214 02:52:21.984546 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0214 02:52:21.999540 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0214 02:52:22.000082 1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
W0214 02:52:22.960722 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0214 02:52:23.000030 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0214 02:52:23.014080 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
I0214 02:54:03.604449 1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.109.13.102"}
==> kube-controller-manager [566caa8985e9ad91783c75a26d8bbeb271276a73db41e74bb8c9c72de7fba5c7] <==
E0214 02:52:56.218173 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W0214 02:52:57.138802 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0214 02:52:57.138866 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W0214 02:53:01.071467 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0214 02:53:01.071519 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W0214 02:53:24.929757 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0214 02:53:24.929934 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W0214 02:53:28.982726 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0214 02:53:28.982839 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W0214 02:53:33.892741 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0214 02:53:33.892806 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
W0214 02:53:36.130147 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0214 02:53:36.130200 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
I0214 02:54:03.373852 1 event.go:307] "Event occurred" object="default/hello-world-app" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-world-app-5d77478584 to 1"
I0214 02:54:03.411242 1 event.go:307] "Event occurred" object="default/hello-world-app-5d77478584" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-world-app-5d77478584-wwkqr"
I0214 02:54:03.424321 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="51.631057ms"
I0214 02:54:03.443168 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="18.768731ms"
I0214 02:54:03.443279 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="31.017µs"
I0214 02:54:06.022820 1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-create"
I0214 02:54:06.029237 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-69cff4fd79" duration="10.903µs"
I0214 02:54:06.034682 1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-patch"
I0214 02:54:06.773242 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="8.25987ms"
I0214 02:54:06.773811 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="79.238µs"
W0214 02:54:13.660544 1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0214 02:54:13.660716 1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
==> kube-proxy [1ea32232943093ac655208788bbef6a58272eccfb4c010fc3b3c79be8109c06f] <==
I0214 02:49:44.587581 1 server_others.go:69] "Using iptables proxy"
I0214 02:49:44.680453 1 node.go:141] Successfully retrieved node IP: 192.168.39.41
I0214 02:49:45.742810 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 02:49:45.744035 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 02:49:45.963406 1 server_others.go:152] "Using iptables Proxier"
I0214 02:49:45.963468 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 02:49:45.963755 1 server.go:846] "Version info" version="v1.28.4"
I0214 02:49:45.963773 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 02:49:45.965850 1 config.go:188] "Starting service config controller"
I0214 02:49:45.965862 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 02:49:45.965878 1 config.go:97] "Starting endpoint slice config controller"
I0214 02:49:45.965881 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 02:49:45.968017 1 config.go:315] "Starting node config controller"
I0214 02:49:45.968171 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 02:49:46.192563 1 shared_informer.go:318] Caches are synced for service config
I0214 02:49:46.192734 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 02:49:46.269898 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [f216c982a4d6f234267c8cf0f081dda3c81a53f0c20fcfb1716cf18485c350f1] <==
W0214 02:49:06.963050 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 02:49:06.963059 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0214 02:49:06.963104 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 02:49:06.963113 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 02:49:06.963158 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 02:49:06.963165 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 02:49:06.963211 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 02:49:06.963221 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0214 02:49:06.966503 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 02:49:06.966519 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 02:49:07.818717 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 02:49:07.818741 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 02:49:07.833096 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 02:49:07.833166 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 02:49:07.833969 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 02:49:07.834027 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 02:49:07.901048 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 02:49:07.901122 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0214 02:49:08.002266 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 02:49:08.002318 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0214 02:49:08.146831 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 02:49:08.146919 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0214 02:49:08.199524 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 02:49:08.199729 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
I0214 02:49:08.543653 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 02:48:38 UTC, ends at Wed 2024-02-14 02:54:14 UTC. --
Feb 14 02:54:04 addons-800005 kubelet[1318]: I0214 02:54:04.776767 1318 scope.go:117] "RemoveContainer" containerID="45e32729d83989dbea003a66e0f6a38a8eae5443f097bbd92887272165dc5613"
Feb 14 02:54:04 addons-800005 kubelet[1318]: E0214 02:54:04.777414 1318 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e32729d83989dbea003a66e0f6a38a8eae5443f097bbd92887272165dc5613\": container with ID starting with 45e32729d83989dbea003a66e0f6a38a8eae5443f097bbd92887272165dc5613 not found: ID does not exist" containerID="45e32729d83989dbea003a66e0f6a38a8eae5443f097bbd92887272165dc5613"
Feb 14 02:54:04 addons-800005 kubelet[1318]: I0214 02:54:04.777464 1318 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e32729d83989dbea003a66e0f6a38a8eae5443f097bbd92887272165dc5613"} err="failed to get container status \"45e32729d83989dbea003a66e0f6a38a8eae5443f097bbd92887272165dc5613\": rpc error: code = NotFound desc = could not find container \"45e32729d83989dbea003a66e0f6a38a8eae5443f097bbd92887272165dc5613\": container with ID starting with 45e32729d83989dbea003a66e0f6a38a8eae5443f097bbd92887272165dc5613 not found: ID does not exist"
Feb 14 02:54:04 addons-800005 kubelet[1318]: I0214 02:54:04.852186 1318 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-mmh9f\" (UniqueName: \"kubernetes.io/projected/4def4bc5-0d41-4dd3-8875-89a4f91cd3bc-kube-api-access-mmh9f\") on node \"addons-800005\" DevicePath \"\""
Feb 14 02:54:06 addons-800005 kubelet[1318]: I0214 02:54:06.300382 1318 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21bb3f65-39f4-4eeb-8abc-60738f156292" path="/var/lib/kubelet/pods/21bb3f65-39f4-4eeb-8abc-60738f156292/volumes"
Feb 14 02:54:06 addons-800005 kubelet[1318]: I0214 02:54:06.300926 1318 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4def4bc5-0d41-4dd3-8875-89a4f91cd3bc" path="/var/lib/kubelet/pods/4def4bc5-0d41-4dd3-8875-89a4f91cd3bc/volumes"
Feb 14 02:54:06 addons-800005 kubelet[1318]: I0214 02:54:06.301272 1318 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5964735a-c465-4447-a614-d8eedc2b11cc" path="/var/lib/kubelet/pods/5964735a-c465-4447-a614-d8eedc2b11cc/volumes"
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.390089 1318 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v48qb\" (UniqueName: \"kubernetes.io/projected/d99807bc-d72d-44a7-8ba0-f60226917c00-kube-api-access-v48qb\") pod \"d99807bc-d72d-44a7-8ba0-f60226917c00\" (UID: \"d99807bc-d72d-44a7-8ba0-f60226917c00\") "
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.390165 1318 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d99807bc-d72d-44a7-8ba0-f60226917c00-webhook-cert\") pod \"d99807bc-d72d-44a7-8ba0-f60226917c00\" (UID: \"d99807bc-d72d-44a7-8ba0-f60226917c00\") "
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.392687 1318 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99807bc-d72d-44a7-8ba0-f60226917c00-kube-api-access-v48qb" (OuterVolumeSpecName: "kube-api-access-v48qb") pod "d99807bc-d72d-44a7-8ba0-f60226917c00" (UID: "d99807bc-d72d-44a7-8ba0-f60226917c00"). InnerVolumeSpecName "kube-api-access-v48qb". PluginName "kubernetes.io/projected", VolumeGidValue ""
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.394777 1318 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99807bc-d72d-44a7-8ba0-f60226917c00-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d99807bc-d72d-44a7-8ba0-f60226917c00" (UID: "d99807bc-d72d-44a7-8ba0-f60226917c00"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.491382 1318 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-v48qb\" (UniqueName: \"kubernetes.io/projected/d99807bc-d72d-44a7-8ba0-f60226917c00-kube-api-access-v48qb\") on node \"addons-800005\" DevicePath \"\""
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.491415 1318 reconciler_common.go:300] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d99807bc-d72d-44a7-8ba0-f60226917c00-webhook-cert\") on node \"addons-800005\" DevicePath \"\""
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.766185 1318 scope.go:117] "RemoveContainer" containerID="49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db"
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.793552 1318 scope.go:117] "RemoveContainer" containerID="49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db"
Feb 14 02:54:09 addons-800005 kubelet[1318]: E0214 02:54:09.794087 1318 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db\": container with ID starting with 49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db not found: ID does not exist" containerID="49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db"
Feb 14 02:54:09 addons-800005 kubelet[1318]: I0214 02:54:09.794160 1318 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db"} err="failed to get container status \"49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db\": rpc error: code = NotFound desc = could not find container \"49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db\": container with ID starting with 49f769e6dcc9ec3b2db71f5d4aec100dbf8906b09abc4015f7a75b21733d96db not found: ID does not exist"
Feb 14 02:54:10 addons-800005 kubelet[1318]: I0214 02:54:10.302354 1318 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d99807bc-d72d-44a7-8ba0-f60226917c00" path="/var/lib/kubelet/pods/d99807bc-d72d-44a7-8ba0-f60226917c00/volumes"
Feb 14 02:54:10 addons-800005 kubelet[1318]: E0214 02:54:10.356552 1318 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 02:54:10 addons-800005 kubelet[1318]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 02:54:10 addons-800005 kubelet[1318]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 02:54:10 addons-800005 kubelet[1318]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 02:54:10 addons-800005 kubelet[1318]: E0214 02:54:10.392258 1318 container_manager_linux.go:514] "Failed to find cgroups of kubelet" err="cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service"
Feb 14 02:54:11 addons-800005 kubelet[1318]: I0214 02:54:11.167028 1318 scope.go:117] "RemoveContainer" containerID="4757f80c0953b585c0d58ea8a6c93c163e7a04ef3ef128d078c3268100c7b887"
Feb 14 02:54:11 addons-800005 kubelet[1318]: I0214 02:54:11.193724 1318 scope.go:117] "RemoveContainer" containerID="dde0482bbf0156d96eb15b1502728096f88f2c10cbc5b84204324cddec19dbf6"
==> storage-provisioner [0e9aa70b88ba35f23e8eece6a81caa853fe0954f2cab4a183fd674dc31a32c63] <==
I0214 02:50:18.274061 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 02:50:18.296202 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 02:50:18.296360 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 02:50:18.320252 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 02:50:18.320428 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-800005_6f13636f-8c68-421d-badb-10456b2cd4c6!
I0214 02:50:18.322172 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"044e83e9-3b1c-4f4b-ab19-9f07daf21bca", APIVersion:"v1", ResourceVersion:"958", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-800005_6f13636f-8c68-421d-badb-10456b2cd4c6 became leader
I0214 02:50:18.421346 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-800005_6f13636f-8c68-421d-badb-10456b2cd4c6!
==> storage-provisioner [2d0b7cc071fd10fa7ce65ab9d6cf70b856b5f85f463f4f73114cc280a17042bb] <==
I0214 02:49:46.841543 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0214 02:50:16.844023 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-800005 -n addons-800005
helpers_test.go:261: (dbg) Run: kubectl --context addons-800005 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (158.80s)
=== RUN TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run: out/minikube-linux-amd64 stop -p addons-800005
addons_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p addons-800005: exit status 82 (2m0.415256038s)
-- stdout --
* Stopping node "addons-800005" ...
-- /stdout --
** stderr **
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
addons_test.go:174: failed to stop minikube. args "out/minikube-linux-amd64 stop -p addons-800005" : exit status 82
addons_test.go:176: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p addons-800005
addons_test.go:176: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p addons-800005: exit status 11 (21.601899126s)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: crictl list: NewSession: new client: new client: dial tcp 192.168.39.41:22: connect: no route to host
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_a2d68fa011bbbda55500e636dff79fec124b29e3_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
addons_test.go:178: failed to enable dashboard addon: args "out/minikube-linux-amd64 addons enable dashboard -p addons-800005" : exit status 11
addons_test.go:180: (dbg) Run: out/minikube-linux-amd64 addons disable dashboard -p addons-800005
addons_test.go:180: (dbg) Non-zero exit: out/minikube-linux-amd64 addons disable dashboard -p addons-800005: exit status 11 (6.143434924s)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: crictl list: NewSession: new client: new client: dial tcp 192.168.39.41:22: connect: no route to host
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_7b2045b3edf32de99b3c34afdc43bfaabe8aa3c2_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
addons_test.go:182: failed to disable dashboard addon: args "out/minikube-linux-amd64 addons disable dashboard -p addons-800005" : exit status 11
addons_test.go:185: (dbg) Run: out/minikube-linux-amd64 addons disable gvisor -p addons-800005
addons_test.go:185: (dbg) Non-zero exit: out/minikube-linux-amd64 addons disable gvisor -p addons-800005: exit status 11 (6.143981692s)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: crictl list: NewSession: new client: new client: dial tcp 192.168.39.41:22: connect: no route to host
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_8dd43b2cee45a94e37dbac1dd983966d1c97e7d4_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
addons_test.go:187: failed to disable non-enabled addon: args "out/minikube-linux-amd64 addons disable gvisor -p addons-800005" : exit status 11
--- FAIL: TestAddons/StoppedEnableDisable (154.31s)
=== RUN TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run: docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:239: (dbg) Run: docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-262041
functional_test.go:244: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image load --daemon gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 image load --daemon gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr: (7.712312733s)
functional_test.go:447: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-262041" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (8.88s)
=== RUN TestHA/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 node stop m02 -v=7 --alsologtostderr
E0214 03:07:35.534816 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:08:57.455891 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
ha_test.go:363: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 node stop m02 -v=7 --alsologtostderr: exit status 30 (2m0.448700108s)
-- stdout --
* Stopping node "ha-447944-m02" ...
-- /stdout --
** stderr **
I0214 03:07:02.611957 1507572 out.go:291] Setting OutFile to fd 1 ...
I0214 03:07:02.612352 1507572 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:07:02.612372 1507572 out.go:304] Setting ErrFile to fd 2...
I0214 03:07:02.612381 1507572 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:07:02.612677 1507572 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:07:02.613108 1507572 mustload.go:65] Loading cluster: ha-447944
I0214 03:07:02.613651 1507572 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:07:02.613687 1507572 stop.go:39] StopHost: ha-447944-m02
I0214 03:07:02.614148 1507572 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:07:02.614216 1507572 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:07:02.631156 1507572 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38343
I0214 03:07:02.631680 1507572 main.go:141] libmachine: () Calling .GetVersion
I0214 03:07:02.632324 1507572 main.go:141] libmachine: Using API Version 1
I0214 03:07:02.632351 1507572 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:07:02.632790 1507572 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:07:02.635969 1507572 out.go:177] * Stopping node "ha-447944-m02" ...
I0214 03:07:02.637674 1507572 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]
I0214 03:07:02.637712 1507572 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:07:02.637977 1507572 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup
I0214 03:07:02.638014 1507572 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:07:02.641598 1507572 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:07:02.642078 1507572 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:07:02.642110 1507572 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:07:02.642429 1507572 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:07:02.642627 1507572 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:07:02.642828 1507572 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:07:02.643028 1507572 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:07:02.748539 1507572 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/cni /var/lib/minikube/backup
I0214 03:07:02.760269 1507572 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/kubernetes /var/lib/minikube/backup
I0214 03:07:02.771718 1507572 main.go:141] libmachine: Stopping "ha-447944-m02"...
I0214 03:07:02.771757 1507572 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:07:02.773351 1507572 main.go:141] libmachine: (ha-447944-m02) Calling .Stop
I0214 03:07:02.776972 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 0/120
I0214 03:07:03.778399 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 1/120
I0214 03:07:04.780538 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 2/120
I0214 03:07:05.781803 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 3/120
I0214 03:07:06.784124 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 4/120
I0214 03:07:07.786855 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 5/120
I0214 03:07:08.788477 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 6/120
I0214 03:07:09.790266 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 7/120
I0214 03:07:10.791747 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 8/120
I0214 03:07:11.793459 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 9/120
I0214 03:07:12.795044 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 10/120
I0214 03:07:13.797855 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 11/120
I0214 03:07:14.799579 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 12/120
I0214 03:07:15.801357 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 13/120
I0214 03:07:16.802931 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 14/120
I0214 03:07:17.804597 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 15/120
I0214 03:07:18.806324 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 16/120
I0214 03:07:19.808074 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 17/120
I0214 03:07:20.809886 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 18/120
I0214 03:07:21.811918 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 19/120
I0214 03:07:22.814673 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 20/120
I0214 03:07:23.816820 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 21/120
I0214 03:07:24.818470 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 22/120
I0214 03:07:25.819893 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 23/120
I0214 03:07:26.821358 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 24/120
I0214 03:07:27.823696 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 25/120
I0214 03:07:28.825428 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 26/120
I0214 03:07:29.827865 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 27/120
I0214 03:07:30.829353 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 28/120
I0214 03:07:31.831015 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 29/120
I0214 03:07:32.832988 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 30/120
I0214 03:07:33.835690 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 31/120
I0214 03:07:34.837091 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 32/120
I0214 03:07:35.838547 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 33/120
I0214 03:07:36.840087 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 34/120
I0214 03:07:37.842167 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 35/120
I0214 03:07:38.844595 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 36/120
I0214 03:07:39.846523 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 37/120
I0214 03:07:40.848346 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 38/120
I0214 03:07:41.850367 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 39/120
I0214 03:07:42.851911 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 40/120
I0214 03:07:43.853828 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 41/120
I0214 03:07:44.856316 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 42/120
I0214 03:07:45.858272 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 43/120
I0214 03:07:46.860590 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 44/120
I0214 03:07:47.862632 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 45/120
I0214 03:07:48.864405 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 46/120
I0214 03:07:49.866252 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 47/120
I0214 03:07:50.867703 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 48/120
I0214 03:07:51.869822 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 49/120
I0214 03:07:52.871818 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 50/120
I0214 03:07:53.873393 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 51/120
I0214 03:07:54.874857 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 52/120
I0214 03:07:55.876743 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 53/120
I0214 03:07:56.878113 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 54/120
I0214 03:07:57.879784 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 55/120
I0214 03:07:58.881329 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 56/120
I0214 03:07:59.882846 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 57/120
I0214 03:08:00.884456 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 58/120
I0214 03:08:01.886148 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 59/120
I0214 03:08:02.887958 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 60/120
I0214 03:08:03.890249 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 61/120
I0214 03:08:04.891987 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 62/120
I0214 03:08:05.893884 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 63/120
I0214 03:08:06.895635 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 64/120
I0214 03:08:07.898328 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 65/120
I0214 03:08:08.899845 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 66/120
I0214 03:08:09.902099 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 67/120
I0214 03:08:10.903889 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 68/120
I0214 03:08:11.905145 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 69/120
I0214 03:08:12.907802 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 70/120
I0214 03:08:13.909958 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 71/120
I0214 03:08:14.911993 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 72/120
I0214 03:08:15.913437 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 73/120
I0214 03:08:16.915813 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 74/120
I0214 03:08:17.917744 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 75/120
I0214 03:08:18.919912 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 76/120
I0214 03:08:19.921524 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 77/120
I0214 03:08:20.923847 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 78/120
I0214 03:08:21.925437 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 79/120
I0214 03:08:22.927701 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 80/120
I0214 03:08:23.929112 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 81/120
I0214 03:08:24.930936 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 82/120
I0214 03:08:25.933457 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 83/120
I0214 03:08:26.935001 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 84/120
I0214 03:08:27.936492 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 85/120
I0214 03:08:28.937913 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 86/120
I0214 03:08:29.940195 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 87/120
I0214 03:08:30.941675 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 88/120
I0214 03:08:31.943881 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 89/120
I0214 03:08:32.946471 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 90/120
I0214 03:08:33.948106 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 91/120
I0214 03:08:34.949404 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 92/120
I0214 03:08:35.950836 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 93/120
I0214 03:08:36.952553 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 94/120
I0214 03:08:37.954400 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 95/120
I0214 03:08:38.955875 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 96/120
I0214 03:08:39.957086 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 97/120
I0214 03:08:40.958454 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 98/120
I0214 03:08:41.960116 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 99/120
I0214 03:08:42.961537 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 100/120
I0214 03:08:43.963086 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 101/120
I0214 03:08:44.965292 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 102/120
I0214 03:08:45.966824 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 103/120
I0214 03:08:46.969073 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 104/120
I0214 03:08:47.970813 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 105/120
I0214 03:08:48.972359 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 106/120
I0214 03:08:49.974408 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 107/120
I0214 03:08:50.975904 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 108/120
I0214 03:08:51.977727 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 109/120
I0214 03:08:52.980099 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 110/120
I0214 03:08:53.981898 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 111/120
I0214 03:08:54.983116 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 112/120
I0214 03:08:55.984527 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 113/120
I0214 03:08:56.985959 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 114/120
I0214 03:08:57.987595 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 115/120
I0214 03:08:58.989368 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 116/120
I0214 03:08:59.991145 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 117/120
I0214 03:09:00.992906 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 118/120
I0214 03:09:01.994381 1507572 main.go:141] libmachine: (ha-447944-m02) Waiting for machine to stop 119/120
I0214 03:09:02.995263 1507572 stop.go:66] stop err: unable to stop vm, current state "Running"
W0214 03:09:02.995574 1507572 out.go:239] X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"
X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"
** /stderr **
ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-linux-amd64 -p ha-447944 node stop m02 -v=7 --alsologtostderr": exit status 30
ha_test.go:369: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 3 (19.302802029s)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:09:03.062905 1507888 out.go:291] Setting OutFile to fd 1 ...
I0214 03:09:03.063077 1507888 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:03.063091 1507888 out.go:304] Setting ErrFile to fd 2...
I0214 03:09:03.063099 1507888 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:03.063327 1507888 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:09:03.063576 1507888 out.go:298] Setting JSON to false
I0214 03:09:03.063621 1507888 mustload.go:65] Loading cluster: ha-447944
I0214 03:09:03.063685 1507888 notify.go:220] Checking for updates...
I0214 03:09:03.064243 1507888 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:09:03.064267 1507888 status.go:255] checking status of ha-447944 ...
I0214 03:09:03.064795 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:03.064869 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:03.091333 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46045
I0214 03:09:03.091848 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:03.092502 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:03.092548 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:03.092956 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:03.093178 1507888 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:09:03.095081 1507888 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:09:03.095142 1507888 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:03.095463 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:03.095507 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:03.111282 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41435
I0214 03:09:03.111731 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:03.112235 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:03.112263 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:03.112621 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:03.112866 1507888 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:09:03.116312 1507888 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:03.116854 1507888 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:03.116886 1507888 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:03.117010 1507888 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:03.117341 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:03.117403 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:03.132889 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35763
I0214 03:09:03.133434 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:03.134044 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:03.134070 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:03.134409 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:03.134619 1507888 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:09:03.134879 1507888 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:03.134925 1507888 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:09:03.138135 1507888 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:03.138645 1507888 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:03.138690 1507888 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:03.138806 1507888 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:09:03.139035 1507888 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:09:03.139185 1507888 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:09:03.139373 1507888 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:09:03.236343 1507888 ssh_runner.go:195] Run: systemctl --version
I0214 03:09:03.244280 1507888 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:03.263995 1507888 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:03.264040 1507888 api_server.go:166] Checking apiserver status ...
I0214 03:09:03.264094 1507888 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:03.282835 1507888 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:09:03.293043 1507888 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:09:03.293133 1507888 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:09:03.303804 1507888 api_server.go:204] freezer state: "THAWED"
I0214 03:09:03.303840 1507888 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:03.309778 1507888 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:03.309820 1507888 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:09:03.309870 1507888 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:03.309903 1507888 status.go:255] checking status of ha-447944-m02 ...
I0214 03:09:03.310258 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:03.310314 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:03.326821 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40277
I0214 03:09:03.327309 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:03.327861 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:03.327902 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:03.328302 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:03.328547 1507888 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:09:03.330360 1507888 status.go:330] ha-447944-m02 host status = "Running" (err=<nil>)
I0214 03:09:03.330376 1507888 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:03.330658 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:03.330723 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:03.345348 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37049
I0214 03:09:03.345846 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:03.346371 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:03.346397 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:03.346755 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:03.346956 1507888 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:09:03.350699 1507888 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:03.351260 1507888 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:03.351297 1507888 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:03.351485 1507888 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:03.351779 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:03.351819 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:03.367064 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39461
I0214 03:09:03.367538 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:03.368013 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:03.368037 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:03.368391 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:03.368605 1507888 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:09:03.368812 1507888 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:03.368835 1507888 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:09:03.372164 1507888 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:03.372627 1507888 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:03.372670 1507888 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:03.372805 1507888 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:09:03.373019 1507888 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:09:03.373183 1507888 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:09:03.373361 1507888 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
W0214 03:09:21.885500 1507888 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:21.885667 1507888 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
E0214 03:09:21.885711 1507888 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:21.885727 1507888 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
E0214 03:09:21.885747 1507888 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:21.885761 1507888 status.go:255] checking status of ha-447944-m03 ...
I0214 03:09:21.886149 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:21.886209 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:21.903892 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45989
I0214 03:09:21.904370 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:21.904987 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:21.905039 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:21.905394 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:21.905605 1507888 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:09:21.907504 1507888 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:09:21.907522 1507888 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:21.907897 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:21.907947 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:21.923629 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35347
I0214 03:09:21.924135 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:21.924612 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:21.924631 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:21.924948 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:21.925152 1507888 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:09:21.928329 1507888 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:21.928715 1507888 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:21.928744 1507888 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:21.928966 1507888 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:21.929394 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:21.929472 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:21.944402 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37011
I0214 03:09:21.944876 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:21.945438 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:21.945464 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:21.945815 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:21.946119 1507888 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:09:21.946364 1507888 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:21.946397 1507888 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:09:21.949788 1507888 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:21.950310 1507888 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:21.950344 1507888 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:21.950461 1507888 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:09:21.950634 1507888 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:09:21.950830 1507888 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:09:21.950997 1507888 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:09:22.057580 1507888 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:22.078834 1507888 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:22.078870 1507888 api_server.go:166] Checking apiserver status ...
I0214 03:09:22.078919 1507888 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:22.098141 1507888 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:09:22.108868 1507888 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:09:22.108968 1507888 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:09:22.121335 1507888 api_server.go:204] freezer state: "THAWED"
I0214 03:09:22.121376 1507888 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:22.128974 1507888 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:22.129009 1507888 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:09:22.129017 1507888 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:22.129039 1507888 status.go:255] checking status of ha-447944-m04 ...
I0214 03:09:22.129452 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:22.129501 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:22.144541 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39969
I0214 03:09:22.145063 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:22.145635 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:22.145661 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:22.145993 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:22.146195 1507888 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:09:22.147700 1507888 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:09:22.147717 1507888 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:22.148025 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:22.148082 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:22.162719 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35849
I0214 03:09:22.163136 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:22.163612 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:22.163637 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:22.164024 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:22.164206 1507888 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:09:22.166969 1507888 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:22.167457 1507888 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:22.167489 1507888 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:22.167591 1507888 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:22.167912 1507888 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:22.167950 1507888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:22.183490 1507888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42895
I0214 03:09:22.184029 1507888 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:22.184604 1507888 main.go:141] libmachine: Using API Version 1
I0214 03:09:22.184630 1507888 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:22.185011 1507888 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:22.185230 1507888 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:09:22.185462 1507888 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:22.185487 1507888 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:09:22.188409 1507888 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:22.188862 1507888 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:22.188890 1507888 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:22.189070 1507888 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:09:22.189282 1507888 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:09:22.189455 1507888 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:09:22.189606 1507888 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:09:22.282510 1507888 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:22.298518 1507888 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:372: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr" : exit status 3
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p ha-447944 -n ha-447944
helpers_test.go:244: <<< TestHA/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestHA/serial/StopSecondaryNode]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-447944 logs -n 25: (1.653648243s)
helpers_test.go:252: TestHA/serial/StopSecondaryNode logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944-m03.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944:/home/docker/cp-test_ha-447944-m03_ha-447944.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944.txt | | | | | |
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m02:/home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04:/home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m04 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt | | | | | |
| cp | ha-447944 cp testdata/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04:/home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944-m04.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944:/home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m02:/home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m03:/home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m03 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| node | ha-447944 node stop m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | |
| | --alsologtostderr | | | | | |
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 03:02:06
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 03:02:06.427529 1503804 out.go:291] Setting OutFile to fd 1 ...
I0214 03:02:06.427659 1503804 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:02:06.427671 1503804 out.go:304] Setting ErrFile to fd 2...
I0214 03:02:06.427675 1503804 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:02:06.427913 1503804 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:02:06.428529 1503804 out.go:298] Setting JSON to false
I0214 03:02:06.429525 1503804 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":20674,"bootTime":1707859053,"procs":199,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:02:06.429588 1503804 start.go:138] virtualization: kvm guest
I0214 03:02:06.431982 1503804 out.go:177] * [ha-447944] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 03:02:06.433564 1503804 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:02:06.433560 1503804 notify.go:220] Checking for updates...
I0214 03:02:06.435143 1503804 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:02:06.436605 1503804 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:02:06.437970 1503804 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:02:06.439380 1503804 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:02:06.440867 1503804 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:02:06.442532 1503804 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:02:06.477793 1503804 out.go:177] * Using the kvm2 driver based on user configuration
I0214 03:02:06.479127 1503804 start.go:296] selected driver: kvm2
I0214 03:02:06.479142 1503804 start.go:900] validating driver "kvm2" against <nil>
I0214 03:02:06.479156 1503804 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:02:06.479902 1503804 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:02:06.479993 1503804 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 03:02:06.494422 1503804 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 03:02:06.494469 1503804 start_flags.go:308] no existing cluster config was found, will generate one from the flags
I0214 03:02:06.494682 1503804 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:02:06.494746 1503804 cni.go:84] Creating CNI manager for ""
I0214 03:02:06.494760 1503804 cni.go:136] multinode detected (0 nodes found), recommending kindnet
I0214 03:02:06.494767 1503804 start_flags.go:317] Found "CNI" CNI - setting NetworkPlugin=cni
I0214 03:02:06.494820 1503804 start.go:339] cluster config:
{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS
ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs:}
I0214 03:02:06.494920 1503804 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:02:06.496689 1503804 out.go:177] * Starting "ha-447944" primary control-plane node in "ha-447944" cluster
I0214 03:02:06.497883 1503804 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:02:06.497925 1503804 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 03:02:06.497939 1503804 cache.go:56] Caching tarball of preloaded images
I0214 03:02:06.498011 1503804 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:02:06.498021 1503804 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:02:06.499039 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:02:06.499080 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json: {Name:mk0f1e24861d2db2bb1ab285edfab3532643e5a1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:06.499332 1503804 start.go:360] acquireMachinesLock for ha-447944: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:02:06.499572 1503804 start.go:364] duration metric: took 196.45µs to acquireMachinesLock for "ha-447944"
I0214 03:02:06.499629 1503804 start.go:93] Provisioning new machine with config: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:
9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:02:06.500061 1503804 start.go:125] createHost starting for "" (driver="kvm2")
I0214 03:02:06.501824 1503804 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0214 03:02:06.501980 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:02:06.502021 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:02:06.516656 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38091
I0214 03:02:06.517182 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:02:06.517760 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:02:06.517785 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:02:06.518163 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:02:06.518348 1503804 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:02:06.518514 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:06.518653 1503804 start.go:159] libmachine.API.Create for "ha-447944" (driver="kvm2")
I0214 03:02:06.518673 1503804 client.go:168] LocalClient.Create starting
I0214 03:02:06.518696 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 03:02:06.518724 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:02:06.518738 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:02:06.518805 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 03:02:06.518828 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:02:06.518840 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:02:06.518865 1503804 main.go:141] libmachine: Running pre-create checks...
I0214 03:02:06.518877 1503804 main.go:141] libmachine: (ha-447944) Calling .PreCreateCheck
I0214 03:02:06.519291 1503804 main.go:141] libmachine: (ha-447944) Calling .GetConfigRaw
I0214 03:02:06.519670 1503804 main.go:141] libmachine: Creating machine...
I0214 03:02:06.519683 1503804 main.go:141] libmachine: (ha-447944) Calling .Create
I0214 03:02:06.519804 1503804 main.go:141] libmachine: (ha-447944) Creating KVM machine...
I0214 03:02:06.521016 1503804 main.go:141] libmachine: (ha-447944) DBG | found existing default KVM network
I0214 03:02:06.521755 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:06.521629 1503826 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015a40}
I0214 03:02:06.521806 1503804 main.go:141] libmachine: (ha-447944) DBG | created network xml:
I0214 03:02:06.521830 1503804 main.go:141] libmachine: (ha-447944) DBG | <network>
I0214 03:02:06.521838 1503804 main.go:141] libmachine: (ha-447944) DBG | <name>mk-ha-447944</name>
I0214 03:02:06.521851 1503804 main.go:141] libmachine: (ha-447944) DBG | <dns enable='no'/>
I0214 03:02:06.521865 1503804 main.go:141] libmachine: (ha-447944) DBG |
I0214 03:02:06.521877 1503804 main.go:141] libmachine: (ha-447944) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0214 03:02:06.521896 1503804 main.go:141] libmachine: (ha-447944) DBG | <dhcp>
I0214 03:02:06.521911 1503804 main.go:141] libmachine: (ha-447944) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0214 03:02:06.521921 1503804 main.go:141] libmachine: (ha-447944) DBG | </dhcp>
I0214 03:02:06.521939 1503804 main.go:141] libmachine: (ha-447944) DBG | </ip>
I0214 03:02:06.521952 1503804 main.go:141] libmachine: (ha-447944) DBG |
I0214 03:02:06.521964 1503804 main.go:141] libmachine: (ha-447944) DBG | </network>
I0214 03:02:06.521978 1503804 main.go:141] libmachine: (ha-447944) DBG |
I0214 03:02:06.526953 1503804 main.go:141] libmachine: (ha-447944) DBG | trying to create private KVM network mk-ha-447944 192.168.39.0/24...
I0214 03:02:06.597016 1503804 main.go:141] libmachine: (ha-447944) DBG | private KVM network mk-ha-447944 192.168.39.0/24 created
I0214 03:02:06.597052 1503804 main.go:141] libmachine: (ha-447944) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944 ...
I0214 03:02:06.597068 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:06.596959 1503826 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:02:06.597099 1503804 main.go:141] libmachine: (ha-447944) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 03:02:06.597118 1503804 main.go:141] libmachine: (ha-447944) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 03:02:06.844263 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:06.844129 1503826 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa...
I0214 03:02:07.024600 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:07.024464 1503826 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/ha-447944.rawdisk...
I0214 03:02:07.024633 1503804 main.go:141] libmachine: (ha-447944) DBG | Writing magic tar header
I0214 03:02:07.024649 1503804 main.go:141] libmachine: (ha-447944) DBG | Writing SSH key tar header
I0214 03:02:07.024666 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:07.024593 1503826 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944 ...
I0214 03:02:07.024736 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944
I0214 03:02:07.024777 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944 (perms=drwx------)
I0214 03:02:07.024789 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 03:02:07.024841 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 03:02:07.024882 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 03:02:07.024895 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:02:07.024918 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 03:02:07.024932 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 03:02:07.024945 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins
I0214 03:02:07.024959 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home
I0214 03:02:07.024981 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 03:02:07.024994 1503804 main.go:141] libmachine: (ha-447944) DBG | Skipping /home - not owner
I0214 03:02:07.025011 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 03:02:07.025024 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 03:02:07.025040 1503804 main.go:141] libmachine: (ha-447944) Creating domain...
I0214 03:02:07.026147 1503804 main.go:141] libmachine: (ha-447944) define libvirt domain using xml:
I0214 03:02:07.026165 1503804 main.go:141] libmachine: (ha-447944) <domain type='kvm'>
I0214 03:02:07.026178 1503804 main.go:141] libmachine: (ha-447944) <name>ha-447944</name>
I0214 03:02:07.026187 1503804 main.go:141] libmachine: (ha-447944) <memory unit='MiB'>2200</memory>
I0214 03:02:07.026204 1503804 main.go:141] libmachine: (ha-447944) <vcpu>2</vcpu>
I0214 03:02:07.026212 1503804 main.go:141] libmachine: (ha-447944) <features>
I0214 03:02:07.026224 1503804 main.go:141] libmachine: (ha-447944) <acpi/>
I0214 03:02:07.026234 1503804 main.go:141] libmachine: (ha-447944) <apic/>
I0214 03:02:07.026288 1503804 main.go:141] libmachine: (ha-447944) <pae/>
I0214 03:02:07.026322 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.026332 1503804 main.go:141] libmachine: (ha-447944) </features>
I0214 03:02:07.026342 1503804 main.go:141] libmachine: (ha-447944) <cpu mode='host-passthrough'>
I0214 03:02:07.026352 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.026358 1503804 main.go:141] libmachine: (ha-447944) </cpu>
I0214 03:02:07.026366 1503804 main.go:141] libmachine: (ha-447944) <os>
I0214 03:02:07.026372 1503804 main.go:141] libmachine: (ha-447944) <type>hvm</type>
I0214 03:02:07.026381 1503804 main.go:141] libmachine: (ha-447944) <boot dev='cdrom'/>
I0214 03:02:07.026387 1503804 main.go:141] libmachine: (ha-447944) <boot dev='hd'/>
I0214 03:02:07.026396 1503804 main.go:141] libmachine: (ha-447944) <bootmenu enable='no'/>
I0214 03:02:07.026405 1503804 main.go:141] libmachine: (ha-447944) </os>
I0214 03:02:07.026412 1503804 main.go:141] libmachine: (ha-447944) <devices>
I0214 03:02:07.026424 1503804 main.go:141] libmachine: (ha-447944) <disk type='file' device='cdrom'>
I0214 03:02:07.026461 1503804 main.go:141] libmachine: (ha-447944) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/boot2docker.iso'/>
I0214 03:02:07.026490 1503804 main.go:141] libmachine: (ha-447944) <target dev='hdc' bus='scsi'/>
I0214 03:02:07.026506 1503804 main.go:141] libmachine: (ha-447944) <readonly/>
I0214 03:02:07.026518 1503804 main.go:141] libmachine: (ha-447944) </disk>
I0214 03:02:07.026534 1503804 main.go:141] libmachine: (ha-447944) <disk type='file' device='disk'>
I0214 03:02:07.026549 1503804 main.go:141] libmachine: (ha-447944) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 03:02:07.026569 1503804 main.go:141] libmachine: (ha-447944) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/ha-447944.rawdisk'/>
I0214 03:02:07.026587 1503804 main.go:141] libmachine: (ha-447944) <target dev='hda' bus='virtio'/>
I0214 03:02:07.026601 1503804 main.go:141] libmachine: (ha-447944) </disk>
I0214 03:02:07.026613 1503804 main.go:141] libmachine: (ha-447944) <interface type='network'>
I0214 03:02:07.026628 1503804 main.go:141] libmachine: (ha-447944) <source network='mk-ha-447944'/>
I0214 03:02:07.026640 1503804 main.go:141] libmachine: (ha-447944) <model type='virtio'/>
I0214 03:02:07.026654 1503804 main.go:141] libmachine: (ha-447944) </interface>
I0214 03:02:07.026667 1503804 main.go:141] libmachine: (ha-447944) <interface type='network'>
I0214 03:02:07.026682 1503804 main.go:141] libmachine: (ha-447944) <source network='default'/>
I0214 03:02:07.026695 1503804 main.go:141] libmachine: (ha-447944) <model type='virtio'/>
I0214 03:02:07.026709 1503804 main.go:141] libmachine: (ha-447944) </interface>
I0214 03:02:07.026726 1503804 main.go:141] libmachine: (ha-447944) <serial type='pty'>
I0214 03:02:07.026740 1503804 main.go:141] libmachine: (ha-447944) <target port='0'/>
I0214 03:02:07.026752 1503804 main.go:141] libmachine: (ha-447944) </serial>
I0214 03:02:07.026767 1503804 main.go:141] libmachine: (ha-447944) <console type='pty'>
I0214 03:02:07.026787 1503804 main.go:141] libmachine: (ha-447944) <target type='serial' port='0'/>
I0214 03:02:07.026800 1503804 main.go:141] libmachine: (ha-447944) </console>
I0214 03:02:07.026824 1503804 main.go:141] libmachine: (ha-447944) <rng model='virtio'>
I0214 03:02:07.026845 1503804 main.go:141] libmachine: (ha-447944) <backend model='random'>/dev/random</backend>
I0214 03:02:07.026861 1503804 main.go:141] libmachine: (ha-447944) </rng>
I0214 03:02:07.026873 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.026888 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.026901 1503804 main.go:141] libmachine: (ha-447944) </devices>
I0214 03:02:07.026924 1503804 main.go:141] libmachine: (ha-447944) </domain>
I0214 03:02:07.026943 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.030918 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:b6:93:8c in network default
I0214 03:02:07.031537 1503804 main.go:141] libmachine: (ha-447944) Ensuring networks are active...
I0214 03:02:07.031566 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:07.032152 1503804 main.go:141] libmachine: (ha-447944) Ensuring network default is active
I0214 03:02:07.032440 1503804 main.go:141] libmachine: (ha-447944) Ensuring network mk-ha-447944 is active
I0214 03:02:07.032942 1503804 main.go:141] libmachine: (ha-447944) Getting domain xml...
I0214 03:02:07.033605 1503804 main.go:141] libmachine: (ha-447944) Creating domain...
I0214 03:02:08.200936 1503804 main.go:141] libmachine: (ha-447944) Waiting to get IP...
I0214 03:02:08.201721 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:08.202064 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:08.202125 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:08.202062 1503826 retry.go:31] will retry after 261.415024ms: waiting for machine to come up
I0214 03:02:08.465569 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:08.466098 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:08.466135 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:08.466043 1503826 retry.go:31] will retry after 298.375096ms: waiting for machine to come up
I0214 03:02:08.766519 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:08.767028 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:08.767060 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:08.766950 1503826 retry.go:31] will retry after 484.028678ms: waiting for machine to come up
I0214 03:02:09.252659 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:09.253166 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:09.253191 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:09.253125 1503826 retry.go:31] will retry after 511.297559ms: waiting for machine to come up
I0214 03:02:09.765825 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:09.766243 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:09.766273 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:09.766181 1503826 retry.go:31] will retry after 681.270558ms: waiting for machine to come up
I0214 03:02:10.449184 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:10.449660 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:10.449690 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:10.449604 1503826 retry.go:31] will retry after 813.721958ms: waiting for machine to come up
I0214 03:02:11.264660 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:11.265142 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:11.265167 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:11.265079 1503826 retry.go:31] will retry after 1.115840924s: waiting for machine to come up
I0214 03:02:12.382904 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:12.383359 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:12.383389 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:12.383308 1503826 retry.go:31] will retry after 1.155677584s: waiting for machine to come up
I0214 03:02:13.540618 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:13.541036 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:13.541074 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:13.540979 1503826 retry.go:31] will retry after 1.26741669s: waiting for machine to come up
I0214 03:02:14.810419 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:14.810845 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:14.810886 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:14.810793 1503826 retry.go:31] will retry after 1.868490026s: waiting for machine to come up
I0214 03:02:16.681022 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:16.681445 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:16.681511 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:16.681418 1503826 retry.go:31] will retry after 2.868404585s: waiting for machine to come up
I0214 03:02:19.551267 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:19.551720 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:19.551752 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:19.551661 1503826 retry.go:31] will retry after 2.870927106s: waiting for machine to come up
I0214 03:02:22.423787 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:22.424284 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:22.424311 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:22.424205 1503826 retry.go:31] will retry after 3.092953895s: waiting for machine to come up
I0214 03:02:25.520438 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:25.520791 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:25.520812 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:25.520753 1503826 retry.go:31] will retry after 5.073865047s: waiting for machine to come up
I0214 03:02:30.599483 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.599885 1503804 main.go:141] libmachine: (ha-447944) Found IP for machine: 192.168.39.41
I0214 03:02:30.599913 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has current primary IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.599922 1503804 main.go:141] libmachine: (ha-447944) Reserving static IP address...
I0214 03:02:30.600338 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find host DHCP lease matching {name: "ha-447944", mac: "52:54:00:c5:66:e2", ip: "192.168.39.41"} in network mk-ha-447944
I0214 03:02:30.675093 1503804 main.go:141] libmachine: (ha-447944) DBG | Getting to WaitForSSH function...
I0214 03:02:30.675135 1503804 main.go:141] libmachine: (ha-447944) Reserved static IP address: 192.168.39.41
I0214 03:02:30.675149 1503804 main.go:141] libmachine: (ha-447944) Waiting for SSH to be available...
I0214 03:02:30.677694 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.678089 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:30.678119 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.678254 1503804 main.go:141] libmachine: (ha-447944) DBG | Using SSH client type: external
I0214 03:02:30.678278 1503804 main.go:141] libmachine: (ha-447944) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa (-rw-------)
I0214 03:02:30.678310 1503804 main.go:141] libmachine: (ha-447944) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.41 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 03:02:30.678327 1503804 main.go:141] libmachine: (ha-447944) DBG | About to run SSH command:
I0214 03:02:30.678361 1503804 main.go:141] libmachine: (ha-447944) DBG | exit 0
I0214 03:02:30.769060 1503804 main.go:141] libmachine: (ha-447944) DBG | SSH cmd err, output: <nil>:
I0214 03:02:30.769301 1503804 main.go:141] libmachine: (ha-447944) KVM machine creation complete!
I0214 03:02:30.769762 1503804 main.go:141] libmachine: (ha-447944) Calling .GetConfigRaw
I0214 03:02:30.770309 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:30.770511 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:30.770619 1503804 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 03:02:30.770629 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:02:30.772010 1503804 main.go:141] libmachine: Detecting operating system of created instance...
I0214 03:02:30.772031 1503804 main.go:141] libmachine: Waiting for SSH to be available...
I0214 03:02:30.772038 1503804 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 03:02:30.772045 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:30.774403 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.774759 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:30.774796 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.774897 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:30.775118 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:30.775291 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:30.775458 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:30.775647 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:30.776084 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:30.776100 1503804 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 03:02:30.896212 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:02:30.896243 1503804 main.go:141] libmachine: Detecting the provisioner...
I0214 03:02:30.896256 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:30.898958 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.899283 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:30.899311 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.899498 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:30.899695 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:30.899863 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:30.899965 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:30.900125 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:30.900587 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:30.900605 1503804 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 03:02:31.021995 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:02:31.022076 1503804 main.go:141] libmachine: found compatible host: buildroot
I0214 03:02:31.022092 1503804 main.go:141] libmachine: Provisioning with buildroot...
I0214 03:02:31.022107 1503804 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:02:31.022392 1503804 buildroot.go:166] provisioning hostname "ha-447944"
I0214 03:02:31.022417 1503804 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:02:31.022627 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.025568 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.025922 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.025948 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.026059 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.026243 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.026416 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.026567 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.026747 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:31.027069 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:31.027082 1503804 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-447944 && echo "ha-447944" | sudo tee /etc/hostname
I0214 03:02:31.161199 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944
I0214 03:02:31.161229 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.164307 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.164779 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.164809 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.165004 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.165213 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.165415 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.165606 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.165781 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:31.166126 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:31.166151 1503804 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-447944' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-447944/g' /etc/hosts;
else
echo '127.0.1.1 ha-447944' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:02:31.292294 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:02:31.292334 1503804 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:02:31.292385 1503804 buildroot.go:174] setting up certificates
I0214 03:02:31.292398 1503804 provision.go:84] configureAuth start
I0214 03:02:31.292418 1503804 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:02:31.292691 1503804 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:02:31.295249 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.295672 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.295700 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.295804 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.298089 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.298420 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.298450 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.298557 1503804 provision.go:143] copyHostCerts
I0214 03:02:31.298591 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:02:31.298632 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:02:31.298649 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:02:31.298715 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:02:31.298792 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:02:31.298810 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:02:31.298816 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:02:31.298841 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:02:31.298901 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:02:31.298920 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:02:31.298924 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:02:31.298945 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:02:31.299039 1503804 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ha-447944 san=[127.0.0.1 192.168.39.41 ha-447944 localhost minikube]
I0214 03:02:31.485425 1503804 provision.go:177] copyRemoteCerts
I0214 03:02:31.485509 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:02:31.485540 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.488400 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.488852 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.488893 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.489090 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.489301 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.489470 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.489661 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:02:31.583003 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:02:31.583073 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:02:31.604312 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:02:31.604381 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)
I0214 03:02:31.625150 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:02:31.625232 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 03:02:31.645972 1503804 provision.go:87] duration metric: took 353.559512ms to configureAuth
I0214 03:02:31.646005 1503804 buildroot.go:189] setting minikube options for container-runtime
I0214 03:02:31.646192 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:02:31.646290 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.649166 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.649591 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.649619 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.649830 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.650037 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.650219 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.650349 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.650526 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:31.650975 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:31.651013 1503804 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:02:31.987159 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:02:31.987206 1503804 main.go:141] libmachine: Checking connection to Docker...
I0214 03:02:31.987216 1503804 main.go:141] libmachine: (ha-447944) Calling .GetURL
I0214 03:02:31.988510 1503804 main.go:141] libmachine: (ha-447944) DBG | Using libvirt version 6000000
I0214 03:02:31.991000 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.991343 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.991363 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.991566 1503804 main.go:141] libmachine: Docker is up and running!
I0214 03:02:31.991581 1503804 main.go:141] libmachine: Reticulating splines...
I0214 03:02:31.991591 1503804 client.go:171] duration metric: took 25.47290983s to LocalClient.Create
I0214 03:02:31.991619 1503804 start.go:167] duration metric: took 25.472964862s to libmachine.API.Create "ha-447944"
I0214 03:02:31.991633 1503804 start.go:293] postStartSetup for "ha-447944" (driver="kvm2")
I0214 03:02:31.991649 1503804 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:02:31.991673 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:31.991931 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:02:31.991954 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.994229 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.994574 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.994602 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.994763 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.994962 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.995131 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.995313 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:02:32.086822 1503804 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:02:32.091499 1503804 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:02:32.091527 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:02:32.091603 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:02:32.091712 1503804 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:02:32.091723 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:02:32.091841 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:02:32.100496 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:02:32.125858 1503804 start.go:296] duration metric: took 134.20566ms for postStartSetup
I0214 03:02:32.125907 1503804 main.go:141] libmachine: (ha-447944) Calling .GetConfigRaw
I0214 03:02:32.126499 1503804 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:02:32.129197 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.129572 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.129593 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.129857 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:02:32.130037 1503804 start.go:128] duration metric: took 25.629963219s to createHost
I0214 03:02:32.130060 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:32.132221 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.132564 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.132585 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.132730 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:32.132940 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:32.133095 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:32.133232 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:32.133381 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:32.133700 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:32.133712 1503804 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:02:32.258054 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707879752.229013129
I0214 03:02:32.258085 1503804 fix.go:216] guest clock: 1707879752.229013129
I0214 03:02:32.258096 1503804 fix.go:229] Guest: 2024-02-14 03:02:32.229013129 +0000 UTC Remote: 2024-02-14 03:02:32.130048524 +0000 UTC m=+25.752251823 (delta=98.964605ms)
I0214 03:02:32.258143 1503804 fix.go:200] guest clock delta is within tolerance: 98.964605ms
I0214 03:02:32.258152 1503804 start.go:83] releasing machines lock for "ha-447944", held for 25.758545602s
I0214 03:02:32.258184 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:32.258438 1503804 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:02:32.260956 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.261330 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.261375 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.261500 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:32.262008 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:32.262182 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:32.262271 1503804 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:02:32.262327 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:32.262370 1503804 ssh_runner.go:195] Run: cat /version.json
I0214 03:02:32.262397 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:32.265078 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.265121 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.265437 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.265479 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.265498 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.265522 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.265634 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:32.265861 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:32.265873 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:32.266062 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:32.266097 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:32.266239 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:32.266237 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:02:32.266367 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:02:32.350033 1503804 ssh_runner.go:195] Run: systemctl --version
I0214 03:02:32.380053 1503804 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:02:32.534686 1503804 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:02:32.540821 1503804 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:02:32.540905 1503804 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:02:32.555078 1503804 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 03:02:32.555107 1503804 start.go:494] detecting cgroup driver to use...
I0214 03:02:32.555205 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:02:32.568577 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:02:32.581203 1503804 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:02:32.581277 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:02:32.593477 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:02:32.605489 1503804 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:02:32.704529 1503804 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:02:32.830993 1503804 docker.go:233] disabling docker service ...
I0214 03:02:32.831063 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:02:32.844703 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:02:32.856763 1503804 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:02:32.970546 1503804 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:02:33.077589 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:02:33.090111 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:02:33.106290 1503804 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:02:33.106374 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:02:33.116458 1503804 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:02:33.116538 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:02:33.126400 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:02:33.136210 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:02:33.145779 1503804 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:02:33.155797 1503804 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:02:33.164658 1503804 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 03:02:33.164732 1503804 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 03:02:33.177818 1503804 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:02:33.186561 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:02:33.289562 1503804 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:02:33.447291 1503804 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:02:33.447363 1503804 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:02:33.452437 1503804 start.go:562] Will wait 60s for crictl version
I0214 03:02:33.452484 1503804 ssh_runner.go:195] Run: which crictl
I0214 03:02:33.456099 1503804 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:02:33.494745 1503804 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:02:33.494822 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:02:33.544007 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:02:33.592475 1503804 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:02:33.593863 1503804 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:02:33.596916 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:33.597376 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:33.597407 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:33.597623 1503804 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:02:33.601811 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:02:33.614034 1503804 kubeadm.go:877] updating cluster {Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cl
usterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mo
untType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 03:02:33.614149 1503804 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:02:33.614194 1503804 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:02:33.649014 1503804 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 03:02:33.649101 1503804 ssh_runner.go:195] Run: which lz4
I0214 03:02:33.653262 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4
I0214 03:02:33.653379 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 03:02:33.657809 1503804 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 03:02:33.657843 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 03:02:35.450509 1503804 crio.go:444] duration metric: took 1.797164405s to copy over tarball
I0214 03:02:35.450599 1503804 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 03:02:38.263977 1503804 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.813337239s)
I0214 03:02:38.264067 1503804 crio.go:451] duration metric: took 2.813517611s to extract the tarball
I0214 03:02:38.264082 1503804 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 03:02:38.307152 1503804 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:02:38.383125 1503804 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:02:38.383156 1503804 cache_images.go:84] Images are preloaded, skipping loading
I0214 03:02:38.383175 1503804 kubeadm.go:928] updating node { 192.168.39.41 8443 v1.28.4 crio true true} ...
I0214 03:02:38.383331 1503804 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-447944 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.41
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:02:38.383424 1503804 ssh_runner.go:195] Run: crio config
I0214 03:02:38.451263 1503804 cni.go:84] Creating CNI manager for ""
I0214 03:02:38.451295 1503804 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I0214 03:02:38.451310 1503804 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 03:02:38.451336 1503804 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.41 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-447944 NodeName:ha-447944 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.41 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/m
anifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 03:02:38.451556 1503804 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.41
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "ha-447944"
kubeletExtraArgs:
node-ip: 192.168.39.41
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.41"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 03:02:38.451636 1503804 kube-vip.go:101] generating kube-vip config ...
I0214 03:02:38.451722 1503804 kube-vip.go:121] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_ddns
value: "false"
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v0.7.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0214 03:02:38.451783 1503804 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:02:38.460623 1503804 binaries.go:44] Found k8s binaries, skipping transfer
I0214 03:02:38.460710 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
I0214 03:02:38.469080 1503804 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (308 bytes)
I0214 03:02:38.485205 1503804 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:02:38.500698 1503804 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2150 bytes)
I0214 03:02:38.516212 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1265 bytes)
I0214 03:02:38.531576 1503804 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0214 03:02:38.535268 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:02:38.547329 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:02:38.648020 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:02:38.662224 1503804 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944 for IP: 192.168.39.41
I0214 03:02:38.662257 1503804 certs.go:194] generating shared ca certs ...
I0214 03:02:38.662279 1503804 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:38.662494 1503804 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:02:38.662536 1503804 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:02:38.662547 1503804 certs.go:256] generating profile certs ...
I0214 03:02:38.662668 1503804 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key
I0214 03:02:38.662687 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt with IP's: []
I0214 03:02:38.883643 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt ...
I0214 03:02:38.883677 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt: {Name:mk715eb455d450fcc18dee3b4292ec9a94f5b3cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:38.883872 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key ...
I0214 03:02:38.883887 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key: {Name:mkfbf984e664759262e4d6294d4e94c39cdafe2d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:38.884009 1503804 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.a1c30460
I0214 03:02:38.884033 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.a1c30460 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41 192.168.39.254]
I0214 03:02:39.016938 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.a1c30460 ...
I0214 03:02:39.016973 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.a1c30460: {Name:mkd9280721df84084591dc9afbc28af8a8283b55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:39.017147 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.a1c30460 ...
I0214 03:02:39.017169 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.a1c30460: {Name:mkcae7fee47ff2703df685bf65ef58c5bb561973 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:39.017294 1503804 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.a1c30460 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt
I0214 03:02:39.017392 1503804 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.a1c30460 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key
I0214 03:02:39.017475 1503804 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key
I0214 03:02:39.017495 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt with IP's: []
I0214 03:02:39.066438 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt ...
I0214 03:02:39.066470 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt: {Name:mkcd5a5a6408fb078830c81b823b48b3e6e4b986 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:39.066636 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key ...
I0214 03:02:39.066655 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key: {Name:mkb12bbf65f35f264a3075eda0479430b90b2215 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:39.066746 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:02:39.066770 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:02:39.066789 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:02:39.066809 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:02:39.066836 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:02:39.066864 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:02:39.066884 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:02:39.066909 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:02:39.066974 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:02:39.067023 1503804 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:02:39.067038 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:02:39.067074 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:02:39.067115 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:02:39.067147 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:02:39.067199 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:02:39.067235 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:02:39.067255 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:02:39.067272 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:02:39.067895 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:02:39.091878 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:02:39.113839 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:02:39.135643 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:02:39.157850 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 03:02:39.180369 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 03:02:39.202648 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:02:39.224769 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:02:39.247075 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:02:39.269360 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:02:39.291566 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:02:39.313810 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 03:02:39.329261 1503804 ssh_runner.go:195] Run: openssl version
I0214 03:02:39.334529 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:02:39.343429 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:02:39.347583 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:02:39.347626 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:02:39.352800 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:02:39.361822 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:02:39.371020 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:02:39.375619 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:02:39.375679 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:02:39.380843 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:02:39.390215 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:02:39.399835 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:02:39.404538 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:02:39.404579 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:02:39.410340 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:02:39.421139 1503804 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:02:39.424981 1503804 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 03:02:39.425038 1503804 kubeadm.go:391] StartCluster: {Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Clust
erName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mount
Type:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:02:39.425130 1503804 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 03:02:39.425175 1503804 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 03:02:39.462656 1503804 cri.go:89] found id: ""
I0214 03:02:39.462743 1503804 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0214 03:02:39.474576 1503804 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 03:02:39.483389 1503804 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 03:02:39.506081 1503804 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 03:02:39.506113 1503804 kubeadm.go:156] found existing configuration files:
I0214 03:02:39.506174 1503804 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 03:02:39.518494 1503804 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 03:02:39.518551 1503804 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 03:02:39.531055 1503804 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 03:02:39.542552 1503804 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 03:02:39.542618 1503804 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 03:02:39.552136 1503804 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 03:02:39.563396 1503804 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 03:02:39.563482 1503804 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 03:02:39.575050 1503804 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 03:02:39.583653 1503804 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 03:02:39.583733 1503804 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 03:02:39.592502 1503804 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 03:02:39.702502 1503804 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 03:02:39.702747 1503804 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 03:02:39.824751 1503804 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 03:02:39.824898 1503804 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 03:02:39.824997 1503804 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 03:02:40.049625 1503804 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 03:02:40.132812 1503804 out.go:204] - Generating certificates and keys ...
I0214 03:02:40.132920 1503804 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 03:02:40.133018 1503804 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 03:02:40.149818 1503804 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 03:02:40.254961 1503804 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 03:02:40.358060 1503804 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 03:02:40.484404 1503804 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 03:02:40.595769 1503804 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 03:02:40.596185 1503804 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-447944 localhost] and IPs [192.168.39.41 127.0.0.1 ::1]
I0214 03:02:40.861906 1503804 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 03:02:40.862117 1503804 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-447944 localhost] and IPs [192.168.39.41 127.0.0.1 ::1]
I0214 03:02:41.009073 1503804 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 03:02:41.081786 1503804 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 03:02:41.163074 1503804 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 03:02:41.163427 1503804 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 03:02:41.225455 1503804 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 03:02:41.573963 1503804 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 03:02:41.908167 1503804 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 03:02:42.126990 1503804 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 03:02:42.127574 1503804 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 03:02:42.132715 1503804 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 03:02:42.134904 1503804 out.go:204] - Booting up control plane ...
I0214 03:02:42.134986 1503804 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 03:02:42.135051 1503804 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 03:02:42.135106 1503804 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 03:02:42.147938 1503804 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 03:02:42.148849 1503804 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 03:02:42.148901 1503804 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 03:02:42.260407 1503804 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 03:02:51.831896 1503804 kubeadm.go:309] [apiclient] All control plane components are healthy after 9.576249 seconds
I0214 03:02:51.832092 1503804 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 03:02:51.854298 1503804 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 03:02:52.394069 1503804 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 03:02:52.394340 1503804 kubeadm.go:309] [mark-control-plane] Marking the node ha-447944 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 03:02:52.908467 1503804 kubeadm.go:309] [bootstrap-token] Using token: isaxlc.jf8d2khhxbct4th6
I0214 03:02:52.909874 1503804 out.go:204] - Configuring RBAC rules ...
I0214 03:02:52.910038 1503804 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 03:02:52.916291 1503804 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 03:02:52.923485 1503804 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 03:02:52.930312 1503804 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 03:02:52.936606 1503804 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 03:02:52.940216 1503804 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 03:02:52.953914 1503804 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 03:02:53.169021 1503804 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 03:02:53.322925 1503804 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 03:02:53.322960 1503804 kubeadm.go:309]
I0214 03:02:53.323033 1503804 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 03:02:53.323044 1503804 kubeadm.go:309]
I0214 03:02:53.323125 1503804 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 03:02:53.323135 1503804 kubeadm.go:309]
I0214 03:02:53.323169 1503804 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 03:02:53.323246 1503804 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 03:02:53.323346 1503804 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 03:02:53.323373 1503804 kubeadm.go:309]
I0214 03:02:53.323461 1503804 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 03:02:53.323472 1503804 kubeadm.go:309]
I0214 03:02:53.323549 1503804 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 03:02:53.323566 1503804 kubeadm.go:309]
I0214 03:02:53.323654 1503804 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 03:02:53.323774 1503804 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 03:02:53.323873 1503804 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 03:02:53.323883 1503804 kubeadm.go:309]
I0214 03:02:53.323987 1503804 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 03:02:53.324095 1503804 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 03:02:53.324108 1503804 kubeadm.go:309]
I0214 03:02:53.324219 1503804 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token isaxlc.jf8d2khhxbct4th6 \
I0214 03:02:53.324366 1503804 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 03:02:53.324399 1503804 kubeadm.go:309] --control-plane
I0214 03:02:53.324423 1503804 kubeadm.go:309]
I0214 03:02:53.324537 1503804 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 03:02:53.324545 1503804 kubeadm.go:309]
I0214 03:02:53.324655 1503804 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token isaxlc.jf8d2khhxbct4th6 \
I0214 03:02:53.324795 1503804 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 03:02:53.324959 1503804 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 03:02:53.324986 1503804 cni.go:84] Creating CNI manager for ""
I0214 03:02:53.324999 1503804 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I0214 03:02:53.326762 1503804 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0214 03:02:53.328081 1503804 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0214 03:02:53.344602 1503804 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.4/kubectl ...
I0214 03:02:53.344630 1503804 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0214 03:02:53.380152 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0214 03:02:54.357399 1503804 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 03:02:54.357524 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:54.357539 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-447944 minikube.k8s.io/updated_at=2024_02_14T03_02_54_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=ha-447944 minikube.k8s.io/primary=true
I0214 03:02:54.561590 1503804 ops.go:34] apiserver oom_adj: -16
I0214 03:02:54.561757 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:55.062080 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:55.562833 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:56.062070 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:56.562125 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:57.061992 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:57.561838 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:58.062761 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:58.562482 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:59.062745 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:59.562508 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:00.061823 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:00.562473 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:01.061902 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:01.562331 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:02.061975 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:02.562086 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:03.062735 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:03.562472 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:03.702621 1503804 kubeadm.go:1106] duration metric: took 9.345179121s to wait for elevateKubeSystemPrivileges
W0214 03:03:03.702684 1503804 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 03:03:03.702695 1503804 kubeadm.go:393] duration metric: took 24.277662415s to StartCluster
I0214 03:03:03.702717 1503804 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:03.702801 1503804 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:03:03.703575 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:03.703846 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0214 03:03:03.703860 1503804 start.go:232] HA cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:03:03.703885 1503804 start.go:240] waiting for startup goroutines ...
I0214 03:03:03.703896 1503804 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 03:03:03.703954 1503804 addons.go:69] Setting storage-provisioner=true in profile "ha-447944"
I0214 03:03:03.703973 1503804 addons.go:69] Setting default-storageclass=true in profile "ha-447944"
I0214 03:03:03.704034 1503804 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-447944"
I0214 03:03:03.703985 1503804 addons.go:234] Setting addon storage-provisioner=true in "ha-447944"
I0214 03:03:03.704111 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:03:03.704154 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:03:03.704537 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.704565 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.704572 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.704590 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.719066 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40917
I0214 03:03:03.719492 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.719962 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.719983 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.720331 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.720553 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:03:03.722831 1503804 loader.go:395] Config loaded from file: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:03:03.723212 1503804 kapi.go:59] client config for ha-447944: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]strin
g(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0214 03:03:03.723944 1503804 cert_rotation.go:137] Starting client certificate rotation controller
I0214 03:03:03.724301 1503804 addons.go:234] Setting addon default-storageclass=true in "ha-447944"
I0214 03:03:03.724349 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:03:03.724661 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.724685 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.724834 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39961
I0214 03:03:03.725267 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.725742 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.725764 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.726131 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.726628 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.726655 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.739542 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33875
I0214 03:03:03.740011 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.740121 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33345
I0214 03:03:03.740592 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.740614 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.740633 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.740969 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.741083 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.741108 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.741471 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.741627 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:03:03.741726 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.741763 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.743342 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:03:03.745887 1503804 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 03:03:03.747354 1503804 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 03:03:03.747372 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 03:03:03.747385 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:03:03.750821 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:03.751303 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:03:03.751330 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:03.751543 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:03:03.751695 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:03:03.751813 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:03:03.751938 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:03:03.756311 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40603
I0214 03:03:03.756634 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.757063 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.757087 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.757416 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.757627 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:03:03.759052 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:03:03.759338 1503804 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 03:03:03.759354 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 03:03:03.759367 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:03:03.762236 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:03.762568 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:03:03.762611 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:03.762789 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:03:03.762962 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:03:03.763129 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:03:03.763301 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:03:03.862307 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0214 03:03:03.918088 1503804 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 03:03:03.931351 1503804 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 03:03:04.612774 1503804 start.go:948] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I0214 03:03:04.682143 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:04.682178 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:04.682478 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:04.682493 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:04.682503 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:04.682510 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:04.682781 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:04.682801 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:04.682937 1503804 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses
I0214 03:03:04.682952 1503804 round_trippers.go:469] Request Headers:
I0214 03:03:04.682963 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:03:04.682976 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:03:04.741577 1503804 round_trippers.go:574] Response Status: 200 OK in 58 milliseconds
I0214 03:03:04.743646 1503804 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard
I0214 03:03:04.743667 1503804 round_trippers.go:469] Request Headers:
I0214 03:03:04.743679 1503804 round_trippers.go:473] Content-Type: application/json
I0214 03:03:04.743687 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:03:04.743696 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:03:04.790312 1503804 round_trippers.go:574] Response Status: 200 OK in 46 milliseconds
I0214 03:03:04.811062 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:04.811107 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:04.811458 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:04.811484 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:05.022065 1503804 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.090672614s)
I0214 03:03:05.022124 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:05.022138 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:05.022481 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:05.022505 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:05.022517 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:05.022527 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:05.022793 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:05.022813 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:05.024464 1503804 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I0214 03:03:05.025612 1503804 addons.go:505] duration metric: took 1.321714929s for enable addons: enabled=[default-storageclass storage-provisioner]
I0214 03:03:05.025647 1503804 start.go:245] waiting for cluster config update ...
I0214 03:03:05.025663 1503804 start.go:254] writing updated cluster config ...
I0214 03:03:05.027099 1503804 out.go:177]
I0214 03:03:05.028388 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:03:05.028460 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:03:05.029880 1503804 out.go:177] * Starting "ha-447944-m02" control-plane node in "ha-447944" cluster
I0214 03:03:05.030956 1503804 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:03:05.030975 1503804 cache.go:56] Caching tarball of preloaded images
I0214 03:03:05.031049 1503804 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:03:05.031059 1503804 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:03:05.031146 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:03:05.031328 1503804 start.go:360] acquireMachinesLock for ha-447944-m02: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:03:05.031385 1503804 start.go:364] duration metric: took 30.606µs to acquireMachinesLock for "ha-447944-m02"
I0214 03:03:05.031412 1503804 start.go:93] Provisioning new machine with config: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cert
Expiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:03:05.031504 1503804 start.go:125] createHost starting for "m02" (driver="kvm2")
I0214 03:03:05.033058 1503804 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0214 03:03:05.033143 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:05.033167 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:05.047737 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44665
I0214 03:03:05.048192 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:05.048773 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:05.048808 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:05.049131 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:05.049382 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetMachineName
I0214 03:03:05.049531 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:05.049661 1503804 start.go:159] libmachine.API.Create for "ha-447944" (driver="kvm2")
I0214 03:03:05.049692 1503804 client.go:168] LocalClient.Create starting
I0214 03:03:05.049735 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 03:03:05.049780 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:03:05.049800 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:03:05.049867 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 03:03:05.049899 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:03:05.049916 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:03:05.049941 1503804 main.go:141] libmachine: Running pre-create checks...
I0214 03:03:05.049954 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .PreCreateCheck
I0214 03:03:05.050087 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetConfigRaw
I0214 03:03:05.050532 1503804 main.go:141] libmachine: Creating machine...
I0214 03:03:05.050553 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .Create
I0214 03:03:05.050724 1503804 main.go:141] libmachine: (ha-447944-m02) Creating KVM machine...
I0214 03:03:05.051966 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found existing default KVM network
I0214 03:03:05.052088 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found existing private KVM network mk-ha-447944
I0214 03:03:05.052247 1503804 main.go:141] libmachine: (ha-447944-m02) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02 ...
I0214 03:03:05.052274 1503804 main.go:141] libmachine: (ha-447944-m02) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 03:03:05.052355 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:05.052229 1504170 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:03:05.052432 1503804 main.go:141] libmachine: (ha-447944-m02) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 03:03:05.293240 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:05.293059 1504170 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa...
I0214 03:03:05.380963 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:05.380834 1504170 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/ha-447944-m02.rawdisk...
I0214 03:03:05.380998 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Writing magic tar header
I0214 03:03:05.381008 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Writing SSH key tar header
I0214 03:03:05.381016 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:05.380977 1504170 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02 ...
I0214 03:03:05.381153 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02
I0214 03:03:05.381203 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02 (perms=drwx------)
I0214 03:03:05.381223 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 03:03:05.381245 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:03:05.381274 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 03:03:05.381289 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 03:03:05.381301 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 03:03:05.381318 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 03:03:05.381333 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 03:03:05.381348 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 03:03:05.381363 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 03:03:05.381374 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins
I0214 03:03:05.381404 1503804 main.go:141] libmachine: (ha-447944-m02) Creating domain...
I0214 03:03:05.381417 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home
I0214 03:03:05.381430 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Skipping /home - not owner
I0214 03:03:05.382416 1503804 main.go:141] libmachine: (ha-447944-m02) define libvirt domain using xml:
I0214 03:03:05.382441 1503804 main.go:141] libmachine: (ha-447944-m02) <domain type='kvm'>
I0214 03:03:05.382454 1503804 main.go:141] libmachine: (ha-447944-m02) <name>ha-447944-m02</name>
I0214 03:03:05.382467 1503804 main.go:141] libmachine: (ha-447944-m02) <memory unit='MiB'>2200</memory>
I0214 03:03:05.382479 1503804 main.go:141] libmachine: (ha-447944-m02) <vcpu>2</vcpu>
I0214 03:03:05.382497 1503804 main.go:141] libmachine: (ha-447944-m02) <features>
I0214 03:03:05.382505 1503804 main.go:141] libmachine: (ha-447944-m02) <acpi/>
I0214 03:03:05.382513 1503804 main.go:141] libmachine: (ha-447944-m02) <apic/>
I0214 03:03:05.382525 1503804 main.go:141] libmachine: (ha-447944-m02) <pae/>
I0214 03:03:05.382536 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.382548 1503804 main.go:141] libmachine: (ha-447944-m02) </features>
I0214 03:03:05.382557 1503804 main.go:141] libmachine: (ha-447944-m02) <cpu mode='host-passthrough'>
I0214 03:03:05.382563 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.382570 1503804 main.go:141] libmachine: (ha-447944-m02) </cpu>
I0214 03:03:05.382576 1503804 main.go:141] libmachine: (ha-447944-m02) <os>
I0214 03:03:05.382583 1503804 main.go:141] libmachine: (ha-447944-m02) <type>hvm</type>
I0214 03:03:05.382590 1503804 main.go:141] libmachine: (ha-447944-m02) <boot dev='cdrom'/>
I0214 03:03:05.382599 1503804 main.go:141] libmachine: (ha-447944-m02) <boot dev='hd'/>
I0214 03:03:05.382609 1503804 main.go:141] libmachine: (ha-447944-m02) <bootmenu enable='no'/>
I0214 03:03:05.382621 1503804 main.go:141] libmachine: (ha-447944-m02) </os>
I0214 03:03:05.382631 1503804 main.go:141] libmachine: (ha-447944-m02) <devices>
I0214 03:03:05.382644 1503804 main.go:141] libmachine: (ha-447944-m02) <disk type='file' device='cdrom'>
I0214 03:03:05.382661 1503804 main.go:141] libmachine: (ha-447944-m02) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/boot2docker.iso'/>
I0214 03:03:05.382672 1503804 main.go:141] libmachine: (ha-447944-m02) <target dev='hdc' bus='scsi'/>
I0214 03:03:05.382680 1503804 main.go:141] libmachine: (ha-447944-m02) <readonly/>
I0214 03:03:05.382685 1503804 main.go:141] libmachine: (ha-447944-m02) </disk>
I0214 03:03:05.382694 1503804 main.go:141] libmachine: (ha-447944-m02) <disk type='file' device='disk'>
I0214 03:03:05.382703 1503804 main.go:141] libmachine: (ha-447944-m02) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 03:03:05.382723 1503804 main.go:141] libmachine: (ha-447944-m02) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/ha-447944-m02.rawdisk'/>
I0214 03:03:05.382736 1503804 main.go:141] libmachine: (ha-447944-m02) <target dev='hda' bus='virtio'/>
I0214 03:03:05.382746 1503804 main.go:141] libmachine: (ha-447944-m02) </disk>
I0214 03:03:05.382759 1503804 main.go:141] libmachine: (ha-447944-m02) <interface type='network'>
I0214 03:03:05.382772 1503804 main.go:141] libmachine: (ha-447944-m02) <source network='mk-ha-447944'/>
I0214 03:03:05.382784 1503804 main.go:141] libmachine: (ha-447944-m02) <model type='virtio'/>
I0214 03:03:05.382795 1503804 main.go:141] libmachine: (ha-447944-m02) </interface>
I0214 03:03:05.382803 1503804 main.go:141] libmachine: (ha-447944-m02) <interface type='network'>
I0214 03:03:05.382813 1503804 main.go:141] libmachine: (ha-447944-m02) <source network='default'/>
I0214 03:03:05.382825 1503804 main.go:141] libmachine: (ha-447944-m02) <model type='virtio'/>
I0214 03:03:05.382837 1503804 main.go:141] libmachine: (ha-447944-m02) </interface>
I0214 03:03:05.382849 1503804 main.go:141] libmachine: (ha-447944-m02) <serial type='pty'>
I0214 03:03:05.382863 1503804 main.go:141] libmachine: (ha-447944-m02) <target port='0'/>
I0214 03:03:05.382882 1503804 main.go:141] libmachine: (ha-447944-m02) </serial>
I0214 03:03:05.382895 1503804 main.go:141] libmachine: (ha-447944-m02) <console type='pty'>
I0214 03:03:05.382905 1503804 main.go:141] libmachine: (ha-447944-m02) <target type='serial' port='0'/>
I0214 03:03:05.382912 1503804 main.go:141] libmachine: (ha-447944-m02) </console>
I0214 03:03:05.382924 1503804 main.go:141] libmachine: (ha-447944-m02) <rng model='virtio'>
I0214 03:03:05.382939 1503804 main.go:141] libmachine: (ha-447944-m02) <backend model='random'>/dev/random</backend>
I0214 03:03:05.382952 1503804 main.go:141] libmachine: (ha-447944-m02) </rng>
I0214 03:03:05.382964 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.382975 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.382987 1503804 main.go:141] libmachine: (ha-447944-m02) </devices>
I0214 03:03:05.383003 1503804 main.go:141] libmachine: (ha-447944-m02) </domain>
I0214 03:03:05.383015 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.390177 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:68:0a:ac in network default
I0214 03:03:05.390849 1503804 main.go:141] libmachine: (ha-447944-m02) Ensuring networks are active...
I0214 03:03:05.390879 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:05.391591 1503804 main.go:141] libmachine: (ha-447944-m02) Ensuring network default is active
I0214 03:03:05.391960 1503804 main.go:141] libmachine: (ha-447944-m02) Ensuring network mk-ha-447944 is active
I0214 03:03:05.392293 1503804 main.go:141] libmachine: (ha-447944-m02) Getting domain xml...
I0214 03:03:05.393073 1503804 main.go:141] libmachine: (ha-447944-m02) Creating domain...
I0214 03:03:06.596308 1503804 main.go:141] libmachine: (ha-447944-m02) Waiting to get IP...
I0214 03:03:06.597068 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:06.597519 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:06.597542 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:06.597492 1504170 retry.go:31] will retry after 275.546774ms: waiting for machine to come up
I0214 03:03:06.874971 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:06.875581 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:06.875615 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:06.875519 1504170 retry.go:31] will retry after 378.989959ms: waiting for machine to come up
I0214 03:03:07.256206 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:07.256697 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:07.256730 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:07.256634 1504170 retry.go:31] will retry after 357.175343ms: waiting for machine to come up
I0214 03:03:07.614994 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:07.615546 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:07.615579 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:07.615487 1504170 retry.go:31] will retry after 416.141863ms: waiting for machine to come up
I0214 03:03:08.032886 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:08.033284 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:08.033332 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:08.033225 1504170 retry.go:31] will retry after 489.283065ms: waiting for machine to come up
I0214 03:03:08.523858 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:08.524327 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:08.524362 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:08.524269 1504170 retry.go:31] will retry after 881.345438ms: waiting for machine to come up
I0214 03:03:09.407256 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:09.407740 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:09.407772 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:09.407698 1504170 retry.go:31] will retry after 893.378694ms: waiting for machine to come up
I0214 03:03:10.303158 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:10.303621 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:10.303687 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:10.303573 1504170 retry.go:31] will retry after 1.18385875s: waiting for machine to come up
I0214 03:03:11.488903 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:11.489368 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:11.489446 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:11.489345 1504170 retry.go:31] will retry after 1.752018652s: waiting for machine to come up
I0214 03:03:13.242608 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:13.243007 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:13.243035 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:13.242966 1504170 retry.go:31] will retry after 2.161859841s: waiting for machine to come up
I0214 03:03:15.406350 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:15.406780 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:15.406835 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:15.406744 1504170 retry.go:31] will retry after 2.101426673s: waiting for machine to come up
I0214 03:03:17.510686 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:17.511252 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:17.511290 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:17.511186 1504170 retry.go:31] will retry after 2.455890503s: waiting for machine to come up
I0214 03:03:19.969763 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:19.970191 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:19.970222 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:19.970119 1504170 retry.go:31] will retry after 3.297494106s: waiting for machine to come up
I0214 03:03:23.270286 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:23.270718 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:23.270770 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:23.270677 1504170 retry.go:31] will retry after 5.486051669s: waiting for machine to come up
I0214 03:03:28.761383 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.761866 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has current primary IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.761903 1503804 main.go:141] libmachine: (ha-447944-m02) Found IP for machine: 192.168.39.218
I0214 03:03:28.761917 1503804 main.go:141] libmachine: (ha-447944-m02) Reserving static IP address...
I0214 03:03:28.762319 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find host DHCP lease matching {name: "ha-447944-m02", mac: "52:54:00:61:ed:46", ip: "192.168.39.218"} in network mk-ha-447944
I0214 03:03:28.836971 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Getting to WaitForSSH function...
I0214 03:03:28.837007 1503804 main.go:141] libmachine: (ha-447944-m02) Reserved static IP address: 192.168.39.218
I0214 03:03:28.837029 1503804 main.go:141] libmachine: (ha-447944-m02) Waiting for SSH to be available...
I0214 03:03:28.839580 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.840015 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:minikube Clientid:01:52:54:00:61:ed:46}
I0214 03:03:28.840044 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.840209 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Using SSH client type: external
I0214 03:03:28.840241 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa (-rw-------)
I0214 03:03:28.840283 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.218 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 03:03:28.840298 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | About to run SSH command:
I0214 03:03:28.840315 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | exit 0
I0214 03:03:28.933452 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | SSH cmd err, output: <nil>:
I0214 03:03:28.933687 1503804 main.go:141] libmachine: (ha-447944-m02) KVM machine creation complete!
I0214 03:03:28.934029 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetConfigRaw
I0214 03:03:28.934623 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:28.934856 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:28.935048 1503804 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 03:03:28.935064 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:03:28.936430 1503804 main.go:141] libmachine: Detecting operating system of created instance...
I0214 03:03:28.936455 1503804 main.go:141] libmachine: Waiting for SSH to be available...
I0214 03:03:28.936461 1503804 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 03:03:28.936467 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:28.938815 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.939199 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:28.939230 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.939407 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:28.939569 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:28.939712 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:28.939838 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:28.940041 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:28.940646 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:28.940664 1503804 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 03:03:29.060273 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:03:29.060301 1503804 main.go:141] libmachine: Detecting the provisioner...
I0214 03:03:29.060310 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.063089 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.063473 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.063502 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.063657 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.063896 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.064074 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.064205 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.064322 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:29.064632 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:29.064643 1503804 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 03:03:29.185978 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:03:29.186091 1503804 main.go:141] libmachine: found compatible host: buildroot
I0214 03:03:29.186103 1503804 main.go:141] libmachine: Provisioning with buildroot...
I0214 03:03:29.186115 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetMachineName
I0214 03:03:29.186424 1503804 buildroot.go:166] provisioning hostname "ha-447944-m02"
I0214 03:03:29.186457 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetMachineName
I0214 03:03:29.186666 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.190840 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.191196 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.191221 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.191388 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.191547 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.191734 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.191917 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.192097 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:29.192410 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:29.192424 1503804 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-447944-m02 && echo "ha-447944-m02" | sudo tee /etc/hostname
I0214 03:03:29.333762 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944-m02
I0214 03:03:29.333819 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.336668 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.337056 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.337087 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.337221 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.337436 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.337614 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.337731 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.337919 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:29.338386 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:29.338424 1503804 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-447944-m02' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-447944-m02/g' /etc/hosts;
else
echo '127.0.1.1 ha-447944-m02' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:03:29.473586 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:03:29.473630 1503804 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:03:29.473668 1503804 buildroot.go:174] setting up certificates
I0214 03:03:29.473685 1503804 provision.go:84] configureAuth start
I0214 03:03:29.473703 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetMachineName
I0214 03:03:29.474017 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:03:29.476704 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.477114 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.477146 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.477337 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.479930 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.480287 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.480308 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.480465 1503804 provision.go:143] copyHostCerts
I0214 03:03:29.480498 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:03:29.480548 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:03:29.480557 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:03:29.480624 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:03:29.480710 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:03:29.480727 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:03:29.480733 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:03:29.480757 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:03:29.480822 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:03:29.480844 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:03:29.480847 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:03:29.480871 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:03:29.480919 1503804 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ha-447944-m02 san=[127.0.0.1 192.168.39.218 ha-447944-m02 localhost minikube]
I0214 03:03:29.595313 1503804 provision.go:177] copyRemoteCerts
I0214 03:03:29.595396 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:03:29.595433 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.598227 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.598607 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.598648 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.598959 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.599161 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.599337 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.599435 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:03:29.690233 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:03:29.690324 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:03:29.714265 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:03:29.714357 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0214 03:03:29.737089 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:03:29.737162 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 03:03:29.761350 1503804 provision.go:87] duration metric: took 287.643885ms to configureAuth
I0214 03:03:29.761399 1503804 buildroot.go:189] setting minikube options for container-runtime
I0214 03:03:29.761640 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:03:29.761794 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.764629 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.765078 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.765110 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.765340 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.765568 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.765770 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.765924 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.766119 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:29.766502 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:29.766523 1503804 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:03:30.090505 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:03:30.090551 1503804 main.go:141] libmachine: Checking connection to Docker...
I0214 03:03:30.090564 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetURL
I0214 03:03:30.092103 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Using libvirt version 6000000
I0214 03:03:30.094550 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.094943 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.094982 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.095126 1503804 main.go:141] libmachine: Docker is up and running!
I0214 03:03:30.095141 1503804 main.go:141] libmachine: Reticulating splines...
I0214 03:03:30.095149 1503804 client.go:171] duration metric: took 25.045445551s to LocalClient.Create
I0214 03:03:30.095184 1503804 start.go:167] duration metric: took 25.04552467s to libmachine.API.Create "ha-447944"
I0214 03:03:30.095198 1503804 start.go:293] postStartSetup for "ha-447944-m02" (driver="kvm2")
I0214 03:03:30.095215 1503804 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:03:30.095255 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.095514 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:03:30.095538 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:30.097900 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.098235 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.098264 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.098371 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:30.098566 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.098750 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:30.098900 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:03:30.190500 1503804 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:03:30.194831 1503804 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:03:30.194880 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:03:30.194972 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:03:30.195070 1503804 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:03:30.195083 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:03:30.195165 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:03:30.203237 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:03:30.226322 1503804 start.go:296] duration metric: took 131.103918ms for postStartSetup
I0214 03:03:30.226460 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetConfigRaw
I0214 03:03:30.227140 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:03:30.230278 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.230620 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.230648 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.230861 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:03:30.231100 1503804 start.go:128] duration metric: took 25.199582166s to createHost
I0214 03:03:30.231132 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:30.233520 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.233826 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.233857 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.233978 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:30.234171 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.234383 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.234555 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:30.234737 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:30.235068 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:30.235080 1503804 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:03:30.358150 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707879810.329974913
I0214 03:03:30.358177 1503804 fix.go:216] guest clock: 1707879810.329974913
I0214 03:03:30.358187 1503804 fix.go:229] Guest: 2024-02-14 03:03:30.329974913 +0000 UTC Remote: 2024-02-14 03:03:30.231115991 +0000 UTC m=+83.853319298 (delta=98.858922ms)
I0214 03:03:30.358207 1503804 fix.go:200] guest clock delta is within tolerance: 98.858922ms
I0214 03:03:30.358214 1503804 start.go:83] releasing machines lock for "ha-447944-m02", held for 25.326815322s
I0214 03:03:30.358253 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.358558 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:03:30.360977 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.361418 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.361453 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.363774 1503804 out.go:177] * Found network options:
I0214 03:03:30.365180 1503804 out.go:177] - NO_PROXY=192.168.39.41
W0214 03:03:30.366470 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
I0214 03:03:30.366500 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.367012 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.367187 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.367275 1503804 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:03:30.367322 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
W0214 03:03:30.367360 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
I0214 03:03:30.367449 1503804 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:03:30.367473 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:30.369918 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.370184 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.370309 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.370339 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.370499 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:30.370608 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.370636 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.370687 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.370774 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:30.370893 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.370893 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:30.371034 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:30.371118 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:03:30.371148 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:03:30.616761 1503804 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:03:30.622681 1503804 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:03:30.622764 1503804 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:03:30.638707 1503804 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 03:03:30.638735 1503804 start.go:494] detecting cgroup driver to use...
I0214 03:03:30.638811 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:03:30.658568 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:03:30.670605 1503804 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:03:30.670669 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:03:30.683968 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:03:30.696705 1503804 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:03:30.820632 1503804 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:03:30.938186 1503804 docker.go:233] disabling docker service ...
I0214 03:03:30.938277 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:03:30.952137 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:03:30.964393 1503804 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:03:31.082930 1503804 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:03:31.195491 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:03:31.208825 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:03:31.225923 1503804 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:03:31.225982 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:03:31.234946 1503804 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:03:31.235018 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:03:31.244101 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:03:31.253152 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:03:31.262045 1503804 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:03:31.273222 1503804 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:03:31.281572 1503804 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 03:03:31.281633 1503804 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 03:03:31.294588 1503804 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:03:31.302711 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:03:31.409573 1503804 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:03:31.579557 1503804 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:03:31.579627 1503804 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:03:31.584662 1503804 start.go:562] Will wait 60s for crictl version
I0214 03:03:31.584729 1503804 ssh_runner.go:195] Run: which crictl
I0214 03:03:31.588678 1503804 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:03:31.625336 1503804 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:03:31.625461 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:03:31.675299 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:03:31.724845 1503804 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:03:31.726313 1503804 out.go:177] - env NO_PROXY=192.168.39.41
I0214 03:03:31.727563 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:03:31.730296 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:31.730666 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:31.730695 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:31.730864 1503804 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:03:31.734983 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:03:31.747816 1503804 mustload.go:65] Loading cluster: ha-447944
I0214 03:03:31.748077 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:03:31.748364 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:31.748389 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:31.762867 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38927
I0214 03:03:31.763319 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:31.763794 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:31.763830 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:31.764153 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:31.764394 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:03:31.765977 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:03:31.766274 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:31.766301 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:31.780773 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45535
I0214 03:03:31.781236 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:31.781698 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:31.781724 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:31.782076 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:31.782276 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:03:31.782465 1503804 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944 for IP: 192.168.39.218
I0214 03:03:31.782480 1503804 certs.go:194] generating shared ca certs ...
I0214 03:03:31.782502 1503804 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:31.782643 1503804 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:03:31.782684 1503804 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:03:31.782694 1503804 certs.go:256] generating profile certs ...
I0214 03:03:31.782764 1503804 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key
I0214 03:03:31.782789 1503804 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.b3c69853
I0214 03:03:31.782803 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.b3c69853 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41 192.168.39.218 192.168.39.254]
I0214 03:03:31.969249 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.b3c69853 ...
I0214 03:03:31.969289 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.b3c69853: {Name:mk77b55ff6268bf8a98f0bc8d28204b4921fada3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:31.969456 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.b3c69853 ...
I0214 03:03:31.969469 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.b3c69853: {Name:mke73c8660d06807ef7f111701b87ad0d3af8c6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:31.969553 1503804 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.b3c69853 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt
I0214 03:03:31.969673 1503804 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.b3c69853 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key
I0214 03:03:31.969800 1503804 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key
I0214 03:03:31.969818 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:03:31.969830 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:03:31.969844 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:03:31.969857 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:03:31.969867 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:03:31.969879 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:03:31.969891 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:03:31.969902 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:03:31.969952 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:03:31.969986 1503804 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:03:31.969996 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:03:31.970027 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:03:31.970048 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:03:31.970069 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:03:31.970104 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:03:31.970130 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:03:31.970144 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:03:31.970161 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:03:31.970197 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:03:31.973605 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:31.974133 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:03:31.974158 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:31.974342 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:03:31.974553 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:03:31.974725 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:03:31.974870 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:03:32.061614 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub
I0214 03:03:32.068170 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
I0214 03:03:32.079272 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key
I0214 03:03:32.083631 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)
I0214 03:03:32.094654 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt
I0214 03:03:32.099002 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
I0214 03:03:32.110043 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key
I0214 03:03:32.114222 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)
I0214 03:03:32.124973 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt
I0214 03:03:32.128927 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
I0214 03:03:32.138123 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key
I0214 03:03:32.142696 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
I0214 03:03:32.152769 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:03:32.176737 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:03:32.199900 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:03:32.223148 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:03:32.245388 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
I0214 03:03:32.268405 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 03:03:32.290627 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:03:32.312575 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:03:32.335399 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:03:32.358071 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:03:32.380938 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:03:32.402946 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
I0214 03:03:32.418921 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)
I0214 03:03:32.434547 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
I0214 03:03:32.449355 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)
I0214 03:03:32.464432 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
I0214 03:03:32.479858 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
I0214 03:03:32.495050 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
I0214 03:03:32.510762 1503804 ssh_runner.go:195] Run: openssl version
I0214 03:03:32.516081 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:03:32.525012 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:03:32.529330 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:03:32.529383 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:03:32.534680 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:03:32.543641 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:03:32.553860 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:03:32.558324 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:03:32.558378 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:03:32.563677 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:03:32.572839 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:03:32.582011 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:03:32.586326 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:03:32.586378 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:03:32.591668 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:03:32.600687 1503804 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:03:32.604688 1503804 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 03:03:32.604747 1503804 kubeadm.go:928] updating node {m02 192.168.39.218 8443 v1.28.4 crio true true} ...
I0214 03:03:32.604860 1503804 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-447944-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.218
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:03:32.604887 1503804 kube-vip.go:101] generating kube-vip config ...
I0214 03:03:32.604917 1503804 kube-vip.go:121] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_ddns
value: "false"
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v0.7.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0214 03:03:32.604949 1503804 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:03:32.612704 1503804 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.28.4: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.28.4': No such file or directory
Initiating transfer...
I0214 03:03:32.612750 1503804 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.28.4
I0214 03:03:32.620724 1503804 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubectl.sha256
I0214 03:03:32.620749 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubectl -> /var/lib/minikube/binaries/v1.28.4/kubectl
I0214 03:03:32.620803 1503804 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet
I0214 03:03:32.620826 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubectl
I0214 03:03:32.620852 1503804 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm
I0214 03:03:32.628360 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubectl: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubectl': No such file or directory
I0214 03:03:32.628399 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubectl --> /var/lib/minikube/binaries/v1.28.4/kubectl (49885184 bytes)
I0214 03:03:33.360323 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm -> /var/lib/minikube/binaries/v1.28.4/kubeadm
I0214 03:03:33.360413 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubeadm
I0214 03:03:33.366277 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubeadm: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubeadm': No such file or directory
I0214 03:03:33.366317 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm --> /var/lib/minikube/binaries/v1.28.4/kubeadm (49102848 bytes)
I0214 03:03:33.880992 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:03:33.894244 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet -> /var/lib/minikube/binaries/v1.28.4/kubelet
I0214 03:03:33.894359 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubelet
I0214 03:03:33.898841 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubelet: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubelet': No such file or directory
I0214 03:03:33.898884 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet --> /var/lib/minikube/binaries/v1.28.4/kubelet (110850048 bytes)
I0214 03:03:34.426596 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
I0214 03:03:34.435201 1503804 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)
I0214 03:03:34.451103 1503804 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:03:34.466509 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1265 bytes)
I0214 03:03:34.483014 1503804 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0214 03:03:34.486856 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:03:34.499243 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:03:34.607695 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:03:34.623817 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:03:34.624253 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:34.624289 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:34.639230 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33639
I0214 03:03:34.639780 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:34.640305 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:34.640335 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:34.640777 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:34.641034 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:03:34.641210 1503804 start.go:316] joinCluster: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cluster
Name:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration
:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:03:34.641355 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm token create --print-join-command --ttl=0"
I0214 03:03:34.641384 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:03:34.644101 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:34.644528 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:03:34.644578 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:34.644735 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:03:34.644934 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:03:34.645109 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:03:34.645309 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:03:34.820814 1503804 start.go:342] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:03:34.820866 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm join control-plane.minikube.internal:8443 --token z4245n.isjg1bnvaxsd3tea --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-447944-m02 --control-plane --apiserver-advertise-address=192.168.39.218 --apiserver-bind-port=8443"
I0214 03:04:17.162207 1503804 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm join control-plane.minikube.internal:8443 --token z4245n.isjg1bnvaxsd3tea --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-447944-m02 --control-plane --apiserver-advertise-address=192.168.39.218 --apiserver-bind-port=8443": (42.341303783s)
I0214 03:04:17.162264 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
I0214 03:04:17.636529 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-447944-m02 minikube.k8s.io/updated_at=2024_02_14T03_04_17_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=ha-447944 minikube.k8s.io/primary=false
I0214 03:04:17.784809 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-447944-m02 node-role.kubernetes.io/control-plane:NoSchedule-
I0214 03:04:17.914278 1503804 start.go:318] duration metric: took 43.273055212s to joinCluster
I0214 03:04:17.914385 1503804 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:04:17.917214 1503804 out.go:177] * Verifying Kubernetes components...
I0214 03:04:17.914705 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:04:17.918949 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:04:18.203103 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:04:18.240635 1503804 loader.go:395] Config loaded from file: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:04:18.240981 1503804 kapi.go:59] client config for ha-447944: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]strin
g(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
W0214 03:04:18.241119 1503804 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.41:8443
I0214 03:04:18.241456 1503804 node_ready.go:35] waiting up to 6m0s for node "ha-447944-m02" to be "Ready" ...
I0214 03:04:18.241579 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:18.241592 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:18.241603 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:18.241613 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:18.255676 1503804 round_trippers.go:574] Response Status: 200 OK in 14 milliseconds
I0214 03:04:18.742593 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:18.742618 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:18.742626 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:18.742633 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:18.747050 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:19.241745 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:19.241773 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:19.241784 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:19.241793 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:19.250946 1503804 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds
I0214 03:04:19.742470 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:19.742497 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:19.742509 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:19.742517 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:19.755299 1503804 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds
I0214 03:04:20.242587 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:20.242616 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:20.242634 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:20.242641 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:20.247274 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:20.247978 1503804 node_ready.go:53] node "ha-447944-m02" has status "Ready":"False"
I0214 03:04:20.742315 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:20.742349 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:20.742361 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:20.742370 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:20.746157 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:21.242328 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:21.242360 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:21.242370 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:21.242385 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:21.246567 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:21.742083 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:21.742114 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:21.742127 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:21.742137 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:21.745678 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:22.242537 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:22.242562 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:22.242571 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:22.242577 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:22.247488 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:22.248365 1503804 node_ready.go:53] node "ha-447944-m02" has status "Ready":"False"
I0214 03:04:22.742699 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:22.742727 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:22.742740 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:22.742750 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:22.746544 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:23.241714 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:23.241744 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:23.241752 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:23.241758 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:23.246139 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:23.742384 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:23.742415 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:23.742428 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:23.742438 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:23.747144 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:24.242399 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:24.242430 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:24.242449 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:24.242460 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:24.247597 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:24.741749 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:24.741774 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:24.741783 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:24.741789 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:24.746754 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:24.747819 1503804 node_ready.go:53] node "ha-447944-m02" has status "Ready":"False"
I0214 03:04:25.241727 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:25.241750 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.241759 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.241766 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.247263 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:25.742518 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:25.742546 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.742555 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.742561 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.746678 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:25.747748 1503804 node_ready.go:49] node "ha-447944-m02" has status "Ready":"True"
I0214 03:04:25.747774 1503804 node_ready.go:38] duration metric: took 7.506292318s for node "ha-447944-m02" to be "Ready" ...
I0214 03:04:25.747787 1503804 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:04:25.747877 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:25.747890 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.747901 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.747910 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.753120 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:25.759699 1503804 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.759800 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-chs9l
I0214 03:04:25.759811 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.759822 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.759833 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.763363 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:25.764234 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:25.764252 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.764262 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.764269 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.774597 1503804 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds
I0214 03:04:25.775020 1503804 pod_ready.go:92] pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:25.775038 1503804 pod_ready.go:81] duration metric: took 15.316375ms for pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.775047 1503804 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.775124 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rpnsx
I0214 03:04:25.775134 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.775141 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.775147 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.782747 1503804 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds
I0214 03:04:25.783324 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:25.783338 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.783349 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.783377 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.788992 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:25.789567 1503804 pod_ready.go:92] pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:25.789596 1503804 pod_ready.go:81] duration metric: took 14.535895ms for pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.789608 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.789684 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944
I0214 03:04:25.789693 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.789700 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.789706 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.795886 1503804 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds
I0214 03:04:25.797439 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:25.797459 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.797470 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.797480 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.802132 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:25.803357 1503804 pod_ready.go:92] pod "etcd-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:25.803386 1503804 pod_ready.go:81] duration metric: took 13.763768ms for pod "etcd-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.803405 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.803479 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m02
I0214 03:04:25.803485 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.803496 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.803529 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.809192 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:25.809893 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:25.809913 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.809924 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.809934 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.816391 1503804 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds
I0214 03:04:25.816788 1503804 pod_ready.go:92] pod "etcd-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:25.816812 1503804 pod_ready.go:81] duration metric: took 13.396468ms for pod "etcd-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.816830 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.943268 1503804 request.go:629] Waited for 126.350377ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944
I0214 03:04:25.943350 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944
I0214 03:04:25.943356 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.943365 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.943371 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.947098 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:26.143243 1503804 request.go:629] Waited for 195.380547ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:26.143319 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:26.143326 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.143341 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.143360 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.147160 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:26.147713 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:26.147734 1503804 pod_ready.go:81] duration metric: took 330.893639ms for pod "kube-apiserver-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:26.147747 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:26.342985 1503804 request.go:629] Waited for 195.150246ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:26.343083 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:26.343093 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.343100 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.343107 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.347763 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:26.543246 1503804 request.go:629] Waited for 194.359317ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:26.543343 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:26.543356 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.543367 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.543377 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.549359 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:26.743201 1503804 request.go:629] Waited for 94.249579ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:26.743287 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:26.743297 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.743308 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.743322 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.750936 1503804 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds
I0214 03:04:26.943169 1503804 request.go:629] Waited for 190.664092ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:26.943247 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:26.943254 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.943266 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.943280 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.947742 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:27.148461 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:27.148491 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:27.148504 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:27.148514 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:27.152898 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:27.343015 1503804 request.go:629] Waited for 189.35968ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:27.343081 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:27.343085 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:27.343093 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:27.343100 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:27.348866 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:27.648575 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:27.648601 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:27.648610 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:27.648616 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:27.651978 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:27.742988 1503804 request.go:629] Waited for 90.257253ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:27.743055 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:27.743060 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:27.743067 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:27.743078 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:27.749784 1503804 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds
I0214 03:04:28.148299 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:28.148344 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.148352 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.148364 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.152002 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:28.152574 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:28.152590 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.152597 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.152603 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.155803 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:28.156313 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:28.156331 1503804 pod_ready.go:81] duration metric: took 2.008576982s for pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.156339 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.342722 1503804 request.go:629] Waited for 186.306919ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944
I0214 03:04:28.342807 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944
I0214 03:04:28.342812 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.342820 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.342827 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.347287 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:28.542677 1503804 request.go:629] Waited for 194.300509ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:28.542746 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:28.542750 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.542759 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.542769 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.547329 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:28.548103 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:28.548121 1503804 pod_ready.go:81] duration metric: took 391.775783ms for pod "kube-controller-manager-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.548131 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.743187 1503804 request.go:629] Waited for 194.970706ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m02
I0214 03:04:28.743274 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m02
I0214 03:04:28.743279 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.743288 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.743294 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.747878 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:28.942951 1503804 request.go:629] Waited for 194.39297ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:28.943024 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:28.943029 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.943037 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.943043 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.946853 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:28.947284 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:28.947303 1503804 pod_ready.go:81] duration metric: took 399.166234ms for pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.947318 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9cjk2" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.143434 1503804 request.go:629] Waited for 196.006984ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9cjk2
I0214 03:04:29.143539 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9cjk2
I0214 03:04:29.143548 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.143559 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.143573 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.147344 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:29.343380 1503804 request.go:629] Waited for 195.361602ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:29.343472 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:29.343483 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.343503 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.343516 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.347583 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:29.348299 1503804 pod_ready.go:92] pod "kube-proxy-9cjk2" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:29.348319 1503804 pod_ready.go:81] duration metric: took 400.993478ms for pod "kube-proxy-9cjk2" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.348328 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dpm4f" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.543497 1503804 request.go:629] Waited for 195.093843ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-dpm4f
I0214 03:04:29.543584 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-dpm4f
I0214 03:04:29.543589 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.543601 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.543612 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.547856 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:29.742871 1503804 request.go:629] Waited for 194.27753ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:29.742947 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:29.742955 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.742964 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.742972 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.748569 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:29.749372 1503804 pod_ready.go:92] pod "kube-proxy-dpm4f" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:29.749391 1503804 pod_ready.go:81] duration metric: took 401.057276ms for pod "kube-proxy-dpm4f" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.749400 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.943457 1503804 request.go:629] Waited for 193.957943ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944
I0214 03:04:29.943532 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944
I0214 03:04:29.943540 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.943548 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.943556 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.947716 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:30.142789 1503804 request.go:629] Waited for 194.472356ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:30.142870 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:30.142877 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.142888 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.142905 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.147368 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:30.148421 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:30.148444 1503804 pod_ready.go:81] duration metric: took 399.035036ms for pod "kube-scheduler-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:30.148457 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:30.342567 1503804 request.go:629] Waited for 193.995385ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m02
I0214 03:04:30.342643 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m02
I0214 03:04:30.342652 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.342663 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.342690 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.348475 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:30.542571 1503804 request.go:629] Waited for 192.294127ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:30.542642 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:30.542649 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.542660 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.542674 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.547660 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:30.548393 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:30.548412 1503804 pod_ready.go:81] duration metric: took 399.94779ms for pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:30.548423 1503804 pod_ready.go:38] duration metric: took 4.800619194s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:04:30.548437 1503804 api_server.go:52] waiting for apiserver process to appear ...
I0214 03:04:30.548489 1503804 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:04:30.563925 1503804 api_server.go:72] duration metric: took 12.649472625s to wait for apiserver process to appear ...
I0214 03:04:30.563959 1503804 api_server.go:88] waiting for apiserver healthz status ...
I0214 03:04:30.563981 1503804 api_server.go:253] Checking apiserver healthz at https://192.168.39.41:8443/healthz ...
I0214 03:04:30.570502 1503804 api_server.go:279] https://192.168.39.41:8443/healthz returned 200:
ok
I0214 03:04:30.570577 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/version
I0214 03:04:30.570585 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.570592 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.570601 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.571780 1503804 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0214 03:04:30.571932 1503804 api_server.go:141] control plane version: v1.28.4
I0214 03:04:30.571957 1503804 api_server.go:131] duration metric: took 7.990678ms to wait for apiserver health ...
I0214 03:04:30.571967 1503804 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 03:04:30.743384 1503804 request.go:629] Waited for 171.333128ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:30.743463 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:30.743468 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.743476 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.743482 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.754475 1503804 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds
I0214 03:04:30.759922 1503804 system_pods.go:59] 17 kube-system pods found
I0214 03:04:30.759957 1503804 system_pods.go:61] "coredns-5dd5756b68-chs9l" [224031c4-3d57-4119-921f-0e3fcdceec9c] Running
I0214 03:04:30.759965 1503804 system_pods.go:61] "coredns-5dd5756b68-rpnsx" [cef2a300-e8ff-4099-a5c4-4906889e902c] Running
I0214 03:04:30.759971 1503804 system_pods.go:61] "etcd-ha-447944" [b9879f26-9700-4bee-8e37-f132f15a4582] Running
I0214 03:04:30.759976 1503804 system_pods.go:61] "etcd-ha-447944-m02" [7a7cc3b5-6f9d-42ef-926b-2644763f6072] Running
I0214 03:04:30.759985 1503804 system_pods.go:61] "kindnet-pjrmh" [5cc39f50-0de5-40b5-b670-b33acc977740] Running
I0214 03:04:30.759990 1503804 system_pods.go:61] "kindnet-xkmkd" [534c4261-88a5-4120-89c4-c94bdfb2be76] Running
I0214 03:04:30.759996 1503804 system_pods.go:61] "kube-apiserver-ha-447944" [d48bd5fd-0acd-438c-8b9b-625fcc96d2c0] Running
I0214 03:04:30.760002 1503804 system_pods.go:61] "kube-apiserver-ha-447944-m02" [b36af3a6-21cc-47ae-910d-443dea7db747] Running
I0214 03:04:30.760009 1503804 system_pods.go:61] "kube-controller-manager-ha-447944" [136c8014-5e6e-4af5-aa70-c041e62fb725] Running
I0214 03:04:30.760018 1503804 system_pods.go:61] "kube-controller-manager-ha-447944-m02" [f3bc1826-4323-4c0c-8255-855ffab6cf3d] Running
I0214 03:04:30.760023 1503804 system_pods.go:61] "kube-proxy-9cjk2" [87b6de90-7a92-4c40-bfe1-41353a81d40b] Running
I0214 03:04:30.760029 1503804 system_pods.go:61] "kube-proxy-dpm4f" [2e0eb813-44c4-4623-8789-d37194b83ecd] Running
I0214 03:04:30.760034 1503804 system_pods.go:61] "kube-scheduler-ha-447944" [39ba6921-10a6-4a43-8ecd-8afc7092ba98] Running
I0214 03:04:30.760039 1503804 system_pods.go:61] "kube-scheduler-ha-447944-m02" [f8de4bcd-f5ba-4172-a461-7c2cc73ea6f2] Running
I0214 03:04:30.760044 1503804 system_pods.go:61] "kube-vip-ha-447944" [8e505ede-4ac8-4482-97ba-08943265ce41] Running
I0214 03:04:30.760050 1503804 system_pods.go:61] "kube-vip-ha-447944-m02" [80c89449-01b1-414b-bf1a-c727d4b03e8d] Running
I0214 03:04:30.760057 1503804 system_pods.go:61] "storage-provisioner" [7da2937f-2d9b-40d4-a521-5bf4a2585de7] Running
I0214 03:04:30.760066 1503804 system_pods.go:74] duration metric: took 188.086947ms to wait for pod list to return data ...
I0214 03:04:30.760076 1503804 default_sa.go:34] waiting for default service account to be created ...
I0214 03:04:30.943563 1503804 request.go:629] Waited for 183.379135ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:04:30.943635 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:04:30.943639 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.943647 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.943653 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.948619 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:30.948926 1503804 default_sa.go:45] found service account: "default"
I0214 03:04:30.948949 1503804 default_sa.go:55] duration metric: took 188.864284ms for default service account to be created ...
I0214 03:04:30.948960 1503804 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 03:04:31.143433 1503804 request.go:629] Waited for 194.367116ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:31.143516 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:31.143526 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:31.143537 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:31.143548 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:31.148947 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:31.154025 1503804 system_pods.go:86] 17 kube-system pods found
I0214 03:04:31.154050 1503804 system_pods.go:89] "coredns-5dd5756b68-chs9l" [224031c4-3d57-4119-921f-0e3fcdceec9c] Running
I0214 03:04:31.154055 1503804 system_pods.go:89] "coredns-5dd5756b68-rpnsx" [cef2a300-e8ff-4099-a5c4-4906889e902c] Running
I0214 03:04:31.154061 1503804 system_pods.go:89] "etcd-ha-447944" [b9879f26-9700-4bee-8e37-f132f15a4582] Running
I0214 03:04:31.154065 1503804 system_pods.go:89] "etcd-ha-447944-m02" [7a7cc3b5-6f9d-42ef-926b-2644763f6072] Running
I0214 03:04:31.154070 1503804 system_pods.go:89] "kindnet-pjrmh" [5cc39f50-0de5-40b5-b670-b33acc977740] Running
I0214 03:04:31.154077 1503804 system_pods.go:89] "kindnet-xkmkd" [534c4261-88a5-4120-89c4-c94bdfb2be76] Running
I0214 03:04:31.154084 1503804 system_pods.go:89] "kube-apiserver-ha-447944" [d48bd5fd-0acd-438c-8b9b-625fcc96d2c0] Running
I0214 03:04:31.154088 1503804 system_pods.go:89] "kube-apiserver-ha-447944-m02" [b36af3a6-21cc-47ae-910d-443dea7db747] Running
I0214 03:04:31.154093 1503804 system_pods.go:89] "kube-controller-manager-ha-447944" [136c8014-5e6e-4af5-aa70-c041e62fb725] Running
I0214 03:04:31.154097 1503804 system_pods.go:89] "kube-controller-manager-ha-447944-m02" [f3bc1826-4323-4c0c-8255-855ffab6cf3d] Running
I0214 03:04:31.154102 1503804 system_pods.go:89] "kube-proxy-9cjk2" [87b6de90-7a92-4c40-bfe1-41353a81d40b] Running
I0214 03:04:31.154108 1503804 system_pods.go:89] "kube-proxy-dpm4f" [2e0eb813-44c4-4623-8789-d37194b83ecd] Running
I0214 03:04:31.154113 1503804 system_pods.go:89] "kube-scheduler-ha-447944" [39ba6921-10a6-4a43-8ecd-8afc7092ba98] Running
I0214 03:04:31.154120 1503804 system_pods.go:89] "kube-scheduler-ha-447944-m02" [f8de4bcd-f5ba-4172-a461-7c2cc73ea6f2] Running
I0214 03:04:31.154124 1503804 system_pods.go:89] "kube-vip-ha-447944" [8e505ede-4ac8-4482-97ba-08943265ce41] Running
I0214 03:04:31.154128 1503804 system_pods.go:89] "kube-vip-ha-447944-m02" [80c89449-01b1-414b-bf1a-c727d4b03e8d] Running
I0214 03:04:31.154132 1503804 system_pods.go:89] "storage-provisioner" [7da2937f-2d9b-40d4-a521-5bf4a2585de7] Running
I0214 03:04:31.154139 1503804 system_pods.go:126] duration metric: took 205.17312ms to wait for k8s-apps to be running ...
I0214 03:04:31.154147 1503804 system_svc.go:44] waiting for kubelet service to be running ....
I0214 03:04:31.154193 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:04:31.170383 1503804 system_svc.go:56] duration metric: took 16.229012ms WaitForService to wait for kubelet
I0214 03:04:31.170422 1503804 kubeadm.go:576] duration metric: took 13.255974288s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:04:31.170445 1503804 node_conditions.go:102] verifying NodePressure condition ...
I0214 03:04:31.342918 1503804 request.go:629] Waited for 172.369583ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes
I0214 03:04:31.343004 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes
I0214 03:04:31.343014 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:31.343023 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:31.343031 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:31.346976 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:31.347797 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:04:31.347826 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:04:31.347842 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:04:31.347849 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:04:31.347855 1503804 node_conditions.go:105] duration metric: took 177.400006ms to run NodePressure ...
I0214 03:04:31.347870 1503804 start.go:240] waiting for startup goroutines ...
I0214 03:04:31.347906 1503804 start.go:254] writing updated cluster config ...
I0214 03:04:31.350431 1503804 out.go:177]
I0214 03:04:31.351944 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:04:31.352049 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:04:31.353902 1503804 out.go:177] * Starting "ha-447944-m03" control-plane node in "ha-447944" cluster
I0214 03:04:31.355167 1503804 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:04:31.355193 1503804 cache.go:56] Caching tarball of preloaded images
I0214 03:04:31.355291 1503804 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:04:31.355304 1503804 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:04:31.355414 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:04:31.355594 1503804 start.go:360] acquireMachinesLock for ha-447944-m03: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:04:31.355655 1503804 start.go:364] duration metric: took 39.081µs to acquireMachinesLock for "ha-447944-m03"
I0214 03:04:31.355680 1503804 start.go:93] Provisioning new machine with config: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-d
ns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimi
zations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:04:31.355778 1503804 start.go:125] createHost starting for "m03" (driver="kvm2")
I0214 03:04:31.357477 1503804 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0214 03:04:31.357579 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:04:31.357614 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:04:31.372497 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38061
I0214 03:04:31.372951 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:04:31.373473 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:04:31.373502 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:04:31.373894 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:04:31.374073 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetMachineName
I0214 03:04:31.374234 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:31.374403 1503804 start.go:159] libmachine.API.Create for "ha-447944" (driver="kvm2")
I0214 03:04:31.374433 1503804 client.go:168] LocalClient.Create starting
I0214 03:04:31.374462 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 03:04:31.374493 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:04:31.374509 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:04:31.374564 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 03:04:31.374582 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:04:31.374594 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:04:31.374609 1503804 main.go:141] libmachine: Running pre-create checks...
I0214 03:04:31.374618 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .PreCreateCheck
I0214 03:04:31.374851 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetConfigRaw
I0214 03:04:31.375259 1503804 main.go:141] libmachine: Creating machine...
I0214 03:04:31.375275 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .Create
I0214 03:04:31.375466 1503804 main.go:141] libmachine: (ha-447944-m03) Creating KVM machine...
I0214 03:04:31.376773 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found existing default KVM network
I0214 03:04:31.376871 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found existing private KVM network mk-ha-447944
I0214 03:04:31.377053 1503804 main.go:141] libmachine: (ha-447944-m03) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03 ...
I0214 03:04:31.377079 1503804 main.go:141] libmachine: (ha-447944-m03) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 03:04:31.377181 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:31.377047 1504508 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:04:31.377289 1503804 main.go:141] libmachine: (ha-447944-m03) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 03:04:31.613659 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:31.613496 1504508 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa...
I0214 03:04:31.754507 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:31.754378 1504508 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/ha-447944-m03.rawdisk...
I0214 03:04:31.754538 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Writing magic tar header
I0214 03:04:31.754552 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Writing SSH key tar header
I0214 03:04:31.754687 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:31.754584 1504508 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03 ...
I0214 03:04:31.754764 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03
I0214 03:04:31.754787 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 03:04:31.754802 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03 (perms=drwx------)
I0214 03:04:31.754816 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 03:04:31.754831 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 03:04:31.754872 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 03:04:31.754912 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 03:04:31.754924 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:04:31.754978 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 03:04:31.755006 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 03:04:31.755022 1503804 main.go:141] libmachine: (ha-447944-m03) Creating domain...
I0214 03:04:31.755041 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 03:04:31.755055 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins
I0214 03:04:31.755071 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home
I0214 03:04:31.755086 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Skipping /home - not owner
I0214 03:04:31.755929 1503804 main.go:141] libmachine: (ha-447944-m03) define libvirt domain using xml:
I0214 03:04:31.755952 1503804 main.go:141] libmachine: (ha-447944-m03) <domain type='kvm'>
I0214 03:04:31.755962 1503804 main.go:141] libmachine: (ha-447944-m03) <name>ha-447944-m03</name>
I0214 03:04:31.755968 1503804 main.go:141] libmachine: (ha-447944-m03) <memory unit='MiB'>2200</memory>
I0214 03:04:31.755974 1503804 main.go:141] libmachine: (ha-447944-m03) <vcpu>2</vcpu>
I0214 03:04:31.755981 1503804 main.go:141] libmachine: (ha-447944-m03) <features>
I0214 03:04:31.755993 1503804 main.go:141] libmachine: (ha-447944-m03) <acpi/>
I0214 03:04:31.756009 1503804 main.go:141] libmachine: (ha-447944-m03) <apic/>
I0214 03:04:31.756021 1503804 main.go:141] libmachine: (ha-447944-m03) <pae/>
I0214 03:04:31.756029 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.756035 1503804 main.go:141] libmachine: (ha-447944-m03) </features>
I0214 03:04:31.756043 1503804 main.go:141] libmachine: (ha-447944-m03) <cpu mode='host-passthrough'>
I0214 03:04:31.756086 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.756112 1503804 main.go:141] libmachine: (ha-447944-m03) </cpu>
I0214 03:04:31.756123 1503804 main.go:141] libmachine: (ha-447944-m03) <os>
I0214 03:04:31.756141 1503804 main.go:141] libmachine: (ha-447944-m03) <type>hvm</type>
I0214 03:04:31.756154 1503804 main.go:141] libmachine: (ha-447944-m03) <boot dev='cdrom'/>
I0214 03:04:31.756166 1503804 main.go:141] libmachine: (ha-447944-m03) <boot dev='hd'/>
I0214 03:04:31.756179 1503804 main.go:141] libmachine: (ha-447944-m03) <bootmenu enable='no'/>
I0214 03:04:31.756187 1503804 main.go:141] libmachine: (ha-447944-m03) </os>
I0214 03:04:31.756194 1503804 main.go:141] libmachine: (ha-447944-m03) <devices>
I0214 03:04:31.756205 1503804 main.go:141] libmachine: (ha-447944-m03) <disk type='file' device='cdrom'>
I0214 03:04:31.756232 1503804 main.go:141] libmachine: (ha-447944-m03) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/boot2docker.iso'/>
I0214 03:04:31.756249 1503804 main.go:141] libmachine: (ha-447944-m03) <target dev='hdc' bus='scsi'/>
I0214 03:04:31.756262 1503804 main.go:141] libmachine: (ha-447944-m03) <readonly/>
I0214 03:04:31.756273 1503804 main.go:141] libmachine: (ha-447944-m03) </disk>
I0214 03:04:31.756287 1503804 main.go:141] libmachine: (ha-447944-m03) <disk type='file' device='disk'>
I0214 03:04:31.756301 1503804 main.go:141] libmachine: (ha-447944-m03) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 03:04:31.756318 1503804 main.go:141] libmachine: (ha-447944-m03) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/ha-447944-m03.rawdisk'/>
I0214 03:04:31.756334 1503804 main.go:141] libmachine: (ha-447944-m03) <target dev='hda' bus='virtio'/>
I0214 03:04:31.756346 1503804 main.go:141] libmachine: (ha-447944-m03) </disk>
I0214 03:04:31.756378 1503804 main.go:141] libmachine: (ha-447944-m03) <interface type='network'>
I0214 03:04:31.756392 1503804 main.go:141] libmachine: (ha-447944-m03) <source network='mk-ha-447944'/>
I0214 03:04:31.756401 1503804 main.go:141] libmachine: (ha-447944-m03) <model type='virtio'/>
I0214 03:04:31.756421 1503804 main.go:141] libmachine: (ha-447944-m03) </interface>
I0214 03:04:31.756442 1503804 main.go:141] libmachine: (ha-447944-m03) <interface type='network'>
I0214 03:04:31.756458 1503804 main.go:141] libmachine: (ha-447944-m03) <source network='default'/>
I0214 03:04:31.756471 1503804 main.go:141] libmachine: (ha-447944-m03) <model type='virtio'/>
I0214 03:04:31.756484 1503804 main.go:141] libmachine: (ha-447944-m03) </interface>
I0214 03:04:31.756496 1503804 main.go:141] libmachine: (ha-447944-m03) <serial type='pty'>
I0214 03:04:31.756507 1503804 main.go:141] libmachine: (ha-447944-m03) <target port='0'/>
I0214 03:04:31.756519 1503804 main.go:141] libmachine: (ha-447944-m03) </serial>
I0214 03:04:31.756542 1503804 main.go:141] libmachine: (ha-447944-m03) <console type='pty'>
I0214 03:04:31.756555 1503804 main.go:141] libmachine: (ha-447944-m03) <target type='serial' port='0'/>
I0214 03:04:31.756568 1503804 main.go:141] libmachine: (ha-447944-m03) </console>
I0214 03:04:31.756580 1503804 main.go:141] libmachine: (ha-447944-m03) <rng model='virtio'>
I0214 03:04:31.756595 1503804 main.go:141] libmachine: (ha-447944-m03) <backend model='random'>/dev/random</backend>
I0214 03:04:31.756608 1503804 main.go:141] libmachine: (ha-447944-m03) </rng>
I0214 03:04:31.756621 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.756629 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.756642 1503804 main.go:141] libmachine: (ha-447944-m03) </devices>
I0214 03:04:31.756654 1503804 main.go:141] libmachine: (ha-447944-m03) </domain>
I0214 03:04:31.756667 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.763871 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:62:3e:57 in network default
I0214 03:04:31.764439 1503804 main.go:141] libmachine: (ha-447944-m03) Ensuring networks are active...
I0214 03:04:31.764460 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:31.765314 1503804 main.go:141] libmachine: (ha-447944-m03) Ensuring network default is active
I0214 03:04:31.765607 1503804 main.go:141] libmachine: (ha-447944-m03) Ensuring network mk-ha-447944 is active
I0214 03:04:31.765954 1503804 main.go:141] libmachine: (ha-447944-m03) Getting domain xml...
I0214 03:04:31.766632 1503804 main.go:141] libmachine: (ha-447944-m03) Creating domain...
I0214 03:04:32.985140 1503804 main.go:141] libmachine: (ha-447944-m03) Waiting to get IP...
I0214 03:04:32.985872 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:32.986307 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:32.986400 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:32.986307 1504508 retry.go:31] will retry after 231.206952ms: waiting for machine to come up
I0214 03:04:33.219742 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:33.220329 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:33.220365 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:33.220258 1504508 retry.go:31] will retry after 328.180423ms: waiting for machine to come up
I0214 03:04:33.549698 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:33.550227 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:33.550264 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:33.550163 1504508 retry.go:31] will retry after 371.452955ms: waiting for machine to come up
I0214 03:04:33.923313 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:33.923793 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:33.923831 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:33.923704 1504508 retry.go:31] will retry after 385.703961ms: waiting for machine to come up
I0214 03:04:34.311384 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:34.311872 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:34.311909 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:34.311811 1504508 retry.go:31] will retry after 539.263627ms: waiting for machine to come up
I0214 03:04:34.853366 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:34.853810 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:34.853841 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:34.853744 1504508 retry.go:31] will retry after 651.069109ms: waiting for machine to come up
I0214 03:04:35.506508 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:35.506934 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:35.506956 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:35.506911 1504508 retry.go:31] will retry after 931.243329ms: waiting for machine to come up
I0214 03:04:36.439377 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:36.439840 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:36.439881 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:36.439803 1504508 retry.go:31] will retry after 937.425624ms: waiting for machine to come up
I0214 03:04:37.380044 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:37.380519 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:37.380550 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:37.380472 1504508 retry.go:31] will retry after 1.840284587s: waiting for machine to come up
I0214 03:04:39.223232 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:39.223698 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:39.223730 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:39.223635 1504508 retry.go:31] will retry after 1.807475488s: waiting for machine to come up
I0214 03:04:41.032873 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:41.033487 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:41.033526 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:41.033422 1504508 retry.go:31] will retry after 2.1212585s: waiting for machine to come up
I0214 03:04:43.156767 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:43.157431 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:43.157466 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:43.157399 1504508 retry.go:31] will retry after 3.177450242s: waiting for machine to come up
I0214 03:04:46.338803 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:46.339336 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:46.339368 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:46.339283 1504508 retry.go:31] will retry after 4.440671603s: waiting for machine to come up
I0214 03:04:50.785287 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:50.785808 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:50.785843 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:50.785740 1504508 retry.go:31] will retry after 4.939727768s: waiting for machine to come up
I0214 03:04:55.727404 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.727832 1503804 main.go:141] libmachine: (ha-447944-m03) Found IP for machine: 192.168.39.133
I0214 03:04:55.727858 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has current primary IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.727872 1503804 main.go:141] libmachine: (ha-447944-m03) Reserving static IP address...
I0214 03:04:55.728267 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find host DHCP lease matching {name: "ha-447944-m03", mac: "52:54:00:2e:2c:af", ip: "192.168.39.133"} in network mk-ha-447944
I0214 03:04:55.806016 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Getting to WaitForSSH function...
I0214 03:04:55.806052 1503804 main.go:141] libmachine: (ha-447944-m03) Reserved static IP address: 192.168.39.133
I0214 03:04:55.806064 1503804 main.go:141] libmachine: (ha-447944-m03) Waiting for SSH to be available...
I0214 03:04:55.809012 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.809591 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:minikube Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:55.809628 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.809819 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Using SSH client type: external
I0214 03:04:55.809856 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa (-rw-------)
I0214 03:04:55.809922 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.133 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 03:04:55.809943 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | About to run SSH command:
I0214 03:04:55.809957 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | exit 0
I0214 03:04:55.909818 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | SSH cmd err, output: <nil>:
I0214 03:04:55.910170 1503804 main.go:141] libmachine: (ha-447944-m03) KVM machine creation complete!
I0214 03:04:55.910452 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetConfigRaw
I0214 03:04:55.911054 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:55.911289 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:55.911511 1503804 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 03:04:55.911527 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:04:55.913003 1503804 main.go:141] libmachine: Detecting operating system of created instance...
I0214 03:04:55.913024 1503804 main.go:141] libmachine: Waiting for SSH to be available...
I0214 03:04:55.913031 1503804 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 03:04:55.913038 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:55.915586 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.915974 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:55.916012 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.916133 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:55.916325 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:55.916491 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:55.916646 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:55.916819 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:55.917436 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:55.917454 1503804 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 03:04:56.052977 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:04:56.053011 1503804 main.go:141] libmachine: Detecting the provisioner...
I0214 03:04:56.053025 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.056141 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.056546 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.056580 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.056758 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.056982 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.057160 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.057347 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.057549 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:56.057883 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:56.057897 1503804 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 03:04:56.198380 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:04:56.198507 1503804 main.go:141] libmachine: found compatible host: buildroot
I0214 03:04:56.198532 1503804 main.go:141] libmachine: Provisioning with buildroot...
I0214 03:04:56.198561 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetMachineName
I0214 03:04:56.198896 1503804 buildroot.go:166] provisioning hostname "ha-447944-m03"
I0214 03:04:56.198934 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetMachineName
I0214 03:04:56.199148 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.202348 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.202788 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.202816 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.202986 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.203193 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.203379 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.203520 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.203747 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:56.204073 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:56.204087 1503804 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-447944-m03 && echo "ha-447944-m03" | sudo tee /etc/hostname
I0214 03:04:56.350529 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944-m03
I0214 03:04:56.350563 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.353678 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.354211 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.354240 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.354453 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.354703 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.354873 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.355068 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.355237 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:56.355694 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:56.355725 1503804 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-447944-m03' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-447944-m03/g' /etc/hosts;
else
echo '127.0.1.1 ha-447944-m03' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:04:56.499722 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:04:56.499800 1503804 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:04:56.499899 1503804 buildroot.go:174] setting up certificates
I0214 03:04:56.499945 1503804 provision.go:84] configureAuth start
I0214 03:04:56.499975 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetMachineName
I0214 03:04:56.500291 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:04:56.503319 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.503718 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.503751 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.503926 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.506405 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.506818 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.506848 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.507050 1503804 provision.go:143] copyHostCerts
I0214 03:04:56.507096 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:04:56.507129 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:04:56.507138 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:04:56.507210 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:04:56.507284 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:04:56.507301 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:04:56.507308 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:04:56.507334 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:04:56.507384 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:04:56.507401 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:04:56.507407 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:04:56.507429 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:04:56.507483 1503804 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ha-447944-m03 san=[127.0.0.1 192.168.39.133 ha-447944-m03 localhost minikube]
I0214 03:04:56.687635 1503804 provision.go:177] copyRemoteCerts
I0214 03:04:56.687698 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:04:56.687722 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.690531 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.690875 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.690921 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.691059 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.691314 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.691543 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.691733 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:04:56.790228 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:04:56.790314 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0214 03:04:56.816182 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:04:56.816248 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 03:04:56.838278 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:04:56.838355 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:04:56.861954 1503804 provision.go:87] duration metric: took 361.990462ms to configureAuth
I0214 03:04:56.861990 1503804 buildroot.go:189] setting minikube options for container-runtime
I0214 03:04:56.862231 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:04:56.862334 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.865587 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.865956 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.865994 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.866194 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.866430 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.866645 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.866826 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.867080 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:56.867405 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:56.867427 1503804 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:04:57.196183 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:04:57.196213 1503804 main.go:141] libmachine: Checking connection to Docker...
I0214 03:04:57.196222 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetURL
I0214 03:04:57.197525 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Using libvirt version 6000000
I0214 03:04:57.199996 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.200397 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.200424 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.200623 1503804 main.go:141] libmachine: Docker is up and running!
I0214 03:04:57.200647 1503804 main.go:141] libmachine: Reticulating splines...
I0214 03:04:57.200658 1503804 client.go:171] duration metric: took 25.826216301s to LocalClient.Create
I0214 03:04:57.200688 1503804 start.go:167] duration metric: took 25.826285624s to libmachine.API.Create "ha-447944"
I0214 03:04:57.200700 1503804 start.go:293] postStartSetup for "ha-447944-m03" (driver="kvm2")
I0214 03:04:57.200719 1503804 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:04:57.200743 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.201048 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:04:57.201084 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:57.203493 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.203831 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.203860 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.203927 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:57.204139 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.204328 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:57.204504 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:04:57.302762 1503804 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:04:57.307252 1503804 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:04:57.307280 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:04:57.307343 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:04:57.307419 1503804 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:04:57.307429 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:04:57.307514 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:04:57.316667 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:04:57.339187 1503804 start.go:296] duration metric: took 138.467672ms for postStartSetup
I0214 03:04:57.339248 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetConfigRaw
I0214 03:04:57.339926 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:04:57.342531 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.342920 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.342949 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.343186 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:04:57.343405 1503804 start.go:128] duration metric: took 25.98761485s to createHost
I0214 03:04:57.343428 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:57.345718 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.346055 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.346074 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.346243 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:57.346418 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.346571 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.346737 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:57.346879 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:57.347186 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:57.347196 1503804 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:04:57.482449 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707879897.465586791
I0214 03:04:57.482484 1503804 fix.go:216] guest clock: 1707879897.465586791
I0214 03:04:57.482495 1503804 fix.go:229] Guest: 2024-02-14 03:04:57.465586791 +0000 UTC Remote: 2024-02-14 03:04:57.343417122 +0000 UTC m=+170.965620422 (delta=122.169669ms)
I0214 03:04:57.482518 1503804 fix.go:200] guest clock delta is within tolerance: 122.169669ms
I0214 03:04:57.482538 1503804 start.go:83] releasing machines lock for "ha-447944-m03", held for 26.126856879s
I0214 03:04:57.482566 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.482885 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:04:57.485974 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.486404 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.486429 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.489049 1503804 out.go:177] * Found network options:
I0214 03:04:57.490678 1503804 out.go:177] - NO_PROXY=192.168.39.41,192.168.39.218
W0214 03:04:57.492366 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
W0214 03:04:57.492395 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
I0214 03:04:57.492414 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.493080 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.493317 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.493424 1503804 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:04:57.493469 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
W0214 03:04:57.493492 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
W0214 03:04:57.493516 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
I0214 03:04:57.493583 1503804 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:04:57.493633 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:57.496442 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.496734 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.496950 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.496976 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.497163 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:57.497193 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.497219 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.497350 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.497445 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:57.497536 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:57.497618 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.497697 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:04:57.497794 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:57.497968 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:04:57.753773 1503804 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:04:57.759578 1503804 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:04:57.759653 1503804 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:04:57.774954 1503804 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 03:04:57.774977 1503804 start.go:494] detecting cgroup driver to use...
I0214 03:04:57.775043 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:04:57.793982 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:04:57.807458 1503804 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:04:57.807524 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:04:57.820908 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:04:57.834126 1503804 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:04:57.951122 1503804 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:04:58.067897 1503804 docker.go:233] disabling docker service ...
I0214 03:04:58.067965 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:04:58.082392 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:04:58.093653 1503804 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:04:58.211315 1503804 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:04:58.335852 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:04:58.349955 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:04:58.368796 1503804 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:04:58.368877 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:04:58.378423 1503804 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:04:58.378502 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:04:58.387764 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:04:58.396856 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:04:58.406073 1503804 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:04:58.415892 1503804 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:04:58.424179 1503804 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 03:04:58.424235 1503804 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 03:04:58.437377 1503804 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:04:58.445669 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:04:58.561727 1503804 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:04:58.743858 1503804 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:04:58.743957 1503804 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:04:58.749202 1503804 start.go:562] Will wait 60s for crictl version
I0214 03:04:58.749289 1503804 ssh_runner.go:195] Run: which crictl
I0214 03:04:58.753577 1503804 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:04:58.796883 1503804 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:04:58.796991 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:04:58.848076 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:04:58.904953 1503804 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:04:58.906624 1503804 out.go:177] - env NO_PROXY=192.168.39.41
I0214 03:04:58.908343 1503804 out.go:177] - env NO_PROXY=192.168.39.41,192.168.39.218
I0214 03:04:58.909969 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:04:58.913103 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:58.913674 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:58.913710 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:58.913903 1503804 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:04:58.918407 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:04:58.931995 1503804 mustload.go:65] Loading cluster: ha-447944
I0214 03:04:58.932249 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:04:58.932540 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:04:58.932597 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:04:58.949409 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34805
I0214 03:04:58.949947 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:04:58.950440 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:04:58.950466 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:04:58.950808 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:04:58.951061 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:04:58.952823 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:04:58.953209 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:04:58.953276 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:04:58.969332 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36187
I0214 03:04:58.969758 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:04:58.970353 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:04:58.970394 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:04:58.970749 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:04:58.970957 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:04:58.971122 1503804 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944 for IP: 192.168.39.133
I0214 03:04:58.971137 1503804 certs.go:194] generating shared ca certs ...
I0214 03:04:58.971194 1503804 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:04:58.971345 1503804 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:04:58.971394 1503804 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:04:58.971407 1503804 certs.go:256] generating profile certs ...
I0214 03:04:58.971516 1503804 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key
I0214 03:04:58.971547 1503804 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.3a606c76
I0214 03:04:58.971564 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.3a606c76 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41 192.168.39.218 192.168.39.133 192.168.39.254]
I0214 03:04:59.220510 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.3a606c76 ...
I0214 03:04:59.220549 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.3a606c76: {Name:mk805b6f304bd194a1321a4575b34094c01fa699 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:04:59.220755 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.3a606c76 ...
I0214 03:04:59.220769 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.3a606c76: {Name:mk60b7ba845904cfe971c4063495cbf9fbaf9905 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:04:59.220848 1503804 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.3a606c76 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt
I0214 03:04:59.221001 1503804 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.3a606c76 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key
I0214 03:04:59.221143 1503804 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key
I0214 03:04:59.221165 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:04:59.221182 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:04:59.221197 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:04:59.221213 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:04:59.221225 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:04:59.221239 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:04:59.221275 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:04:59.221290 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:04:59.221356 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:04:59.221387 1503804 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:04:59.221402 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:04:59.221432 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:04:59.221459 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:04:59.221484 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:04:59.221526 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:04:59.221556 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:04:59.221572 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:04:59.221588 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:04:59.221627 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:04:59.224880 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:04:59.225348 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:04:59.225404 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:04:59.225527 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:04:59.225734 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:04:59.225927 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:04:59.226109 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:04:59.309626 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub
I0214 03:04:59.316586 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
I0214 03:04:59.328547 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key
I0214 03:04:59.332884 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)
I0214 03:04:59.342552 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt
I0214 03:04:59.347190 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
I0214 03:04:59.359716 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key
I0214 03:04:59.364194 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)
I0214 03:04:59.374190 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt
I0214 03:04:59.378330 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
I0214 03:04:59.388203 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key
I0214 03:04:59.392789 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
I0214 03:04:59.403942 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:04:59.429552 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:04:59.452429 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:04:59.475620 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:04:59.501056 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)
I0214 03:04:59.525594 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 03:04:59.550003 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:04:59.572951 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:04:59.596226 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:04:59.621159 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:04:59.644773 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:04:59.668889 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
I0214 03:04:59.684765 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)
I0214 03:04:59.700761 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
I0214 03:04:59.716083 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)
I0214 03:04:59.732131 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
I0214 03:04:59.747655 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
I0214 03:04:59.762701 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
I0214 03:04:59.777808 1503804 ssh_runner.go:195] Run: openssl version
I0214 03:04:59.783105 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:04:59.792199 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:04:59.796960 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:04:59.797030 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:04:59.802740 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:04:59.813125 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:04:59.822502 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:04:59.827104 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:04:59.827147 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:04:59.833177 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:04:59.843743 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:04:59.854374 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:04:59.859111 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:04:59.859165 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:04:59.864699 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:04:59.874218 1503804 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:04:59.878086 1503804 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 03:04:59.878140 1503804 kubeadm.go:928] updating node {m03 192.168.39.133 8443 v1.28.4 crio true true} ...
I0214 03:04:59.878230 1503804 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-447944-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.133
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:04:59.878276 1503804 kube-vip.go:101] generating kube-vip config ...
I0214 03:04:59.878302 1503804 kube-vip.go:121] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_ddns
value: "false"
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v0.7.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0214 03:04:59.878337 1503804 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:04:59.886487 1503804 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.28.4: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.28.4': No such file or directory
Initiating transfer...
I0214 03:04:59.886554 1503804 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.28.4
I0214 03:04:59.895014 1503804 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubectl.sha256
I0214 03:04:59.895038 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubectl -> /var/lib/minikube/binaries/v1.28.4/kubectl
I0214 03:04:59.895041 1503804 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubeadm.sha256
I0214 03:04:59.895041 1503804 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubelet.sha256
I0214 03:04:59.895061 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm -> /var/lib/minikube/binaries/v1.28.4/kubeadm
I0214 03:04:59.895096 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubectl
I0214 03:04:59.895137 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:04:59.895154 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubeadm
I0214 03:04:59.904085 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubectl: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubectl': No such file or directory
I0214 03:04:59.904114 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubectl --> /var/lib/minikube/binaries/v1.28.4/kubectl (49885184 bytes)
I0214 03:04:59.909938 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet -> /var/lib/minikube/binaries/v1.28.4/kubelet
I0214 03:04:59.909978 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubeadm: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubeadm': No such file or directory
I0214 03:04:59.910011 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm --> /var/lib/minikube/binaries/v1.28.4/kubeadm (49102848 bytes)
I0214 03:04:59.910023 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubelet
I0214 03:04:59.951100 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubelet: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubelet': No such file or directory
I0214 03:04:59.951139 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet --> /var/lib/minikube/binaries/v1.28.4/kubelet (110850048 bytes)
I0214 03:05:00.780613 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
I0214 03:05:00.790380 1503804 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)
I0214 03:05:00.806724 1503804 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:05:00.823575 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1265 bytes)
I0214 03:05:00.840021 1503804 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0214 03:05:00.844054 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:05:00.855678 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:05:00.973446 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:05:00.989381 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:05:00.989762 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:05:00.989806 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:05:01.004600 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35847
I0214 03:05:01.005109 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:05:01.005659 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:05:01.005689 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:05:01.006081 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:05:01.006296 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:05:01.006482 1503804 start.go:316] joinCluster: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cluster
Name:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false i
nspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fa
lse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:05:01.006649 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm token create --print-join-command --ttl=0"
I0214 03:05:01.006677 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:05:01.010223 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:05:01.010705 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:05:01.010738 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:05:01.010909 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:05:01.011130 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:05:01.011302 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:05:01.011461 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:05:01.206354 1503804 start.go:342] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:05:01.206398 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm join control-plane.minikube.internal:8443 --token fk9mvz.ya6fw7u33bxwi51m --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-447944-m03 --control-plane --apiserver-advertise-address=192.168.39.133 --apiserver-bind-port=8443"
I0214 03:05:31.831546 1503804 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm join control-plane.minikube.internal:8443 --token fk9mvz.ya6fw7u33bxwi51m --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-447944-m03 --control-plane --apiserver-advertise-address=192.168.39.133 --apiserver-bind-port=8443": (30.625111543s)
I0214 03:05:31.831601 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
I0214 03:05:32.351229 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-447944-m03 minikube.k8s.io/updated_at=2024_02_14T03_05_32_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=ha-447944 minikube.k8s.io/primary=false
I0214 03:05:32.500973 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-447944-m03 node-role.kubernetes.io/control-plane:NoSchedule-
I0214 03:05:32.643802 1503804 start.go:318] duration metric: took 31.637304929s to joinCluster
I0214 03:05:32.643952 1503804 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:05:32.645690 1503804 out.go:177] * Verifying Kubernetes components...
I0214 03:05:32.644304 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:05:32.647101 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:05:32.909964 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:05:32.928628 1503804 loader.go:395] Config loaded from file: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:05:32.928877 1503804 kapi.go:59] client config for ha-447944: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]strin
g(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
W0214 03:05:32.928957 1503804 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.41:8443
I0214 03:05:32.929189 1503804 node_ready.go:35] waiting up to 6m0s for node "ha-447944-m03" to be "Ready" ...
I0214 03:05:32.929303 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:32.929312 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:32.929320 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:32.929326 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:32.934053 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:33.430283 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:33.430314 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:33.430327 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:33.430335 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:33.434481 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:33.929483 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:33.929513 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:33.929525 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:33.929536 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:33.934711 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:34.429487 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:34.429519 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:34.429536 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:34.429545 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:34.434761 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:34.930319 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:34.930354 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:34.930366 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:34.930375 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:34.935203 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:34.936276 1503804 node_ready.go:53] node "ha-447944-m03" has status "Ready":"False"
I0214 03:05:35.430064 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:35.430088 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:35.430097 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:35.430103 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:35.433577 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:35.929463 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:35.929492 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:35.929503 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:35.929512 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:35.933411 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:36.429709 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:36.431085 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:36.431106 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:36.431117 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:36.435689 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:36.930172 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:36.930202 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:36.930215 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:36.930233 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:36.933964 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:37.430213 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:37.430235 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:37.430243 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:37.430249 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:37.434881 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:37.436351 1503804 node_ready.go:53] node "ha-447944-m03" has status "Ready":"False"
I0214 03:05:37.929469 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:37.929513 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:37.929534 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:37.929541 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:37.933747 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:38.429461 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:38.429490 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:38.429503 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:38.429513 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:38.433922 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:38.930388 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:38.930422 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:38.930434 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:38.930443 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:38.934229 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.430291 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:39.430322 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.430333 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.430343 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.435510 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:39.929823 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:39.929850 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.929857 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.929864 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.934204 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:39.934774 1503804 node_ready.go:49] node "ha-447944-m03" has status "Ready":"True"
I0214 03:05:39.934796 1503804 node_ready.go:38] duration metric: took 7.005591557s for node "ha-447944-m03" to be "Ready" ...
I0214 03:05:39.934806 1503804 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:05:39.934894 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:39.934907 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.934918 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.934931 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.943462 1503804 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds
I0214 03:05:39.951605 1503804 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.951695 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-chs9l
I0214 03:05:39.951709 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.951717 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.951722 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.955282 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.955991 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:39.956007 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.956015 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.956021 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.960383 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:39.961514 1503804 pod_ready.go:92] pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:39.961533 1503804 pod_ready.go:81] duration metric: took 9.903069ms for pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.961543 1503804 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.961598 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rpnsx
I0214 03:05:39.961605 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.961613 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.961621 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.965506 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.966906 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:39.966925 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.966932 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.966938 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.970379 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.971713 1503804 pod_ready.go:92] pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:39.971730 1503804 pod_ready.go:81] duration metric: took 10.181405ms for pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.971739 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.971800 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944
I0214 03:05:39.971809 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.971816 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.971824 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.977326 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:39.977844 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:39.977857 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.977864 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.977869 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.983271 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:39.983946 1503804 pod_ready.go:92] pod "etcd-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:39.983976 1503804 pod_ready.go:81] duration metric: took 12.230345ms for pod "etcd-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.983989 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.984059 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m02
I0214 03:05:39.984067 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.984074 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.984080 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.988573 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:39.989835 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:39.989849 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.989857 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.989862 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.993206 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.994370 1503804 pod_ready.go:92] pod "etcd-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:39.994394 1503804 pod_ready.go:81] duration metric: took 10.393577ms for pod "etcd-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.994406 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:40.130983 1503804 request.go:629] Waited for 136.474266ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:40.131095 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:40.131103 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.131114 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:40.131125 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.135382 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:40.330722 1503804 request.go:629] Waited for 194.381098ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:40.330817 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:40.330834 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.330845 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:40.330857 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.335067 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:40.530524 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:40.530558 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.530570 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:40.530580 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.540798 1503804 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds
I0214 03:05:40.730316 1503804 request.go:629] Waited for 188.386871ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:40.730415 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:40.730421 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.730438 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:40.730444 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.734514 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:40.995458 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:40.995484 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.995493 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.995499 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.000447 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:41.130730 1503804 request.go:629] Waited for 129.334873ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:41.131242 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:41.131322 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.131334 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.131346 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.136384 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:41.494892 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:41.494916 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.494924 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.494931 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.499495 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:41.529916 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:41.529940 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.529952 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.529959 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.534090 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:41.534642 1503804 pod_ready.go:92] pod "etcd-ha-447944-m03" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:41.534662 1503804 pod_ready.go:81] duration metric: took 1.540246847s for pod "etcd-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:41.534692 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:41.730233 1503804 request.go:629] Waited for 195.410449ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944
I0214 03:05:41.730312 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944
I0214 03:05:41.730318 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.730325 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.730333 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.735497 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:41.930504 1503804 request.go:629] Waited for 194.037217ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:41.930592 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:41.930603 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.930617 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.930640 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.934264 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:41.934764 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:41.934784 1503804 pod_ready.go:81] duration metric: took 400.077766ms for pod "kube-apiserver-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:41.934794 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.129991 1503804 request.go:629] Waited for 195.090379ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:05:42.130087 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:05:42.130099 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.130112 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.130124 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.134428 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:42.330689 1503804 request.go:629] Waited for 195.426457ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:42.330791 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:42.330799 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.330811 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.330820 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.335217 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:42.336228 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:42.336257 1503804 pod_ready.go:81] duration metric: took 401.455111ms for pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.336271 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.530433 1503804 request.go:629] Waited for 194.069646ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m03
I0214 03:05:42.530541 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m03
I0214 03:05:42.530553 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.530564 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.530577 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.534575 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:42.730832 1503804 request.go:629] Waited for 195.372279ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:42.730899 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:42.730904 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.730914 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.730920 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.735002 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:42.735629 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944-m03" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:42.735651 1503804 pod_ready.go:81] duration metric: took 399.372275ms for pod "kube-apiserver-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.735663 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.930749 1503804 request.go:629] Waited for 195.003759ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944
I0214 03:05:42.930838 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944
I0214 03:05:42.930853 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.930862 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.930868 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.935037 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.130317 1503804 request.go:629] Waited for 194.445455ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:43.130408 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:43.130417 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.130433 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.130447 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.134549 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.135321 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:43.135350 1503804 pod_ready.go:81] duration metric: took 399.679407ms for pod "kube-controller-manager-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:43.135360 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:43.330505 1503804 request.go:629] Waited for 194.97349ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m02
I0214 03:05:43.330590 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m02
I0214 03:05:43.330599 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.330610 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.330624 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.335228 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.530465 1503804 request.go:629] Waited for 194.33279ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:43.530583 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:43.530594 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.530606 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.530618 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.535053 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.535633 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:43.535658 1503804 pod_ready.go:81] duration metric: took 400.290286ms for pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:43.535668 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:43.730882 1503804 request.go:629] Waited for 195.123709ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m03
I0214 03:05:43.730970 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m03
I0214 03:05:43.730977 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.730991 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.731001 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.735220 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.930378 1503804 request.go:629] Waited for 194.399955ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:43.930478 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:43.930485 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.930496 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.930508 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.934312 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:44.130512 1503804 request.go:629] Waited for 94.313935ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m03
I0214 03:05:44.130595 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m03
I0214 03:05:44.130602 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.130613 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.130623 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.135107 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:44.330299 1503804 request.go:629] Waited for 194.442093ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:44.330387 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:44.330392 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.330401 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.330408 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.334465 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:44.335194 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944-m03" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:44.335220 1503804 pod_ready.go:81] duration metric: took 799.54483ms for pod "kube-controller-manager-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:44.335230 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9cjk2" in "kube-system" namespace to be "Ready" ...
I0214 03:05:44.530759 1503804 request.go:629] Waited for 195.426151ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9cjk2
I0214 03:05:44.530858 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9cjk2
I0214 03:05:44.530887 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.530898 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.530909 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.535038 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:44.730476 1503804 request.go:629] Waited for 194.566717ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:44.730556 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:44.730561 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.730571 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.730583 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.735465 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:44.736382 1503804 pod_ready.go:92] pod "kube-proxy-9cjk2" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:44.736417 1503804 pod_ready.go:81] duration metric: took 401.180862ms for pod "kube-proxy-9cjk2" in "kube-system" namespace to be "Ready" ...
I0214 03:05:44.736428 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dpm4f" in "kube-system" namespace to be "Ready" ...
I0214 03:05:44.930623 1503804 request.go:629] Waited for 194.118805ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-dpm4f
I0214 03:05:44.930706 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-dpm4f
I0214 03:05:44.930716 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.930727 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.930738 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.935262 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:45.130559 1503804 request.go:629] Waited for 194.419279ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:45.130626 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:45.130630 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.130638 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.130645 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.135159 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:45.136181 1503804 pod_ready.go:92] pod "kube-proxy-dpm4f" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:45.136222 1503804 pod_ready.go:81] duration metric: took 399.777167ms for pod "kube-proxy-dpm4f" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.136237 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-rz6vt" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.330230 1503804 request.go:629] Waited for 193.904155ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-rz6vt
I0214 03:05:45.330307 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-rz6vt
I0214 03:05:45.330315 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.330326 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.330335 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.334810 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:45.530157 1503804 request.go:629] Waited for 194.388263ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:45.530225 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:45.530234 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.530242 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.530252 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.534191 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:45.534904 1503804 pod_ready.go:92] pod "kube-proxy-rz6vt" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:45.534929 1503804 pod_ready.go:81] duration metric: took 398.68278ms for pod "kube-proxy-rz6vt" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.534942 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.730152 1503804 request.go:629] Waited for 195.104415ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944
I0214 03:05:45.730240 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944
I0214 03:05:45.730251 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.730263 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.730272 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.734034 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:45.929888 1503804 request.go:629] Waited for 195.292662ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:45.930008 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:45.930020 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.930032 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.930042 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.934067 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:45.934790 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:45.934819 1503804 pod_ready.go:81] duration metric: took 399.86818ms for pod "kube-scheduler-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.934838 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:46.130325 1503804 request.go:629] Waited for 195.394801ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m02
I0214 03:05:46.130418 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m02
I0214 03:05:46.130423 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.130431 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.130438 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.134695 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:46.330461 1503804 request.go:629] Waited for 195.250466ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:46.330551 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:46.330564 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.330579 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.330595 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.335020 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:46.336067 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:46.336089 1503804 pod_ready.go:81] duration metric: took 401.239194ms for pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:46.336102 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:46.530201 1503804 request.go:629] Waited for 193.991421ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m03
I0214 03:05:46.530302 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m03
I0214 03:05:46.530312 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.530320 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.530327 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.534170 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:46.730300 1503804 request.go:629] Waited for 195.206006ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:46.730375 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:46.730380 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.730388 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.730394 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.734407 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:46.735070 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944-m03" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:46.735093 1503804 pod_ready.go:81] duration metric: took 398.984598ms for pod "kube-scheduler-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:46.735107 1503804 pod_ready.go:38] duration metric: took 6.80028443s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:05:46.735128 1503804 api_server.go:52] waiting for apiserver process to appear ...
I0214 03:05:46.735203 1503804 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:05:46.751047 1503804 api_server.go:72] duration metric: took 14.107051273s to wait for apiserver process to appear ...
I0214 03:05:46.751081 1503804 api_server.go:88] waiting for apiserver healthz status ...
I0214 03:05:46.751113 1503804 api_server.go:253] Checking apiserver healthz at https://192.168.39.41:8443/healthz ...
I0214 03:05:46.756613 1503804 api_server.go:279] https://192.168.39.41:8443/healthz returned 200:
ok
I0214 03:05:46.756686 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/version
I0214 03:05:46.756691 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.756699 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.756706 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.758276 1503804 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0214 03:05:46.758408 1503804 api_server.go:141] control plane version: v1.28.4
I0214 03:05:46.758429 1503804 api_server.go:131] duration metric: took 7.341489ms to wait for apiserver health ...
I0214 03:05:46.758437 1503804 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 03:05:46.930585 1503804 request.go:629] Waited for 172.073514ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:46.930665 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:46.930670 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.930678 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.930684 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.938039 1503804 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds
I0214 03:05:46.945232 1503804 system_pods.go:59] 24 kube-system pods found
I0214 03:05:46.945275 1503804 system_pods.go:61] "coredns-5dd5756b68-chs9l" [224031c4-3d57-4119-921f-0e3fcdceec9c] Running
I0214 03:05:46.945285 1503804 system_pods.go:61] "coredns-5dd5756b68-rpnsx" [cef2a300-e8ff-4099-a5c4-4906889e902c] Running
I0214 03:05:46.945291 1503804 system_pods.go:61] "etcd-ha-447944" [b9879f26-9700-4bee-8e37-f132f15a4582] Running
I0214 03:05:46.945296 1503804 system_pods.go:61] "etcd-ha-447944-m02" [7a7cc3b5-6f9d-42ef-926b-2644763f6072] Running
I0214 03:05:46.945300 1503804 system_pods.go:61] "etcd-ha-447944-m03" [333b2788-49e2-4eb2-ab37-1bcf2e3a36b9] Running
I0214 03:05:46.945303 1503804 system_pods.go:61] "kindnet-pjrmh" [5cc39f50-0de5-40b5-b670-b33acc977740] Running
I0214 03:05:46.945307 1503804 system_pods.go:61] "kindnet-xkmkd" [534c4261-88a5-4120-89c4-c94bdfb2be76] Running
I0214 03:05:46.945311 1503804 system_pods.go:61] "kindnet-xwqhp" [f6cb2716-1303-433e-b2b7-53cc035ffc7a] Running
I0214 03:05:46.945315 1503804 system_pods.go:61] "kube-apiserver-ha-447944" [d48bd5fd-0acd-438c-8b9b-625fcc96d2c0] Running
I0214 03:05:46.945319 1503804 system_pods.go:61] "kube-apiserver-ha-447944-m02" [b36af3a6-21cc-47ae-910d-443dea7db747] Running
I0214 03:05:46.945323 1503804 system_pods.go:61] "kube-apiserver-ha-447944-m03" [e70600fa-8bc4-4321-b1d9-2f93d1c634a3] Running
I0214 03:05:46.945327 1503804 system_pods.go:61] "kube-controller-manager-ha-447944" [136c8014-5e6e-4af5-aa70-c041e62fb725] Running
I0214 03:05:46.945332 1503804 system_pods.go:61] "kube-controller-manager-ha-447944-m02" [f3bc1826-4323-4c0c-8255-855ffab6cf3d] Running
I0214 03:05:46.945337 1503804 system_pods.go:61] "kube-controller-manager-ha-447944-m03" [04928942-0b40-404f-9c46-53846956c358] Running
I0214 03:05:46.945343 1503804 system_pods.go:61] "kube-proxy-9cjk2" [87b6de90-7a92-4c40-bfe1-41353a81d40b] Running
I0214 03:05:46.945347 1503804 system_pods.go:61] "kube-proxy-dpm4f" [2e0eb813-44c4-4623-8789-d37194b83ecd] Running
I0214 03:05:46.945351 1503804 system_pods.go:61] "kube-proxy-rz6vt" [d396cc98-4175-4364-a84e-6e29c647be56] Running
I0214 03:05:46.945354 1503804 system_pods.go:61] "kube-scheduler-ha-447944" [39ba6921-10a6-4a43-8ecd-8afc7092ba98] Running
I0214 03:05:46.945358 1503804 system_pods.go:61] "kube-scheduler-ha-447944-m02" [f8de4bcd-f5ba-4172-a461-7c2cc73ea6f2] Running
I0214 03:05:46.945362 1503804 system_pods.go:61] "kube-scheduler-ha-447944-m03" [873867e0-f4fe-4450-95e8-860b2af6e116] Running
I0214 03:05:46.945365 1503804 system_pods.go:61] "kube-vip-ha-447944" [8e505ede-4ac8-4482-97ba-08943265ce41] Running
I0214 03:05:46.945372 1503804 system_pods.go:61] "kube-vip-ha-447944-m02" [80c89449-01b1-414b-bf1a-c727d4b03e8d] Running
I0214 03:05:46.945375 1503804 system_pods.go:61] "kube-vip-ha-447944-m03" [3ad2afab-b960-4b65-8357-2fd24e022ee4] Running
I0214 03:05:46.945381 1503804 system_pods.go:61] "storage-provisioner" [7da2937f-2d9b-40d4-a521-5bf4a2585de7] Running
I0214 03:05:46.945387 1503804 system_pods.go:74] duration metric: took 186.94533ms to wait for pod list to return data ...
I0214 03:05:46.945396 1503804 default_sa.go:34] waiting for default service account to be created ...
I0214 03:05:47.130887 1503804 request.go:629] Waited for 185.38484ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:05:47.130975 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:05:47.130984 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:47.130996 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:47.131011 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:47.135082 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:47.135267 1503804 default_sa.go:45] found service account: "default"
I0214 03:05:47.135287 1503804 default_sa.go:55] duration metric: took 189.883221ms for default service account to be created ...
I0214 03:05:47.135299 1503804 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 03:05:47.330768 1503804 request.go:629] Waited for 195.356807ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:47.330873 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:47.330892 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:47.330908 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:47.330923 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:47.340805 1503804 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds
I0214 03:05:47.347992 1503804 system_pods.go:86] 24 kube-system pods found
I0214 03:05:47.348030 1503804 system_pods.go:89] "coredns-5dd5756b68-chs9l" [224031c4-3d57-4119-921f-0e3fcdceec9c] Running
I0214 03:05:47.348038 1503804 system_pods.go:89] "coredns-5dd5756b68-rpnsx" [cef2a300-e8ff-4099-a5c4-4906889e902c] Running
I0214 03:05:47.348045 1503804 system_pods.go:89] "etcd-ha-447944" [b9879f26-9700-4bee-8e37-f132f15a4582] Running
I0214 03:05:47.348052 1503804 system_pods.go:89] "etcd-ha-447944-m02" [7a7cc3b5-6f9d-42ef-926b-2644763f6072] Running
I0214 03:05:47.348069 1503804 system_pods.go:89] "etcd-ha-447944-m03" [333b2788-49e2-4eb2-ab37-1bcf2e3a36b9] Running
I0214 03:05:47.348076 1503804 system_pods.go:89] "kindnet-pjrmh" [5cc39f50-0de5-40b5-b670-b33acc977740] Running
I0214 03:05:47.348082 1503804 system_pods.go:89] "kindnet-xkmkd" [534c4261-88a5-4120-89c4-c94bdfb2be76] Running
I0214 03:05:47.348088 1503804 system_pods.go:89] "kindnet-xwqhp" [f6cb2716-1303-433e-b2b7-53cc035ffc7a] Running
I0214 03:05:47.348095 1503804 system_pods.go:89] "kube-apiserver-ha-447944" [d48bd5fd-0acd-438c-8b9b-625fcc96d2c0] Running
I0214 03:05:47.348102 1503804 system_pods.go:89] "kube-apiserver-ha-447944-m02" [b36af3a6-21cc-47ae-910d-443dea7db747] Running
I0214 03:05:47.348110 1503804 system_pods.go:89] "kube-apiserver-ha-447944-m03" [e70600fa-8bc4-4321-b1d9-2f93d1c634a3] Running
I0214 03:05:47.348121 1503804 system_pods.go:89] "kube-controller-manager-ha-447944" [136c8014-5e6e-4af5-aa70-c041e62fb725] Running
I0214 03:05:47.348129 1503804 system_pods.go:89] "kube-controller-manager-ha-447944-m02" [f3bc1826-4323-4c0c-8255-855ffab6cf3d] Running
I0214 03:05:47.348146 1503804 system_pods.go:89] "kube-controller-manager-ha-447944-m03" [04928942-0b40-404f-9c46-53846956c358] Running
I0214 03:05:47.348153 1503804 system_pods.go:89] "kube-proxy-9cjk2" [87b6de90-7a92-4c40-bfe1-41353a81d40b] Running
I0214 03:05:47.348161 1503804 system_pods.go:89] "kube-proxy-dpm4f" [2e0eb813-44c4-4623-8789-d37194b83ecd] Running
I0214 03:05:47.348171 1503804 system_pods.go:89] "kube-proxy-rz6vt" [d396cc98-4175-4364-a84e-6e29c647be56] Running
I0214 03:05:47.348180 1503804 system_pods.go:89] "kube-scheduler-ha-447944" [39ba6921-10a6-4a43-8ecd-8afc7092ba98] Running
I0214 03:05:47.348191 1503804 system_pods.go:89] "kube-scheduler-ha-447944-m02" [f8de4bcd-f5ba-4172-a461-7c2cc73ea6f2] Running
I0214 03:05:47.348201 1503804 system_pods.go:89] "kube-scheduler-ha-447944-m03" [873867e0-f4fe-4450-95e8-860b2af6e116] Running
I0214 03:05:47.348210 1503804 system_pods.go:89] "kube-vip-ha-447944" [8e505ede-4ac8-4482-97ba-08943265ce41] Running
I0214 03:05:47.348219 1503804 system_pods.go:89] "kube-vip-ha-447944-m02" [80c89449-01b1-414b-bf1a-c727d4b03e8d] Running
I0214 03:05:47.348226 1503804 system_pods.go:89] "kube-vip-ha-447944-m03" [3ad2afab-b960-4b65-8357-2fd24e022ee4] Running
I0214 03:05:47.348236 1503804 system_pods.go:89] "storage-provisioner" [7da2937f-2d9b-40d4-a521-5bf4a2585de7] Running
I0214 03:05:47.348247 1503804 system_pods.go:126] duration metric: took 212.941224ms to wait for k8s-apps to be running ...
I0214 03:05:47.348257 1503804 system_svc.go:44] waiting for kubelet service to be running ....
I0214 03:05:47.348318 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:05:47.372595 1503804 system_svc.go:56] duration metric: took 24.327654ms WaitForService to wait for kubelet
I0214 03:05:47.372633 1503804 kubeadm.go:576] duration metric: took 14.728643642s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:05:47.372660 1503804 node_conditions.go:102] verifying NodePressure condition ...
I0214 03:05:47.529977 1503804 request.go:629] Waited for 157.219728ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes
I0214 03:05:47.530075 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes
I0214 03:05:47.530086 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:47.530099 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:47.530113 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:47.535210 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:47.536402 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:05:47.536428 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:05:47.536445 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:05:47.536451 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:05:47.536457 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:05:47.536462 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:05:47.536468 1503804 node_conditions.go:105] duration metric: took 163.801705ms to run NodePressure ...
I0214 03:05:47.536500 1503804 start.go:240] waiting for startup goroutines ...
I0214 03:05:47.536529 1503804 start.go:254] writing updated cluster config ...
I0214 03:05:47.536857 1503804 ssh_runner.go:195] Run: rm -f paused
I0214 03:05:47.593595 1503804 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 03:05:47.596482 1503804 out.go:177] * Done! kubectl is now configured to use "ha-447944" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 03:02:18 UTC, ends at Wed 2024-02-14 03:09:23 UTC. --
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.255367601Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=69382f00-0311-4367-bd91-dee70a5a099d name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.255921920Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880163255907633,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=69382f00-0311-4367-bd91-dee70a5a099d name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.256547240Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=5171ea4b-a86b-4f18-a285-08b7fc2f6dd4 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.256644502Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=5171ea4b-a86b-4f18-a285-08b7fc2f6dd4 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.257396039Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707879954982427495,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.kubernetes.c
ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:494e2397438cea9012a91d71f80adbf747b0858fd8662088495857ea4f140083,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707879852742368720,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 1,io.kubernetes.co
ntainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:671171bd8cc89d2576e6f5d6e07feb4d4fe4fe637d7d07167f06fbea9e5d6b6b,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707879851739185075,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termi
nation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8391be96f5e7718850233a5934e8c5ac915c361d787452a4b2598203fa35b35b,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707879791703352562,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termina
tion-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791123663122,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPo
rt\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791194984160,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,}
,Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f,PodSandboxId:1ca3a54100ad9ab99099afc853b6b90438667b23b57ced2e2ab3c7924b545a33,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707879788029642996,Labels:map[string
]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707879785332012948,Labels:map[string]string{io.kubernetes.container.name:
kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:58b16160dd3050fdc7935e70e6c54431cebba2778995362d8867ac9d9e0f5bbe,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_EXITED,CreatedAt:1707879769405613391,Labels:map[string]string{io.kubernetes.container.name: kube-
vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707879764450387680,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernete
s.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707879764472168051,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: ku
be-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe,PodSandboxId:bdbc6964aad0947d1c3dff295a66352141a9d317183b9ed66532e1a16e5d5f7e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707879763880134071,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubern
etes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72,PodSandboxId:6bfe5642286cbee97891f6cd9fbe7cab921cb6c5bf987613e215ebcd93f36e3f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707879763901103124,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube
-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=5171ea4b-a86b-4f18-a285-08b7fc2f6dd4 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.306288244Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=8da599cf-8e2b-4de0-94a0-06c4f28dd17b name=/runtime.v1.RuntimeService/Version
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.306362279Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=8da599cf-8e2b-4de0-94a0-06c4f28dd17b name=/runtime.v1.RuntimeService/Version
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.312179438Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=8e28fd98-2e9d-4888-979c-04a28ff32ff6 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.313006975Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880163312983314,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=8e28fd98-2e9d-4888-979c-04a28ff32ff6 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.313904461Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=20152263-9c26-4a05-8ce5-ed4f284a5cfb name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.314061754Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=20152263-9c26-4a05-8ce5-ed4f284a5cfb name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.314343003Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707879954982427495,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.kubernetes.c
ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:494e2397438cea9012a91d71f80adbf747b0858fd8662088495857ea4f140083,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707879852742368720,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 1,io.kubernetes.co
ntainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:671171bd8cc89d2576e6f5d6e07feb4d4fe4fe637d7d07167f06fbea9e5d6b6b,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707879851739185075,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termi
nation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8391be96f5e7718850233a5934e8c5ac915c361d787452a4b2598203fa35b35b,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707879791703352562,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termina
tion-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791123663122,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPo
rt\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791194984160,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,}
,Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f,PodSandboxId:1ca3a54100ad9ab99099afc853b6b90438667b23b57ced2e2ab3c7924b545a33,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707879788029642996,Labels:map[string
]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707879785332012948,Labels:map[string]string{io.kubernetes.container.name:
kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:58b16160dd3050fdc7935e70e6c54431cebba2778995362d8867ac9d9e0f5bbe,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_EXITED,CreatedAt:1707879769405613391,Labels:map[string]string{io.kubernetes.container.name: kube-
vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707879764450387680,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernete
s.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707879764472168051,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: ku
be-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe,PodSandboxId:bdbc6964aad0947d1c3dff295a66352141a9d317183b9ed66532e1a16e5d5f7e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707879763880134071,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubern
etes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72,PodSandboxId:6bfe5642286cbee97891f6cd9fbe7cab921cb6c5bf987613e215ebcd93f36e3f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707879763901103124,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube
-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=20152263-9c26-4a05-8ce5-ed4f284a5cfb name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326214470Z" level=debug msg="Request: &ListImagesRequest{Filter:nil,}" file="go-grpc-middleware/chain.go:25" id=627dfa33-3b25-4abe-b163-604748ffc71e name=/runtime.v1.ImageService/ListImages
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326403072Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326494855Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326621082Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326693694Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326836172Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326883748Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326932258Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.326976469Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.327048098Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.327097830Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.327140090Z" level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.mountopt=nodev,metacopy=on]@8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a\"" file="storage/storage_transport.go:185"
Feb 14 03:09:23 ha-447944 crio[718]: time="2024-02-14 03:09:23.327292757Z" level=debug msg="Response: &ListImagesResponse{Images:[]*Image{&Image{Id:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,RepoTags:[registry.k8s.io/kube-apiserver:v1.28.4],RepoDigests:[registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499 registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb],Size_:127226832,Uid:&Int64Value{Value:0,},Username:,Spec:nil,},&Image{Id:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,RepoTags:[registry.k8s.io/kube-controller-manager:v1.28.4],RepoDigests:[registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232],Size_:123261750,Uid:&Int64Value{Value:0,},Username:,Spec:nil,},&Image{Id:e3db313c6dbc065d4ac3b32c
7a6f2a878949031b881d217b63881a109c5cfba1,RepoTags:[registry.k8s.io/kube-scheduler:v1.28.4],RepoDigests:[registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32],Size_:61551410,Uid:&Int64Value{Value:0,},Username:,Spec:nil,},&Image{Id:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,RepoTags:[registry.k8s.io/kube-proxy:v1.28.4],RepoDigests:[registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532],Size_:74749335,Uid:nil,Username:,Spec:nil,},&Image{Id:e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c,RepoTags:[registry.k8s.io/pause:3.9],RepoDigests:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975
d65175d994072d65341f62a8ab0754b0fafe10],Size_:750414,Uid:&Int64Value{Value:65535,},Username:,Spec:nil,},&Image{Id:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,RepoTags:[registry.k8s.io/etcd:3.5.9-0],RepoDigests:[registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15 registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3],Size_:295456551,Uid:&Int64Value{Value:0,},Username:,Spec:nil,},&Image{Id:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,RepoTags:[registry.k8s.io/coredns/coredns:v1.10.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378],Size_:53621675,Uid:nil,Username:,Spec:nil,},&Image{Id:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,RepoTags:[gcr.io/k8s-minikube/storage-provisioner:v5],RepoDigests:[gcr.io/k
8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944 gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f],Size_:31470524,Uid:nil,Username:,Spec:nil,},&Image{Id:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,RepoTags:[docker.io/kindest/kindnetd:v20230809-80a64d96],RepoDigests:[docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052 docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4],Size_:65258016,Uid:nil,Username:,Spec:nil,},&Image{Id:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,RepoTags:[ghcr.io/kube-vip/kube-vip:v0.7.0],RepoDigests:[ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244 ghcr.io/kube-vip/kube-vip@sha256:260ed00348d1e669dd348adfed22ffaed81e2d908701e3489247824f17cfbf05],Size_:45576152,Uid:nil,Username:,Spec:nil,},&I
mage{Id:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,RepoTags:[gcr.io/k8s-minikube/busybox:1.28],RepoDigests:[gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12],Size_:1363676,Uid:nil,Username:,Spec:nil,},},}" file="go-grpc-middleware/chain.go:25" id=627dfa33-3b25-4abe-b163-604748ffc71e name=/runtime.v1.ImageService/ListImages
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
158ed81c1ad09 gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 3 minutes ago Running busybox 0 ae707b68d26d7 busybox-5b5d89c9d6-szrmk
494e2397438ce 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 5 minutes ago Running storage-provisioner 1 952b8ac262ad9 storage-provisioner
671171bd8cc89 77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e 5 minutes ago Running kube-vip 1 40d66b939fbde kube-vip-ha-447944
8391be96f5e77 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 6 minutes ago Exited storage-provisioner 0 952b8ac262ad9 storage-provisioner
f046573e5c613 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 6 minutes ago Running coredns 0 f5b7a259c6576 coredns-5dd5756b68-rpnsx
7e9bb46f5e644 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 6 minutes ago Running coredns 0 9646d9ad7639e coredns-5dd5756b68-chs9l
2d1d563ca45e6 c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc 6 minutes ago Running kindnet-cni 0 1ca3a54100ad9 kindnet-pjrmh
9d1286d601bde 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 6 minutes ago Running kube-proxy 0 c168dfe284262 kube-proxy-dpm4f
58b16160dd305 ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244 6 minutes ago Exited kube-vip 0 40d66b939fbde kube-vip-ha-447944
322a42a79321e e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 6 minutes ago Running kube-scheduler 0 fc67797793fd2 kube-scheduler-ha-447944
a8ad5c38dc289 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 6 minutes ago Running etcd 0 bb35989a47301 etcd-ha-447944
31292f46771fe d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 6 minutes ago Running kube-controller-manager 0 6bfe5642286cb kube-controller-manager-ha-447944
7fe5eed784edf 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 6 minutes ago Running kube-apiserver 0 bdbc6964aad09 kube-apiserver-ha-447944
==> coredns [7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb] <==
[INFO] 10.244.0.4:40217 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000330072s
[INFO] 10.244.0.4:52264 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.0007017s
[INFO] 10.244.2.2:58826 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000263967s
[INFO] 10.244.2.2:58742 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000106317s
[INFO] 10.244.1.2:54246 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000345097s
[INFO] 10.244.1.2:56830 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000207364s
[INFO] 10.244.1.2:53196 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000201609s
[INFO] 10.244.0.4:57282 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000255022s
[INFO] 10.244.0.4:42175 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000101666s
[INFO] 10.244.0.4:47990 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001543994s
[INFO] 10.244.2.2:36297 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000098014s
[INFO] 10.244.2.2:55624 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001606173s
[INFO] 10.244.1.2:42215 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000164975s
[INFO] 10.244.1.2:56863 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00013524s
[INFO] 10.244.0.4:54854 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000077245s
[INFO] 10.244.2.2:47287 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000112202s
[INFO] 10.244.2.2:57185 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000259211s
[INFO] 10.244.2.2:34362 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00020542s
[INFO] 10.244.2.2:35530 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000085011s
[INFO] 10.244.1.2:55025 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000219197s
[INFO] 10.244.1.2:41871 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000278055s
[INFO] 10.244.0.4:34459 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000106414s
[INFO] 10.244.0.4:49400 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000157055s
[INFO] 10.244.0.4:45347 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000226252s
[INFO] 10.244.2.2:56178 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000172264s
==> coredns [f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e] <==
[INFO] 10.244.1.2:53609 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000230567s
[INFO] 10.244.1.2:42733 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003471408s
[INFO] 10.244.1.2:59825 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000162339s
[INFO] 10.244.0.4:35367 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000075576s
[INFO] 10.244.0.4:60738 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001978154s
[INFO] 10.244.0.4:59564 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00011757s
[INFO] 10.244.0.4:57775 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000059017s
[INFO] 10.244.0.4:50120 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000078756s
[INFO] 10.244.2.2:49507 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000141378s
[INFO] 10.244.2.2:49171 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001957068s
[INFO] 10.244.2.2:33740 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000387227s
[INFO] 10.244.2.2:35506 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000108121s
[INFO] 10.244.2.2:58270 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000096656s
[INFO] 10.244.2.2:47275 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000113722s
[INFO] 10.244.1.2:39124 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000232628s
[INFO] 10.244.1.2:36677 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000104764s
[INFO] 10.244.0.4:52867 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000150283s
[INFO] 10.244.0.4:39534 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000098645s
[INFO] 10.244.0.4:52205 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000134847s
[INFO] 10.244.1.2:57709 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000561618s
[INFO] 10.244.1.2:44823 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000149413s
[INFO] 10.244.0.4:53053 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000090637s
[INFO] 10.244.2.2:59333 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000158454s
[INFO] 10.244.2.2:48734 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000320234s
[INFO] 10.244.2.2:57167 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000155417s
==> describe nodes <==
Name: ha-447944
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T03_02_54_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:02:50 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:09:22 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:06:31 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:06:31 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:06:31 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:06:31 +0000 Wed, 14 Feb 2024 03:03:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.41
Hostname: ha-447944
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: a6361e2fe77648efb80ef77ef65e19b9
System UUID: a6361e2f-e776-48ef-b80e-f77ef65e19b9
Boot ID: 028eaefa-0af8-4862-9bdb-3627e617e5df
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-szrmk 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m35s
kube-system coredns-5dd5756b68-chs9l 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 6m19s
kube-system coredns-5dd5756b68-rpnsx 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 6m19s
kube-system etcd-ha-447944 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 6m31s
kube-system kindnet-pjrmh 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 6m19s
kube-system kube-apiserver-ha-447944 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m30s
kube-system kube-controller-manager-ha-447944 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m30s
kube-system kube-proxy-dpm4f 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m19s
kube-system kube-scheduler-ha-447944 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m30s
kube-system kube-vip-ha-447944 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m30s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m18s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 290Mi (13%!)(MISSING) 390Mi (18%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m18s kube-proxy
Normal NodeHasSufficientPID 6m41s (x7 over 6m41s) kubelet Node ha-447944 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m41s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m41s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m41s (x8 over 6m41s) kubelet Node ha-447944 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m41s (x8 over 6m41s) kubelet Node ha-447944 status is now: NodeHasNoDiskPressure
Normal Starting 6m30s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m30s kubelet Node ha-447944 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m30s kubelet Node ha-447944 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m30s kubelet Node ha-447944 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m30s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 6m20s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal NodeReady 6m14s kubelet Node ha-447944 status is now: NodeReady
Normal RegisteredNode 4m54s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal RegisteredNode 3m36s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Name: ha-447944-m02
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_04_17_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:04:00 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m02
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:07:01 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:07:42 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:07:42 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:07:42 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:07:42 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.168.39.218
Hostname: ha-447944-m02
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 535bf6eb4ee34dd6b837047738e23b84
System UUID: 535bf6eb-4ee3-4dd6-b837-047738e23b84
Boot ID: c6ea1ad7-9a18-4b88-8bc1-82e5f8a7909f
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-mjds9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m35s
kube-system etcd-ha-447944-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 5m23s
kube-system kindnet-xkmkd 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 5m23s
kube-system kube-apiserver-ha-447944-m02 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m22s
kube-system kube-controller-manager-ha-447944-m02 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m21s
kube-system kube-proxy-9cjk2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m23s
kube-system kube-scheduler-ha-447944-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m21s
kube-system kube-vip-ha-447944-m02 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m5s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 100m (5%!)(MISSING)
memory 150Mi (7%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 5m4s kube-proxy
Normal RegisteredNode 4m54s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal RegisteredNode 3m36s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal NodeNotReady 101s node-controller Node ha-447944-m02 status is now: NodeNotReady
Name: ha-447944-m03
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m03
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_05_32_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:05:28 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m03
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:09:13 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:05:39 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.133
Hostname: ha-447944-m03
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: c5406b0ff7684df1879332816ce20376
System UUID: c5406b0f-f768-4df1-8793-32816ce20376
Boot ID: 1dc7d320-b8b7-4207-965c-2882293aabcf
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.2.0/24
PodCIDRs: 10.244.2.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-v4857 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m35s
kube-system etcd-ha-447944-m03 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 3m53s
kube-system kindnet-xwqhp 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 3m55s
kube-system kube-apiserver-ha-447944-m03 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m53s
kube-system kube-controller-manager-ha-447944-m03 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m53s
kube-system kube-proxy-rz6vt 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m55s
kube-system kube-scheduler-ha-447944-m03 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m53s
kube-system kube-vip-ha-447944-m03 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m48s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 100m (5%!)(MISSING)
memory 150Mi (7%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 3m51s kube-proxy
Normal RegisteredNode 3m55s node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal RegisteredNode 3m54s node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal RegisteredNode 3m36s node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Name: ha-447944-m04
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m04
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_06_31_0700
minikube.k8s.io/version=v1.32.0
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:06:30 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m04
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:09:15 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:07:01 +0000 Wed, 14 Feb 2024 03:06:30 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:07:01 +0000 Wed, 14 Feb 2024 03:06:30 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:07:01 +0000 Wed, 14 Feb 2024 03:06:30 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:07:01 +0000 Wed, 14 Feb 2024 03:06:40 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.98
Hostname: ha-447944-m04
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: d8594ac4943e4e6ca3585573b6de953f
System UUID: d8594ac4-943e-4e6c-a358-5573b6de953f
Boot ID: c1118fb4-c335-4d7e-8ea0-62ae7e640d77
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.3.0/24
PodCIDRs: 10.244.3.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system kindnet-ldndh 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 2m53s
kube-system kube-proxy-jrhq2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 2m53s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 2m48s kube-proxy
Normal NodeHasSufficientMemory 2m53s (x5 over 2m54s) kubelet Node ha-447944-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 2m53s (x5 over 2m54s) kubelet Node ha-447944-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 2m53s (x5 over 2m54s) kubelet Node ha-447944-m04 status is now: NodeHasSufficientPID
Normal RegisteredNode 2m51s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 2m50s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 2m49s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal NodeReady 2m43s kubelet Node ha-447944-m04 status is now: NodeReady
==> dmesg <==
[Feb14 03:02] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.067171] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.354129] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.296154] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.134944] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.012559] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +9.434119] systemd-fstab-generator[642]: Ignoring "noauto" for root device
[ +0.104064] systemd-fstab-generator[653]: Ignoring "noauto" for root device
[ +0.157556] systemd-fstab-generator[666]: Ignoring "noauto" for root device
[ +0.109767] systemd-fstab-generator[677]: Ignoring "noauto" for root device
[ +0.213788] systemd-fstab-generator[702]: Ignoring "noauto" for root device
[ +5.352315] systemd-fstab-generator[804]: Ignoring "noauto" for root device
[ +3.604175] systemd-fstab-generator[984]: Ignoring "noauto" for root device
[ +10.810722] systemd-fstab-generator[1413]: Ignoring "noauto" for root device
[Feb14 03:03] kauditd_printk_skb: 18 callbacks suppressed
==> etcd [a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721] <==
{"level":"warn","ts":"2024-02-14T03:09:23.647075Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.657365Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.666335Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.670623Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.676937Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.687806Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.696229Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.701248Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.704978Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.709061Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.712392Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.721755Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.729834Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.738539Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.743448Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.746793Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.770654Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.789038Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.801836Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.807014Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.848632Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.850953Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.856694Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.894825Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:09:23.90235Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
==> kernel <==
03:09:23 up 7 min, 0 users, load average: 0.16, 0.44, 0.27
Linux ha-447944 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kindnet [2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f] <==
I0214 03:08:46.224833 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:08:56.240111 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:08:56.240155 1 main.go:227] handling current node
I0214 03:08:56.240178 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:08:56.240184 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:08:56.240311 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:08:56.240342 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:08:56.240394 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:08:56.240402 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:09:06.259835 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:09:06.259885 1 main.go:227] handling current node
I0214 03:09:06.259905 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:09:06.259912 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:09:06.260038 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:09:06.260072 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:09:06.260119 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:09:06.260124 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:09:16.272180 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:09:16.272239 1 main.go:227] handling current node
I0214 03:09:16.272263 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:09:16.272269 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:09:16.272536 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:09:16.272571 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:09:16.272627 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:09:16.272658 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
==> kube-apiserver [7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe] <==
Trace[728426027]: ["List(recursive=true) etcd3" audit-id:6f5aa269-2300-43cb-8d43-bf2794351d86,key:/resourcequotas/kube-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 998ms (03:04:14.742)]
Trace[728426027]: [998.657885ms] [998.657885ms] END
I0214 03:04:15.743594 1 trace.go:236] Trace[1420950922]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b1ca4b01-ab7d-4f68-afe6-30cfa863ee5c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-63gc6a7uuokcsluwb54fia3rja,user-agent:kube-apiserver/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:PUT (14-Feb-2024 03:04:10.493) (total time: 5249ms):
Trace[1420950922]: ["GuaranteedUpdate etcd3" audit-id:b1ca4b01-ab7d-4f68-afe6-30cfa863ee5c,key:/leases/kube-system/apiserver-63gc6a7uuokcsluwb54fia3rja,type:*coordination.Lease,resource:leases.coordination.k8s.io 5249ms (03:04:10.493)
Trace[1420950922]: ---"Txn call completed" 5248ms (03:04:15.743)]
Trace[1420950922]: [5.249964994s] [5.249964994s] END
I0214 03:04:15.747424 1 trace.go:236] Trace[978088035]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e7bcd4e9-f14d-442f-8d4a-4002822baa52,client:192.168.39.218,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/ha-447944-m02/status,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:PATCH (14-Feb-2024 03:04:10.577) (total time: 5170ms):
Trace[978088035]: ["GuaranteedUpdate etcd3" audit-id:e7bcd4e9-f14d-442f-8d4a-4002822baa52,key:/minions/ha-447944-m02,type:*core.Node,resource:nodes 5170ms (03:04:10.577)
Trace[978088035]: ---"Txn call completed" 5168ms (03:04:15.747)]
Trace[978088035]: ---"Object stored in database" 5168ms (03:04:15.747)
Trace[978088035]: [5.170278508s] [5.170278508s] END
I0214 03:04:15.749224 1 trace.go:236] Trace[1314965335]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d9d10802-214d-4dd0-ad4f-51ae8f8c2932,client:192.168.39.41,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/ha-447944-m02,user-agent:kube-controller-manager/v1.28.4 (linux/amd64) kubernetes/bae2c62/system:serviceaccount:kube-system:node-controller,verb:PATCH (14-Feb-2024 03:04:13.630) (total time: 2118ms):
Trace[1314965335]: ["GuaranteedUpdate etcd3" audit-id:d9d10802-214d-4dd0-ad4f-51ae8f8c2932,key:/minions/ha-447944-m02,type:*core.Node,resource:nodes 2118ms (03:04:13.631)
Trace[1314965335]: ---"Txn call completed" 2110ms (03:04:15.747)]
Trace[1314965335]: ---"About to apply patch" 2111ms (03:04:15.747)
Trace[1314965335]: [2.118243434s] [2.118243434s] END
I0214 03:04:15.791888 1 trace.go:236] Trace[296307785]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e9b31557-5e60-4ff2-8991-bb0f1441bbb3,client:192.168.39.218,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:POST (14-Feb-2024 03:04:09.107) (total time: 6684ms):
Trace[296307785]: [6.684341931s] [6.684341931s] END
I0214 03:04:15.792320 1 trace.go:236] Trace[849006311]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:512c83fd-d30d-48ee-865e-1235a70004ca,client:192.168.39.218,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:POST (14-Feb-2024 03:04:09.107) (total time: 6685ms):
Trace[849006311]: [6.685077448s] [6.685077448s] END
I0214 03:04:15.792813 1 trace.go:236] Trace[390025235]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:17327b02-2020-4908-9ce1-58031c3b2d98,client:192.168.39.218,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:POST (14-Feb-2024 03:04:09.108) (total time: 6684ms):
Trace[390025235]: [6.6847903s] [6.6847903s] END
I0214 03:04:15.793138 1 trace.go:236] Trace[222849487]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2821f3f3-b613-494b-a527-08a721f64e94,client:192.168.39.218,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:POST (14-Feb-2024 03:04:08.100) (total time: 7693ms):
Trace[222849487]: [7.693074269s] [7.693074269s] END
E0214 03:05:56.054359 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 192.168.39.41:38710->192.168.39.41:10250: write: broken pipe
==> kube-controller-manager [31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72] <==
I0214 03:05:49.275537 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="64.526µs"
I0214 03:05:49.275635 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="63.776µs"
I0214 03:05:49.394310 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="39.606802ms"
I0214 03:05:49.394492 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="94.908µs"
I0214 03:05:53.146296 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="15.608875ms"
I0214 03:05:53.146437 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="59.169µs"
I0214 03:05:53.522357 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="29.831829ms"
I0214 03:05:53.522598 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="73.392µs"
I0214 03:05:55.220048 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="49.617416ms"
I0214 03:05:55.220204 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="76.516µs"
E0214 03:06:29.402064 1 certificate_controller.go:146] Sync csr-jvwkv failed with : error updating approval for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-jvwkv": the object has been modified; please apply your changes to the latest version and try again
I0214 03:06:30.915182 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-447944-m04\" does not exist"
I0214 03:06:30.936136 1 range_allocator.go:380] "Set node PodCIDR" node="ha-447944-m04" podCIDRs=["10.244.3.0/24"]
I0214 03:06:30.976269 1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-ldndh"
I0214 03:06:30.976385 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-jrhq2"
I0214 03:06:31.110212 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: kube-proxy-w9hpm"
I0214 03:06:31.110271 1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: kindnet-l52ch"
I0214 03:06:31.255979 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: kube-proxy-dc9jr"
I0214 03:06:31.320869 1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: kindnet-4cfh5"
I0214 03:06:33.630609 1 event.go:307] "Event occurred" object="ha-447944-m04" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller"
I0214 03:06:33.650159 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="ha-447944-m04"
I0214 03:06:40.026196 1 topologycache.go:237] "Can't get CPU or zone information for node" node="ha-447944-m04"
I0214 03:07:42.552683 1 topologycache.go:237] "Can't get CPU or zone information for node" node="ha-447944-m04"
I0214 03:07:42.670288 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="18.391265ms"
I0214 03:07:42.670451 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="60.771µs"
==> kube-proxy [9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62] <==
I0214 03:03:05.588684 1 server_others.go:69] "Using iptables proxy"
I0214 03:03:05.606023 1 node.go:141] Successfully retrieved node IP: 192.168.39.41
I0214 03:03:05.654459 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 03:03:05.654501 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 03:03:05.657217 1 server_others.go:152] "Using iptables Proxier"
I0214 03:03:05.657536 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 03:03:05.657962 1 server.go:846] "Version info" version="v1.28.4"
I0214 03:03:05.657999 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:03:05.659980 1 config.go:188] "Starting service config controller"
I0214 03:03:05.660645 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 03:03:05.660884 1 config.go:97] "Starting endpoint slice config controller"
I0214 03:03:05.660893 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 03:03:05.663335 1 config.go:315] "Starting node config controller"
I0214 03:03:05.663384 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 03:03:05.760872 1 shared_informer.go:318] Caches are synced for service config
I0214 03:03:05.761831 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 03:03:05.763783 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2] <==
W0214 03:02:49.711804 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 03:02:49.711885 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 03:02:49.728517 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:02:49.728585 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 03:02:49.739934 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 03:02:49.740024 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0214 03:02:49.757835 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:02:49.757958 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 03:02:49.808506 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 03:02:49.808642 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 03:02:49.833386 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:02:49.833515 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:02:50.030922 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 03:02:50.030975 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0214 03:02:50.041490 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:02:50.041552 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
I0214 03:02:52.040022 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0214 03:06:31.002236 1 framework.go:1206] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-ldndh\": pod kindnet-ldndh is already assigned to node \"ha-447944-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-ldndh" node="ha-447944-m04"
E0214 03:06:31.002516 1 schedule_one.go:989] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-ldndh\": pod kindnet-ldndh is already assigned to node \"ha-447944-m04\"" pod="kube-system/kindnet-ldndh"
E0214 03:06:31.019870 1 framework.go:1206] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-jrhq2\": pod kube-proxy-jrhq2 is already assigned to node \"ha-447944-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-jrhq2" node="ha-447944-m04"
E0214 03:06:31.019981 1 schedule_one.go:319] "scheduler cache ForgetPod failed" err="pod a8dc7b7f-ff43-4e8f-8867-7bbd9b8aca8d(kube-system/kube-proxy-jrhq2) wasn't assumed so cannot be forgotten"
E0214 03:06:31.020025 1 schedule_one.go:989] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-jrhq2\": pod kube-proxy-jrhq2 is already assigned to node \"ha-447944-m04\"" pod="kube-system/kube-proxy-jrhq2"
I0214 03:06:31.020051 1 schedule_one.go:1002] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-jrhq2" node="ha-447944-m04"
E0214 03:06:31.213062 1 framework.go:1206] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-4cfh5\": pod kindnet-4cfh5 is already assigned to node \"ha-447944-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-4cfh5" node="ha-447944-m04"
E0214 03:06:31.213171 1 schedule_one.go:989] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-4cfh5\": pod kindnet-4cfh5 is already assigned to node \"ha-447944-m04\"" pod="kube-system/kindnet-4cfh5"
==> kubelet <==
-- Journal begins at Wed 2024-02-14 03:02:18 UTC, ends at Wed 2024-02-14 03:09:24 UTC. --
Feb 14 03:04:18 ha-447944 kubelet[1420]: E0214 03:04:18.109229 1420 event.go:280] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-ha-447944.17b39bab8eab7b7e", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-ha-447944", UID:"ffa86fcdea5fcdc73edd7aba90728e29", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readiness probe failed: HTTP probe failed with statuscode: 500", Source:v1.EventSource{Component:"kubelet
", Host:"ha-447944"}, FirstTimestamp:time.Date(2024, time.February, 14, 3, 4, 4, 838865790, time.Local), LastTimestamp:time.Date(2024, time.February, 14, 3, 4, 4, 838865790, time.Local), Count:1, Type:"Warning", EventTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"kubelet", ReportingInstance:"ha-447944"}': 'rpc error: code = Unknown desc = context deadline exceeded' (will not retry!)
Feb 14 03:04:53 ha-447944 kubelet[1420]: E0214 03:04:53.427192 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:04:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:04:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:04:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:05:48 ha-447944 kubelet[1420]: I0214 03:05:48.795986 1420 topology_manager.go:215] "Topology Admit Handler" podUID="56ad0ee8-8c4a-4894-b742-a0b3f225feac" podNamespace="default" podName="busybox-5b5d89c9d6-szrmk"
Feb 14 03:05:48 ha-447944 kubelet[1420]: I0214 03:05:48.896919 1420 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t8j9\" (UniqueName: \"kubernetes.io/projected/56ad0ee8-8c4a-4894-b742-a0b3f225feac-kube-api-access-4t8j9\") pod \"busybox-5b5d89c9d6-szrmk\" (UID: \"56ad0ee8-8c4a-4894-b742-a0b3f225feac\") " pod="default/busybox-5b5d89c9d6-szrmk"
Feb 14 03:05:53 ha-447944 kubelet[1420]: E0214 03:05:53.433809 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:05:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:05:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:05:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:05:55 ha-447944 kubelet[1420]: I0214 03:05:55.172088 1420 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="default/busybox-5b5d89c9d6-szrmk" podStartSLOduration=2.397878518 podCreationTimestamp="2024-02-14 03:05:48 +0000 UTC" firstStartedPulling="2024-02-14 03:05:50.181843371 +0000 UTC m=+177.055993906" lastFinishedPulling="2024-02-14 03:05:54.955923543 +0000 UTC m=+181.830074080" observedRunningTime="2024-02-14 03:05:55.171520141 +0000 UTC m=+182.045670686" watchObservedRunningTime="2024-02-14 03:05:55.171958692 +0000 UTC m=+182.046109241"
Feb 14 03:06:53 ha-447944 kubelet[1420]: E0214 03:06:53.428684 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:06:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:06:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:06:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:07:53 ha-447944 kubelet[1420]: E0214 03:07:53.427017 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:07:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:07:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:07:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:07:53 ha-447944 kubelet[1420]: E0214 03:07:53.440089 1420 container_manager_linux.go:514] "Failed to find cgroups of kubelet" err="cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service"
Feb 14 03:08:53 ha-447944 kubelet[1420]: E0214 03:08:53.441032 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:08:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:08:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:08:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-447944 -n ha-447944
helpers_test.go:261: (dbg) Run: kubectl --context ha-447944 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestHA/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestHA/serial/StopSecondaryNode (142.35s)
=== RUN TestHA/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 node start m02 -v=7 --alsologtostderr
ha_test.go:428: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 3 (3.188001397s)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:09:28.582840 1508198 out.go:291] Setting OutFile to fd 1 ...
I0214 03:09:28.582994 1508198 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:28.583007 1508198 out.go:304] Setting ErrFile to fd 2...
I0214 03:09:28.583015 1508198 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:28.583211 1508198 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:09:28.583377 1508198 out.go:298] Setting JSON to false
I0214 03:09:28.583422 1508198 mustload.go:65] Loading cluster: ha-447944
I0214 03:09:28.583541 1508198 notify.go:220] Checking for updates...
I0214 03:09:28.583873 1508198 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:09:28.583890 1508198 status.go:255] checking status of ha-447944 ...
I0214 03:09:28.584263 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:28.584342 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:28.603106 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39655
I0214 03:09:28.603555 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:28.604189 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:28.604211 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:28.604601 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:28.604816 1508198 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:09:28.606845 1508198 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:09:28.606873 1508198 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:28.607308 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:28.607363 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:28.625147 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40021
I0214 03:09:28.625607 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:28.626031 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:28.626055 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:28.626396 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:28.626652 1508198 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:09:28.629748 1508198 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:28.630267 1508198 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:28.630299 1508198 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:28.630418 1508198 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:28.630709 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:28.630760 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:28.646492 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43327
I0214 03:09:28.646896 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:28.647373 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:28.647396 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:28.647716 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:28.647936 1508198 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:09:28.648169 1508198 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:28.648195 1508198 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:09:28.651101 1508198 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:28.651606 1508198 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:28.651643 1508198 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:28.651729 1508198 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:09:28.651976 1508198 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:09:28.652165 1508198 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:09:28.652357 1508198 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:09:28.746540 1508198 ssh_runner.go:195] Run: systemctl --version
I0214 03:09:28.753575 1508198 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:28.768036 1508198 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:28.768080 1508198 api_server.go:166] Checking apiserver status ...
I0214 03:09:28.768115 1508198 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:28.780738 1508198 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:09:28.791740 1508198 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:09:28.791836 1508198 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:09:28.803121 1508198 api_server.go:204] freezer state: "THAWED"
I0214 03:09:28.803163 1508198 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:28.813386 1508198 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:28.813427 1508198 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:09:28.813440 1508198 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:28.813463 1508198 status.go:255] checking status of ha-447944-m02 ...
I0214 03:09:28.813808 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:28.813848 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:28.829753 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43817
I0214 03:09:28.830268 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:28.830872 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:28.830902 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:28.831283 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:28.831508 1508198 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:09:28.833402 1508198 status.go:330] ha-447944-m02 host status = "Running" (err=<nil>)
I0214 03:09:28.833427 1508198 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:28.833736 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:28.833789 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:28.848850 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38879
I0214 03:09:28.849348 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:28.849861 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:28.849889 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:28.850248 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:28.850439 1508198 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:09:28.853882 1508198 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:28.854399 1508198 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:28.854436 1508198 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:28.854601 1508198 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:28.854987 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:28.855027 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:28.870425 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45879
I0214 03:09:28.870845 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:28.871380 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:28.871420 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:28.871775 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:28.871993 1508198 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:09:28.872215 1508198 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:28.872237 1508198 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:09:28.875437 1508198 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:28.875945 1508198 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:28.875978 1508198 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:28.876164 1508198 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:09:28.876336 1508198 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:09:28.876474 1508198 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:09:28.876664 1508198 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
W0214 03:09:31.325656 1508198 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:31.325819 1508198 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
E0214 03:09:31.325841 1508198 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:31.325850 1508198 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
E0214 03:09:31.325875 1508198 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:31.325890 1508198 status.go:255] checking status of ha-447944-m03 ...
I0214 03:09:31.326244 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:31.326307 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:31.341334 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46653
I0214 03:09:31.341860 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:31.342342 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:31.342374 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:31.342713 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:31.342902 1508198 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:09:31.344665 1508198 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:09:31.344684 1508198 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:31.345040 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:31.345089 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:31.360539 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38427
I0214 03:09:31.361034 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:31.361596 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:31.361628 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:31.361966 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:31.362211 1508198 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:09:31.365022 1508198 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:31.365449 1508198 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:31.365494 1508198 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:31.365581 1508198 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:31.366014 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:31.366065 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:31.381419 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36337
I0214 03:09:31.381855 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:31.382333 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:31.382360 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:31.382663 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:31.382856 1508198 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:09:31.383079 1508198 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:31.383104 1508198 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:09:31.385833 1508198 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:31.386211 1508198 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:31.386251 1508198 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:31.386358 1508198 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:09:31.386536 1508198 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:09:31.386677 1508198 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:09:31.386784 1508198 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:09:31.488505 1508198 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:31.504183 1508198 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:31.504232 1508198 api_server.go:166] Checking apiserver status ...
I0214 03:09:31.504279 1508198 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:31.516988 1508198 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:09:31.527606 1508198 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:09:31.527735 1508198 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:09:31.538259 1508198 api_server.go:204] freezer state: "THAWED"
I0214 03:09:31.538284 1508198 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:31.545712 1508198 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:31.545740 1508198 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:09:31.545748 1508198 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:31.545764 1508198 status.go:255] checking status of ha-447944-m04 ...
I0214 03:09:31.546108 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:31.546152 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:31.562144 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43549
I0214 03:09:31.562598 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:31.563075 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:31.563101 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:31.563502 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:31.563696 1508198 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:09:31.565361 1508198 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:09:31.565385 1508198 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:31.565757 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:31.565819 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:31.581045 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33355
I0214 03:09:31.581551 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:31.582105 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:31.582131 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:31.582449 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:31.582661 1508198 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:09:31.585563 1508198 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:31.586035 1508198 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:31.586072 1508198 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:31.586378 1508198 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:31.586731 1508198 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:31.586771 1508198 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:31.602862 1508198 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42057
I0214 03:09:31.603312 1508198 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:31.603795 1508198 main.go:141] libmachine: Using API Version 1
I0214 03:09:31.603826 1508198 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:31.604157 1508198 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:31.604377 1508198 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:09:31.604578 1508198 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:31.604598 1508198 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:09:31.607222 1508198 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:31.607698 1508198 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:31.607729 1508198 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:31.607932 1508198 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:09:31.608146 1508198 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:09:31.608303 1508198 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:09:31.608435 1508198 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:09:31.694097 1508198 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:31.710300 1508198 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:428: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 3 (5.388715122s)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:09:32.536868 1508293 out.go:291] Setting OutFile to fd 1 ...
I0214 03:09:32.536981 1508293 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:32.536993 1508293 out.go:304] Setting ErrFile to fd 2...
I0214 03:09:32.536998 1508293 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:32.537185 1508293 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:09:32.537441 1508293 out.go:298] Setting JSON to false
I0214 03:09:32.537485 1508293 mustload.go:65] Loading cluster: ha-447944
I0214 03:09:32.537531 1508293 notify.go:220] Checking for updates...
I0214 03:09:32.537892 1508293 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:09:32.537906 1508293 status.go:255] checking status of ha-447944 ...
I0214 03:09:32.538302 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:32.538377 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:32.559595 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44539
I0214 03:09:32.560132 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:32.560818 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:32.560847 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:32.561233 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:32.561470 1508293 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:09:32.563661 1508293 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:09:32.563686 1508293 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:32.564031 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:32.564078 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:32.580062 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33195
I0214 03:09:32.580585 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:32.581095 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:32.581128 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:32.581576 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:32.581765 1508293 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:09:32.584898 1508293 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:32.585378 1508293 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:32.585415 1508293 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:32.585523 1508293 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:32.585822 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:32.585859 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:32.600469 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33761
I0214 03:09:32.600944 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:32.601484 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:32.601508 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:32.601865 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:32.602053 1508293 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:09:32.602251 1508293 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:32.602280 1508293 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:09:32.604969 1508293 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:32.605466 1508293 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:32.605504 1508293 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:32.605596 1508293 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:09:32.605776 1508293 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:09:32.605945 1508293 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:09:32.606085 1508293 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:09:32.697201 1508293 ssh_runner.go:195] Run: systemctl --version
I0214 03:09:32.703590 1508293 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:32.717923 1508293 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:32.717958 1508293 api_server.go:166] Checking apiserver status ...
I0214 03:09:32.718004 1508293 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:32.729783 1508293 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:09:32.738956 1508293 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:09:32.739041 1508293 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:09:32.747842 1508293 api_server.go:204] freezer state: "THAWED"
I0214 03:09:32.747884 1508293 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:32.755294 1508293 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:32.755327 1508293 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:09:32.755340 1508293 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:32.755371 1508293 status.go:255] checking status of ha-447944-m02 ...
I0214 03:09:32.755743 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:32.755786 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:32.770886 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42845
I0214 03:09:32.771404 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:32.771965 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:32.771988 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:32.772361 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:32.772557 1508293 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:09:32.774332 1508293 status.go:330] ha-447944-m02 host status = "Running" (err=<nil>)
I0214 03:09:32.774359 1508293 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:32.774650 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:32.774686 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:32.789525 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32889
I0214 03:09:32.790137 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:32.790635 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:32.790662 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:32.791096 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:32.791303 1508293 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:09:32.794331 1508293 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:32.794813 1508293 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:32.794850 1508293 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:32.794959 1508293 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:32.795303 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:32.795356 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:32.811183 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41481
I0214 03:09:32.811663 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:32.812267 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:32.812292 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:32.812603 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:32.812801 1508293 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:09:32.813000 1508293 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:32.813019 1508293 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:09:32.816325 1508293 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:32.816796 1508293 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:32.816828 1508293 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:32.816991 1508293 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:09:32.817208 1508293 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:09:32.817422 1508293 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:09:32.817620 1508293 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
W0214 03:09:34.397664 1508293 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:34.397730 1508293 retry.go:31] will retry after 160.52613ms: dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:37.469625 1508293 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:37.469739 1508293 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
E0214 03:09:37.469757 1508293 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:37.469774 1508293 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
E0214 03:09:37.469793 1508293 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:37.469801 1508293 status.go:255] checking status of ha-447944-m03 ...
I0214 03:09:37.470232 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:37.470296 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:37.486695 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33247
I0214 03:09:37.487237 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:37.487828 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:37.487859 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:37.488255 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:37.488486 1508293 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:09:37.490374 1508293 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:09:37.490393 1508293 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:37.490770 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:37.490824 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:37.506001 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32807
I0214 03:09:37.506613 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:37.507178 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:37.507210 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:37.507678 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:37.507929 1508293 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:09:37.511158 1508293 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:37.511668 1508293 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:37.511699 1508293 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:37.511822 1508293 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:37.512227 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:37.512298 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:37.527857 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45273
I0214 03:09:37.528385 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:37.528955 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:37.528991 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:37.529482 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:37.529707 1508293 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:09:37.529908 1508293 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:37.529928 1508293 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:09:37.532856 1508293 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:37.533372 1508293 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:37.533404 1508293 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:37.533584 1508293 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:09:37.533752 1508293 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:09:37.533907 1508293 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:09:37.534025 1508293 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:09:37.634113 1508293 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:37.651814 1508293 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:37.651854 1508293 api_server.go:166] Checking apiserver status ...
I0214 03:09:37.651899 1508293 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:37.665167 1508293 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:09:37.675461 1508293 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:09:37.675555 1508293 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:09:37.686717 1508293 api_server.go:204] freezer state: "THAWED"
I0214 03:09:37.686754 1508293 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:37.692882 1508293 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:37.692919 1508293 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:09:37.692928 1508293 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:37.692945 1508293 status.go:255] checking status of ha-447944-m04 ...
I0214 03:09:37.693376 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:37.693432 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:37.710772 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41631
I0214 03:09:37.711389 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:37.712022 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:37.712050 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:37.712474 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:37.712719 1508293 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:09:37.714766 1508293 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:09:37.714799 1508293 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:37.715125 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:37.715183 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:37.731235 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35419
I0214 03:09:37.731774 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:37.732296 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:37.732351 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:37.732705 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:37.732956 1508293 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:09:37.736222 1508293 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:37.736701 1508293 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:37.736731 1508293 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:37.736975 1508293 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:37.737439 1508293 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:37.737495 1508293 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:37.753885 1508293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40863
I0214 03:09:37.754338 1508293 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:37.755004 1508293 main.go:141] libmachine: Using API Version 1
I0214 03:09:37.755058 1508293 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:37.755463 1508293 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:37.755710 1508293 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:09:37.755985 1508293 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:37.756020 1508293 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:09:37.759450 1508293 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:37.760035 1508293 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:37.760070 1508293 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:37.760283 1508293 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:09:37.760557 1508293 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:09:37.760751 1508293 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:09:37.760913 1508293 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:09:37.845584 1508293 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:37.863260 1508293 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:428: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 3 (4.19218402s)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:09:40.106993 1508388 out.go:291] Setting OutFile to fd 1 ...
I0214 03:09:40.107182 1508388 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:40.107194 1508388 out.go:304] Setting ErrFile to fd 2...
I0214 03:09:40.107203 1508388 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:40.107388 1508388 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:09:40.107585 1508388 out.go:298] Setting JSON to false
I0214 03:09:40.107629 1508388 mustload.go:65] Loading cluster: ha-447944
I0214 03:09:40.107734 1508388 notify.go:220] Checking for updates...
I0214 03:09:40.108090 1508388 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:09:40.108109 1508388 status.go:255] checking status of ha-447944 ...
I0214 03:09:40.108543 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:40.108596 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:40.136199 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40689
I0214 03:09:40.136744 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:40.137360 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:40.137384 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:40.137755 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:40.137983 1508388 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:09:40.139840 1508388 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:09:40.139867 1508388 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:40.140270 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:40.140352 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:40.155592 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42873
I0214 03:09:40.156112 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:40.156655 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:40.156686 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:40.157031 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:40.157271 1508388 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:09:40.160701 1508388 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:40.161183 1508388 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:40.161222 1508388 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:40.161433 1508388 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:40.161748 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:40.161809 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:40.177170 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44125
I0214 03:09:40.177771 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:40.178331 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:40.178358 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:40.178742 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:40.178927 1508388 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:09:40.179174 1508388 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:40.179214 1508388 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:09:40.182236 1508388 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:40.182689 1508388 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:40.182715 1508388 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:40.182905 1508388 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:09:40.183074 1508388 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:09:40.183226 1508388 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:09:40.183377 1508388 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:09:40.275336 1508388 ssh_runner.go:195] Run: systemctl --version
I0214 03:09:40.282710 1508388 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:40.299112 1508388 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:40.299144 1508388 api_server.go:166] Checking apiserver status ...
I0214 03:09:40.299181 1508388 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:40.317569 1508388 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:09:40.332369 1508388 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:09:40.332477 1508388 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:09:40.342794 1508388 api_server.go:204] freezer state: "THAWED"
I0214 03:09:40.342825 1508388 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:40.348503 1508388 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:40.348530 1508388 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:09:40.348540 1508388 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:40.348558 1508388 status.go:255] checking status of ha-447944-m02 ...
I0214 03:09:40.348858 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:40.348894 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:40.364105 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36397
I0214 03:09:40.364599 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:40.365102 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:40.365123 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:40.365481 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:40.365682 1508388 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:09:40.367686 1508388 status.go:330] ha-447944-m02 host status = "Running" (err=<nil>)
I0214 03:09:40.367705 1508388 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:40.368011 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:40.368078 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:40.383113 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45237
I0214 03:09:40.383568 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:40.384126 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:40.384149 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:40.384472 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:40.384677 1508388 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:09:40.387172 1508388 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:40.387665 1508388 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:40.387706 1508388 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:40.387868 1508388 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:40.388196 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:40.388237 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:40.404763 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45771
I0214 03:09:40.405229 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:40.405828 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:40.405853 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:40.406181 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:40.406418 1508388 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:09:40.406708 1508388 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:40.406731 1508388 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:09:40.409716 1508388 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:40.410266 1508388 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:40.410303 1508388 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:40.410454 1508388 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:09:40.410653 1508388 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:09:40.410816 1508388 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:09:40.410949 1508388 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
W0214 03:09:40.545579 1508388 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:40.545658 1508388 retry.go:31] will retry after 223.968604ms: dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:43.837572 1508388 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:43.837665 1508388 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
E0214 03:09:43.837684 1508388 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:43.837714 1508388 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
E0214 03:09:43.837742 1508388 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:43.837750 1508388 status.go:255] checking status of ha-447944-m03 ...
I0214 03:09:43.838109 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:43.838216 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:43.855038 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43345
I0214 03:09:43.855531 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:43.856128 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:43.856161 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:43.856623 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:43.856833 1508388 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:09:43.858380 1508388 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:09:43.858398 1508388 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:43.858736 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:43.858791 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:43.874687 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34373
I0214 03:09:43.875107 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:43.875583 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:43.875606 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:43.875956 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:43.876142 1508388 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:09:43.879075 1508388 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:43.879545 1508388 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:43.879574 1508388 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:43.879717 1508388 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:43.880027 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:43.880065 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:43.895405 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37495
I0214 03:09:43.895867 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:43.896434 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:43.896464 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:43.896782 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:43.897000 1508388 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:09:43.897230 1508388 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:43.897274 1508388 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:09:43.899962 1508388 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:43.900374 1508388 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:43.900429 1508388 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:43.900532 1508388 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:09:43.900706 1508388 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:09:43.900836 1508388 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:09:43.900955 1508388 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:09:44.003278 1508388 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:44.022940 1508388 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:44.022977 1508388 api_server.go:166] Checking apiserver status ...
I0214 03:09:44.023021 1508388 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:44.037452 1508388 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:09:44.048186 1508388 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:09:44.048274 1508388 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:09:44.058672 1508388 api_server.go:204] freezer state: "THAWED"
I0214 03:09:44.058704 1508388 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:44.064044 1508388 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:44.064071 1508388 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:09:44.064080 1508388 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:44.064096 1508388 status.go:255] checking status of ha-447944-m04 ...
I0214 03:09:44.064412 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:44.064468 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:44.080863 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38919
I0214 03:09:44.081302 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:44.081794 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:44.081821 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:44.082149 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:44.082316 1508388 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:09:44.083885 1508388 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:09:44.083901 1508388 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:44.084247 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:44.084292 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:44.100771 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43215
I0214 03:09:44.101184 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:44.101686 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:44.101704 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:44.102021 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:44.102226 1508388 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:09:44.105439 1508388 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:44.105960 1508388 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:44.105991 1508388 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:44.106199 1508388 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:44.106644 1508388 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:44.106695 1508388 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:44.122835 1508388 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41573
I0214 03:09:44.123330 1508388 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:44.123878 1508388 main.go:141] libmachine: Using API Version 1
I0214 03:09:44.123904 1508388 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:44.124219 1508388 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:44.124480 1508388 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:09:44.124677 1508388 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:44.124698 1508388 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:09:44.127488 1508388 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:44.127851 1508388 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:44.127880 1508388 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:44.127987 1508388 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:09:44.128196 1508388 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:09:44.128361 1508388 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:09:44.128513 1508388 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:09:44.218017 1508388 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:44.233514 1508388 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:428: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 3 (4.8180854s)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:09:45.835954 1508482 out.go:291] Setting OutFile to fd 1 ...
I0214 03:09:45.836109 1508482 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:45.836120 1508482 out.go:304] Setting ErrFile to fd 2...
I0214 03:09:45.836132 1508482 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:45.836360 1508482 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:09:45.836585 1508482 out.go:298] Setting JSON to false
I0214 03:09:45.836623 1508482 mustload.go:65] Loading cluster: ha-447944
I0214 03:09:45.836743 1508482 notify.go:220] Checking for updates...
I0214 03:09:45.837061 1508482 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:09:45.837084 1508482 status.go:255] checking status of ha-447944 ...
I0214 03:09:45.837651 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:45.837746 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:45.864270 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34417
I0214 03:09:45.864835 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:45.865404 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:45.865428 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:45.865828 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:45.866019 1508482 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:09:45.867830 1508482 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:09:45.867859 1508482 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:45.868234 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:45.868273 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:45.883994 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46357
I0214 03:09:45.884555 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:45.885037 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:45.885060 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:45.885459 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:45.885672 1508482 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:09:45.889478 1508482 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:45.889993 1508482 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:45.890036 1508482 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:45.890192 1508482 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:45.890629 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:45.890674 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:45.906234 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33269
I0214 03:09:45.906752 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:45.907248 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:45.907273 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:45.907663 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:45.907907 1508482 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:09:45.908148 1508482 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:45.908186 1508482 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:09:45.911154 1508482 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:45.911638 1508482 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:45.911670 1508482 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:45.911827 1508482 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:09:45.912009 1508482 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:09:45.912250 1508482 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:09:45.912460 1508482 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:09:46.005279 1508482 ssh_runner.go:195] Run: systemctl --version
I0214 03:09:46.017662 1508482 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:46.036292 1508482 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:46.036331 1508482 api_server.go:166] Checking apiserver status ...
I0214 03:09:46.036386 1508482 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:46.050312 1508482 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:09:46.060017 1508482 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:09:46.060117 1508482 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:09:46.070657 1508482 api_server.go:204] freezer state: "THAWED"
I0214 03:09:46.070697 1508482 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:46.077467 1508482 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:46.077496 1508482 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:09:46.077507 1508482 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:46.077526 1508482 status.go:255] checking status of ha-447944-m02 ...
I0214 03:09:46.077983 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:46.078048 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:46.093376 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40241
I0214 03:09:46.093867 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:46.094341 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:46.094390 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:46.094815 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:46.095027 1508482 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:09:46.096699 1508482 status.go:330] ha-447944-m02 host status = "Running" (err=<nil>)
I0214 03:09:46.096723 1508482 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:46.097137 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:46.097191 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:46.114420 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37893
I0214 03:09:46.114872 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:46.115454 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:46.115478 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:46.115901 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:46.116122 1508482 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:09:46.119431 1508482 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:46.119864 1508482 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:46.119896 1508482 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:46.120066 1508482 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:46.120385 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:46.120446 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:46.136369 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46251
I0214 03:09:46.136842 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:46.137452 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:46.137481 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:46.137829 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:46.138004 1508482 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:09:46.138204 1508482 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:46.138227 1508482 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:09:46.141905 1508482 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:46.142393 1508482 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:46.142429 1508482 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:46.142585 1508482 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:09:46.142758 1508482 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:09:46.142960 1508482 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:09:46.143113 1508482 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
W0214 03:09:46.909604 1508482 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:46.909679 1508482 retry.go:31] will retry after 227.350092ms: dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:50.205559 1508482 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:50.205773 1508482 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
E0214 03:09:50.205824 1508482 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:50.205854 1508482 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
E0214 03:09:50.205897 1508482 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:50.205909 1508482 status.go:255] checking status of ha-447944-m03 ...
I0214 03:09:50.206271 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:50.206325 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:50.221448 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34269
I0214 03:09:50.222011 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:50.222562 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:50.222588 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:50.222924 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:50.223114 1508482 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:09:50.224879 1508482 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:09:50.224900 1508482 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:50.225390 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:50.225444 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:50.240246 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41819
I0214 03:09:50.240667 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:50.241176 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:50.241205 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:50.241571 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:50.241750 1508482 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:09:50.244735 1508482 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:50.245274 1508482 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:50.245312 1508482 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:50.245423 1508482 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:50.245837 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:50.245886 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:50.261169 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35925
I0214 03:09:50.261648 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:50.262110 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:50.262132 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:50.262570 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:50.262801 1508482 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:09:50.263048 1508482 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:50.263080 1508482 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:09:50.265937 1508482 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:50.266376 1508482 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:50.266401 1508482 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:50.266591 1508482 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:09:50.266793 1508482 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:09:50.266928 1508482 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:09:50.267103 1508482 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:09:50.365682 1508482 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:50.382340 1508482 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:50.382376 1508482 api_server.go:166] Checking apiserver status ...
I0214 03:09:50.382436 1508482 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:50.396024 1508482 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:09:50.410409 1508482 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:09:50.410496 1508482 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:09:50.423115 1508482 api_server.go:204] freezer state: "THAWED"
I0214 03:09:50.423152 1508482 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:50.430369 1508482 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:50.430396 1508482 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:09:50.430404 1508482 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:50.430420 1508482 status.go:255] checking status of ha-447944-m04 ...
I0214 03:09:50.430819 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:50.430869 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:50.446156 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40961
I0214 03:09:50.446670 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:50.447173 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:50.447198 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:50.447561 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:50.447734 1508482 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:09:50.449351 1508482 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:09:50.449370 1508482 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:50.449668 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:50.449705 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:50.464419 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43685
I0214 03:09:50.464829 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:50.465354 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:50.465381 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:50.465722 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:50.465937 1508482 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:09:50.468781 1508482 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:50.469165 1508482 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:50.469201 1508482 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:50.469364 1508482 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:50.469719 1508482 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:50.469771 1508482 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:50.485486 1508482 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38921
I0214 03:09:50.485990 1508482 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:50.486507 1508482 main.go:141] libmachine: Using API Version 1
I0214 03:09:50.486531 1508482 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:50.486900 1508482 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:50.487120 1508482 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:09:50.487305 1508482 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:50.487330 1508482 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:09:50.490369 1508482 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:50.491058 1508482 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:50.491091 1508482 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:50.491239 1508482 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:09:50.491460 1508482 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:09:50.491652 1508482 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:09:50.491800 1508482 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:09:50.576531 1508482 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:50.590448 1508482 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:428: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 3 (3.816982398s)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:09:53.009907 1508589 out.go:291] Setting OutFile to fd 1 ...
I0214 03:09:53.010027 1508589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:53.010036 1508589 out.go:304] Setting ErrFile to fd 2...
I0214 03:09:53.010043 1508589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:09:53.010254 1508589 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:09:53.010429 1508589 out.go:298] Setting JSON to false
I0214 03:09:53.010470 1508589 mustload.go:65] Loading cluster: ha-447944
I0214 03:09:53.010583 1508589 notify.go:220] Checking for updates...
I0214 03:09:53.011022 1508589 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:09:53.011047 1508589 status.go:255] checking status of ha-447944 ...
I0214 03:09:53.011588 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:53.011656 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:53.030976 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33047
I0214 03:09:53.031500 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:53.032089 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:53.032111 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:53.032546 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:53.032759 1508589 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:09:53.034584 1508589 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:09:53.034621 1508589 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:53.035018 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:53.035054 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:53.050558 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38975
I0214 03:09:53.051042 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:53.051535 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:53.051568 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:53.051921 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:53.052109 1508589 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:09:53.055033 1508589 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:53.055482 1508589 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:53.055522 1508589 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:53.055699 1508589 host.go:66] Checking if "ha-447944" exists ...
I0214 03:09:53.056123 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:53.056171 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:53.071116 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43399
I0214 03:09:53.071659 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:53.072165 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:53.072192 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:53.072502 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:53.072703 1508589 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:09:53.072916 1508589 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:53.072955 1508589 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:09:53.076047 1508589 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:53.076514 1508589 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:09:53.076556 1508589 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:09:53.076706 1508589 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:09:53.076930 1508589 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:09:53.077123 1508589 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:09:53.077290 1508589 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:09:53.169186 1508589 ssh_runner.go:195] Run: systemctl --version
I0214 03:09:53.176685 1508589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:53.192527 1508589 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:53.192571 1508589 api_server.go:166] Checking apiserver status ...
I0214 03:09:53.192642 1508589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:53.206989 1508589 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:09:53.220274 1508589 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:09:53.220373 1508589 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:09:53.232943 1508589 api_server.go:204] freezer state: "THAWED"
I0214 03:09:53.232980 1508589 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:53.241018 1508589 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:53.241050 1508589 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:09:53.241060 1508589 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:53.241079 1508589 status.go:255] checking status of ha-447944-m02 ...
I0214 03:09:53.241517 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:53.241571 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:53.257662 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43655
I0214 03:09:53.258162 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:53.258695 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:53.258724 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:53.259079 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:53.259266 1508589 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:09:53.260820 1508589 status.go:330] ha-447944-m02 host status = "Running" (err=<nil>)
I0214 03:09:53.260835 1508589 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:53.261202 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:53.261267 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:53.276239 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46025
I0214 03:09:53.276754 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:53.277282 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:53.277343 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:53.277914 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:53.278128 1508589 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:09:53.281245 1508589 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:53.281764 1508589 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:53.281793 1508589 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:53.282010 1508589 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:09:53.282366 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:53.282421 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:53.298837 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44909
I0214 03:09:53.299292 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:53.299863 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:53.299887 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:53.300263 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:53.300527 1508589 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:09:53.300737 1508589 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:53.300765 1508589 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:09:53.303575 1508589 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:53.303963 1508589 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:09:53.303994 1508589 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:09:53.304177 1508589 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:09:53.304341 1508589 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:09:53.304596 1508589 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:09:53.304785 1508589 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
W0214 03:09:56.381612 1508589 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:09:56.381722 1508589 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
E0214 03:09:56.381742 1508589 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:56.381772 1508589 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
E0214 03:09:56.381793 1508589 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:09:56.381803 1508589 status.go:255] checking status of ha-447944-m03 ...
I0214 03:09:56.382218 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:56.382279 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:56.399725 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40899
I0214 03:09:56.400244 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:56.400841 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:56.400865 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:56.401213 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:56.401465 1508589 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:09:56.403065 1508589 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:09:56.403080 1508589 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:56.403536 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:56.403581 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:56.421822 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43875
I0214 03:09:56.422247 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:56.422744 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:56.422772 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:56.423169 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:56.423382 1508589 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:09:56.426303 1508589 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:56.426755 1508589 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:56.426792 1508589 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:56.426940 1508589 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:09:56.427284 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:56.427363 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:56.442360 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34707
I0214 03:09:56.442866 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:56.443342 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:56.443373 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:56.443665 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:56.443887 1508589 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:09:56.444097 1508589 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:56.444123 1508589 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:09:56.446949 1508589 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:56.447429 1508589 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:09:56.447463 1508589 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:09:56.447640 1508589 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:09:56.447827 1508589 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:09:56.447995 1508589 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:09:56.448122 1508589 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:09:56.545716 1508589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:56.560356 1508589 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:09:56.560398 1508589 api_server.go:166] Checking apiserver status ...
I0214 03:09:56.560451 1508589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:09:56.573113 1508589 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:09:56.583315 1508589 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:09:56.583420 1508589 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:09:56.594141 1508589 api_server.go:204] freezer state: "THAWED"
I0214 03:09:56.594177 1508589 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:09:56.602055 1508589 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:09:56.602090 1508589 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:09:56.602101 1508589 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:09:56.602123 1508589 status.go:255] checking status of ha-447944-m04 ...
I0214 03:09:56.602470 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:56.602523 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:56.618850 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37351
I0214 03:09:56.619341 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:56.619873 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:56.619907 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:56.620224 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:56.620431 1508589 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:09:56.622144 1508589 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:09:56.622164 1508589 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:56.622470 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:56.622517 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:56.637867 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33609
I0214 03:09:56.638334 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:56.638816 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:56.638841 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:56.639190 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:56.639388 1508589 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:09:56.642514 1508589 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:56.643009 1508589 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:56.643042 1508589 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:56.643205 1508589 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:09:56.643735 1508589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:09:56.643797 1508589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:09:56.658759 1508589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40505
I0214 03:09:56.659308 1508589 main.go:141] libmachine: () Calling .GetVersion
I0214 03:09:56.659817 1508589 main.go:141] libmachine: Using API Version 1
I0214 03:09:56.659842 1508589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:09:56.660176 1508589 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:09:56.660446 1508589 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:09:56.660675 1508589 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:09:56.660704 1508589 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:09:56.663845 1508589 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:56.664326 1508589 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:09:56.664347 1508589 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:09:56.664566 1508589 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:09:56.664808 1508589 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:09:56.664974 1508589 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:09:56.665163 1508589 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:09:56.750189 1508589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:09:56.763261 1508589 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:428: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 3 (3.816886256s)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Error
kubelet: Nonexistent
apiserver: Nonexistent
kubeconfig: Configured
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:10:04.052323 1508697 out.go:291] Setting OutFile to fd 1 ...
I0214 03:10:04.052487 1508697 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:10:04.052498 1508697 out.go:304] Setting ErrFile to fd 2...
I0214 03:10:04.052503 1508697 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:10:04.052704 1508697 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:10:04.052945 1508697 out.go:298] Setting JSON to false
I0214 03:10:04.052990 1508697 mustload.go:65] Loading cluster: ha-447944
I0214 03:10:04.053119 1508697 notify.go:220] Checking for updates...
I0214 03:10:04.053532 1508697 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:10:04.053551 1508697 status.go:255] checking status of ha-447944 ...
I0214 03:10:04.053979 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:04.054065 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:04.072816 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45193
I0214 03:10:04.073331 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:04.074060 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:04.074091 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:04.074453 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:04.074652 1508697 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:10:04.076332 1508697 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:10:04.076362 1508697 host.go:66] Checking if "ha-447944" exists ...
I0214 03:10:04.076678 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:04.076739 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:04.091498 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43471
I0214 03:10:04.091893 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:04.092475 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:04.092502 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:04.092840 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:04.093076 1508697 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:10:04.096237 1508697 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:04.096751 1508697 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:10:04.096783 1508697 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:04.096960 1508697 host.go:66] Checking if "ha-447944" exists ...
I0214 03:10:04.097413 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:04.097467 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:04.112354 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34165
I0214 03:10:04.112796 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:04.113306 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:04.113333 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:04.113768 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:04.114014 1508697 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:10:04.114291 1508697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:04.114318 1508697 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:10:04.117676 1508697 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:04.118144 1508697 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:10:04.118166 1508697 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:04.118328 1508697 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:10:04.118567 1508697 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:10:04.118747 1508697 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:10:04.118919 1508697 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:10:04.211595 1508697 ssh_runner.go:195] Run: systemctl --version
I0214 03:10:04.220707 1508697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:04.244950 1508697 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:10:04.244987 1508697 api_server.go:166] Checking apiserver status ...
I0214 03:10:04.245035 1508697 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:10:04.259611 1508697 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:10:04.269848 1508697 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:10:04.270200 1508697 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:10:04.281978 1508697 api_server.go:204] freezer state: "THAWED"
I0214 03:10:04.282027 1508697 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:10:04.288571 1508697 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:10:04.288604 1508697 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:10:04.288615 1508697 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:10:04.288638 1508697 status.go:255] checking status of ha-447944-m02 ...
I0214 03:10:04.289049 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:04.289098 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:04.304149 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43521
I0214 03:10:04.304704 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:04.305327 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:04.305355 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:04.305732 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:04.305967 1508697 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:10:04.307750 1508697 status.go:330] ha-447944-m02 host status = "Running" (err=<nil>)
I0214 03:10:04.307767 1508697 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:10:04.308065 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:04.308101 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:04.323975 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46661
I0214 03:10:04.324492 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:04.325130 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:04.325163 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:04.325546 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:04.325752 1508697 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:10:04.329135 1508697 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:10:04.329797 1508697 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:10:04.329829 1508697 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:10:04.330112 1508697 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:10:04.330408 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:04.330462 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:04.345454 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46069
I0214 03:10:04.345997 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:04.346493 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:04.346519 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:04.346859 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:04.347060 1508697 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:10:04.347371 1508697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:04.347407 1508697 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:10:04.350652 1508697 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:10:04.351216 1508697 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:10:04.351247 1508697 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:10:04.351481 1508697 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:10:04.351767 1508697 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:10:04.351958 1508697 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:10:04.352128 1508697 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
W0214 03:10:07.421529 1508697 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.218:22: connect: no route to host
W0214 03:10:07.421669 1508697 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
E0214 03:10:07.421693 1508697 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:10:07.421701 1508697 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
E0214 03:10:07.421724 1508697 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.218:22: connect: no route to host
I0214 03:10:07.421734 1508697 status.go:255] checking status of ha-447944-m03 ...
I0214 03:10:07.422189 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:07.422255 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:07.436937 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35927
I0214 03:10:07.437468 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:07.438000 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:07.438029 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:07.438379 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:07.438601 1508697 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:10:07.440747 1508697 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:10:07.440765 1508697 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:10:07.441167 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:07.441217 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:07.456538 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36449
I0214 03:10:07.457060 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:07.457680 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:07.457707 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:07.458109 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:07.458397 1508697 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:10:07.462087 1508697 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:07.462627 1508697 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:10:07.462665 1508697 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:07.462825 1508697 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:10:07.463155 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:07.463196 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:07.478179 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33437
I0214 03:10:07.478696 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:07.479147 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:07.479170 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:07.479541 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:07.479733 1508697 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:10:07.479930 1508697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:07.479962 1508697 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:10:07.483101 1508697 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:07.483517 1508697 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:10:07.483573 1508697 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:07.483816 1508697 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:10:07.484038 1508697 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:10:07.484198 1508697 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:10:07.484355 1508697 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:10:07.581285 1508697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:07.596544 1508697 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:10:07.596579 1508697 api_server.go:166] Checking apiserver status ...
I0214 03:10:07.596616 1508697 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:10:07.611955 1508697 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:10:07.630544 1508697 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:10:07.630647 1508697 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:10:07.642043 1508697 api_server.go:204] freezer state: "THAWED"
I0214 03:10:07.642073 1508697 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:10:07.647677 1508697 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:10:07.647701 1508697 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:10:07.647717 1508697 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:10:07.647732 1508697 status.go:255] checking status of ha-447944-m04 ...
I0214 03:10:07.648016 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:07.648070 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:07.663465 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46533
I0214 03:10:07.663984 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:07.664532 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:07.664567 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:07.664999 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:07.665214 1508697 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:10:07.667037 1508697 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:10:07.667060 1508697 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:10:07.667368 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:07.667408 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:07.682679 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39559
I0214 03:10:07.683229 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:07.683811 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:07.683832 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:07.684161 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:07.684367 1508697 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:10:07.687424 1508697 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:07.687892 1508697 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:10:07.687922 1508697 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:07.688133 1508697 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:10:07.688421 1508697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:07.688461 1508697 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:07.704027 1508697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45635
I0214 03:10:07.704538 1508697 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:07.705109 1508697 main.go:141] libmachine: Using API Version 1
I0214 03:10:07.705134 1508697 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:07.705558 1508697 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:07.705796 1508697 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:10:07.706015 1508697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:07.706037 1508697 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:10:07.708979 1508697 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:07.709456 1508697 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:10:07.709482 1508697 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:07.709645 1508697 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:10:07.709811 1508697 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:10:07.709978 1508697 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:10:07.710127 1508697 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:10:07.792942 1508697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:07.807054 1508697 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:428: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 7 (712.898342ms)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:10:14.637813 1508824 out.go:291] Setting OutFile to fd 1 ...
I0214 03:10:14.637962 1508824 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:10:14.637970 1508824 out.go:304] Setting ErrFile to fd 2...
I0214 03:10:14.637980 1508824 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:10:14.638193 1508824 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:10:14.638417 1508824 out.go:298] Setting JSON to false
I0214 03:10:14.638452 1508824 mustload.go:65] Loading cluster: ha-447944
I0214 03:10:14.638574 1508824 notify.go:220] Checking for updates...
I0214 03:10:14.638953 1508824 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:10:14.638975 1508824 status.go:255] checking status of ha-447944 ...
I0214 03:10:14.639428 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:14.639543 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:14.669572 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39933
I0214 03:10:14.670153 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:14.670909 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:14.670936 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:14.671362 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:14.671622 1508824 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:10:14.673832 1508824 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:10:14.673866 1508824 host.go:66] Checking if "ha-447944" exists ...
I0214 03:10:14.674320 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:14.674387 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:14.689634 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33577
I0214 03:10:14.690107 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:14.690638 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:14.690669 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:14.691040 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:14.691246 1508824 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:10:14.694657 1508824 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:14.695190 1508824 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:10:14.695230 1508824 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:14.695443 1508824 host.go:66] Checking if "ha-447944" exists ...
I0214 03:10:14.695759 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:14.695809 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:14.710829 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46465
I0214 03:10:14.711432 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:14.711939 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:14.711967 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:14.712277 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:14.712451 1508824 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:10:14.712659 1508824 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:14.712685 1508824 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:10:14.715659 1508824 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:14.716127 1508824 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:10:14.716154 1508824 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:14.716348 1508824 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:10:14.716530 1508824 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:10:14.716649 1508824 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:10:14.716771 1508824 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:10:14.811663 1508824 ssh_runner.go:195] Run: systemctl --version
I0214 03:10:14.819677 1508824 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:14.834784 1508824 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:10:14.834821 1508824 api_server.go:166] Checking apiserver status ...
I0214 03:10:14.834856 1508824 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:10:14.859768 1508824 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:10:14.871907 1508824 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:10:14.871992 1508824 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:10:14.883061 1508824 api_server.go:204] freezer state: "THAWED"
I0214 03:10:14.883103 1508824 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:10:14.889835 1508824 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:10:14.889863 1508824 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:10:14.889873 1508824 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:10:14.889897 1508824 status.go:255] checking status of ha-447944-m02 ...
I0214 03:10:14.890184 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:14.890230 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:14.906013 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46783
I0214 03:10:14.906524 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:14.907019 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:14.907052 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:14.907414 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:14.907639 1508824 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:10:14.909323 1508824 status.go:330] ha-447944-m02 host status = "Stopped" (err=<nil>)
I0214 03:10:14.909337 1508824 status.go:343] host is not running, skipping remaining checks
I0214 03:10:14.909342 1508824 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:10:14.909370 1508824 status.go:255] checking status of ha-447944-m03 ...
I0214 03:10:14.909657 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:14.909694 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:14.925117 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41445
I0214 03:10:14.925617 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:14.926160 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:14.926185 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:14.926564 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:14.926775 1508824 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:10:14.928533 1508824 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:10:14.928555 1508824 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:10:14.928900 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:14.928945 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:14.945249 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36129
I0214 03:10:14.945708 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:14.946187 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:14.946211 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:14.946570 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:14.946805 1508824 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:10:14.949380 1508824 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:14.949804 1508824 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:10:14.949848 1508824 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:14.949924 1508824 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:10:14.950480 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:14.950542 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:14.967164 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33321
I0214 03:10:14.967841 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:14.968336 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:14.968359 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:14.968714 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:14.968906 1508824 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:10:14.969123 1508824 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:14.969152 1508824 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:10:14.971763 1508824 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:14.972172 1508824 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:10:14.972211 1508824 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:14.972317 1508824 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:10:14.972497 1508824 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:10:14.972663 1508824 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:10:14.972826 1508824 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:10:15.070215 1508824 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:15.084798 1508824 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:10:15.084831 1508824 api_server.go:166] Checking apiserver status ...
I0214 03:10:15.084865 1508824 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:10:15.098659 1508824 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:10:15.109587 1508824 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:10:15.109688 1508824 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:10:15.121028 1508824 api_server.go:204] freezer state: "THAWED"
I0214 03:10:15.121066 1508824 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:10:15.126689 1508824 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:10:15.126717 1508824 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:10:15.126725 1508824 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:10:15.126741 1508824 status.go:255] checking status of ha-447944-m04 ...
I0214 03:10:15.127052 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:15.127093 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:15.142807 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33543
I0214 03:10:15.143295 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:15.143799 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:15.143822 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:15.144149 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:15.144359 1508824 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:10:15.146130 1508824 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:10:15.146147 1508824 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:10:15.146579 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:15.146633 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:15.161498 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38213
I0214 03:10:15.161961 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:15.162419 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:15.162446 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:15.162873 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:15.163086 1508824 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:10:15.166077 1508824 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:15.166646 1508824 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:10:15.166679 1508824 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:15.166970 1508824 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:10:15.167416 1508824 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:15.167468 1508824 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:15.182570 1508824 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41145
I0214 03:10:15.183127 1508824 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:15.183602 1508824 main.go:141] libmachine: Using API Version 1
I0214 03:10:15.183627 1508824 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:15.183949 1508824 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:15.184151 1508824 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:10:15.184355 1508824 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:15.184379 1508824 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:10:15.187356 1508824 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:15.187831 1508824 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:10:15.187861 1508824 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:15.188019 1508824 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:10:15.188235 1508824 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:10:15.188397 1508824 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:10:15.188595 1508824 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:10:15.273132 1508824 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:15.286661 1508824 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:428: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 7 (689.304858ms)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
ha-447944-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I0214 03:10:27.257859 1508919 out.go:291] Setting OutFile to fd 1 ...
I0214 03:10:27.258011 1508919 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:10:27.258020 1508919 out.go:304] Setting ErrFile to fd 2...
I0214 03:10:27.258024 1508919 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:10:27.258234 1508919 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:10:27.258437 1508919 out.go:298] Setting JSON to false
I0214 03:10:27.258496 1508919 notify.go:220] Checking for updates...
I0214 03:10:27.258505 1508919 mustload.go:65] Loading cluster: ha-447944
I0214 03:10:27.259048 1508919 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:10:27.259073 1508919 status.go:255] checking status of ha-447944 ...
I0214 03:10:27.259518 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.259634 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.278842 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32775
I0214 03:10:27.279370 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.280035 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.280072 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.280470 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.280694 1508919 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:10:27.282637 1508919 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:10:27.282661 1508919 host.go:66] Checking if "ha-447944" exists ...
I0214 03:10:27.283069 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.283122 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.298133 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33321
I0214 03:10:27.298578 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.299069 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.299092 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.299445 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.299662 1508919 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:10:27.302795 1508919 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:27.303296 1508919 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:10:27.303361 1508919 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:27.303394 1508919 host.go:66] Checking if "ha-447944" exists ...
I0214 03:10:27.303981 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.304047 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.321809 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44457
I0214 03:10:27.322294 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.322753 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.322772 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.323136 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.323366 1508919 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:10:27.323639 1508919 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:27.323666 1508919 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:10:27.326640 1508919 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:27.327055 1508919 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:10:27.327099 1508919 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:10:27.327279 1508919 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:10:27.327517 1508919 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:10:27.327704 1508919 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:10:27.327916 1508919 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:10:27.419217 1508919 ssh_runner.go:195] Run: systemctl --version
I0214 03:10:27.425687 1508919 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:27.446240 1508919 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:10:27.446301 1508919 api_server.go:166] Checking apiserver status ...
I0214 03:10:27.446347 1508919 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:10:27.462420 1508919 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup
I0214 03:10:27.474646 1508919 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:10:27.474756 1508919 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe/freezer.state
I0214 03:10:27.485289 1508919 api_server.go:204] freezer state: "THAWED"
I0214 03:10:27.485323 1508919 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:10:27.490743 1508919 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:10:27.490772 1508919 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:10:27.490781 1508919 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:10:27.490806 1508919 status.go:255] checking status of ha-447944-m02 ...
I0214 03:10:27.491100 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.491125 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.506207 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40765
I0214 03:10:27.506669 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.507198 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.507221 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.507580 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.507913 1508919 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:10:27.509645 1508919 status.go:330] ha-447944-m02 host status = "Stopped" (err=<nil>)
I0214 03:10:27.509660 1508919 status.go:343] host is not running, skipping remaining checks
I0214 03:10:27.509667 1508919 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:10:27.509702 1508919 status.go:255] checking status of ha-447944-m03 ...
I0214 03:10:27.510027 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.510109 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.526062 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45209
I0214 03:10:27.526660 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.527191 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.527224 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.527554 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.527745 1508919 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:10:27.529484 1508919 status.go:330] ha-447944-m03 host status = "Running" (err=<nil>)
I0214 03:10:27.529505 1508919 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:10:27.529804 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.529853 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.544958 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36891
I0214 03:10:27.545480 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.545965 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.545990 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.546333 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.546557 1508919 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:10:27.549289 1508919 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:27.549828 1508919 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:10:27.549864 1508919 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:27.550085 1508919 host.go:66] Checking if "ha-447944-m03" exists ...
I0214 03:10:27.550566 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.550625 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.566653 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42995
I0214 03:10:27.567153 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.567637 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.567672 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.568074 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.568274 1508919 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:10:27.568468 1508919 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:27.568486 1508919 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:10:27.571449 1508919 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:27.571851 1508919 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:10:27.571874 1508919 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:27.572028 1508919 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:10:27.572246 1508919 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:10:27.572453 1508919 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:10:27.572628 1508919 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:10:27.669682 1508919 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:27.682995 1508919 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:10:27.683025 1508919 api_server.go:166] Checking apiserver status ...
I0214 03:10:27.683062 1508919 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:10:27.696281 1508919 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1523/cgroup
I0214 03:10:27.706121 1508919 api_server.go:182] apiserver freezer: "7:freezer:/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb"
I0214 03:10:27.706191 1508919 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod4d76453aa5e32e8031e8e27003a748c0/crio-ea290a0f62c8dd53c5514f26ee2b52cb57fba1cae95f634f501d7444b12e6efb/freezer.state
I0214 03:10:27.716657 1508919 api_server.go:204] freezer state: "THAWED"
I0214 03:10:27.716694 1508919 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:10:27.722173 1508919 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:10:27.722200 1508919 status.go:422] ha-447944-m03 apiserver status = Running (err=<nil>)
I0214 03:10:27.722209 1508919 status.go:257] ha-447944-m03 status: &{Name:ha-447944-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:10:27.722224 1508919 status.go:255] checking status of ha-447944-m04 ...
I0214 03:10:27.722521 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.722548 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.739548 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45003
I0214 03:10:27.740037 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.740615 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.740644 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.740983 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.741192 1508919 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:10:27.743031 1508919 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:10:27.743055 1508919 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:10:27.743382 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.743412 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.759724 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44431
I0214 03:10:27.760192 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.760746 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.760780 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.761175 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.761435 1508919 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:10:27.764455 1508919 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:27.764906 1508919 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:10:27.764938 1508919 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:27.765068 1508919 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:10:27.765480 1508919 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:27.765529 1508919 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:27.780292 1508919 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45177
I0214 03:10:27.780748 1508919 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:27.781277 1508919 main.go:141] libmachine: Using API Version 1
I0214 03:10:27.781307 1508919 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:27.781634 1508919 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:27.781835 1508919 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:10:27.782001 1508919 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:10:27.782033 1508919 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:10:27.785167 1508919 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:27.785604 1508919 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:10:27.785631 1508919 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:27.785814 1508919 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:10:27.786015 1508919 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:10:27.786158 1508919 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:10:27.786273 1508919 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:10:27.869243 1508919 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:10:27.882681 1508919 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
ha_test.go:432: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p ha-447944 -n ha-447944
helpers_test.go:244: <<< TestHA/serial/RestartSecondaryNode FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestHA/serial/RestartSecondaryNode]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-447944 logs -n 25: (1.613792506s)
helpers_test.go:252: TestHA/serial/RestartSecondaryNode logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944:/home/docker/cp-test_ha-447944-m03_ha-447944.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944.txt | | | | | |
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m02:/home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04:/home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m04 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt | | | | | |
| cp | ha-447944 cp testdata/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04:/home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944-m04.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944:/home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m02:/home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m03:/home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m03 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| node | ha-447944 node stop m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | |
| | --alsologtostderr | | | | | |
| node | ha-447944 node start m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:09 UTC | |
| | --alsologtostderr | | | | | |
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 03:02:06
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 03:02:06.427529 1503804 out.go:291] Setting OutFile to fd 1 ...
I0214 03:02:06.427659 1503804 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:02:06.427671 1503804 out.go:304] Setting ErrFile to fd 2...
I0214 03:02:06.427675 1503804 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:02:06.427913 1503804 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:02:06.428529 1503804 out.go:298] Setting JSON to false
I0214 03:02:06.429525 1503804 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":20674,"bootTime":1707859053,"procs":199,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:02:06.429588 1503804 start.go:138] virtualization: kvm guest
I0214 03:02:06.431982 1503804 out.go:177] * [ha-447944] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 03:02:06.433564 1503804 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:02:06.433560 1503804 notify.go:220] Checking for updates...
I0214 03:02:06.435143 1503804 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:02:06.436605 1503804 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:02:06.437970 1503804 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:02:06.439380 1503804 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:02:06.440867 1503804 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:02:06.442532 1503804 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:02:06.477793 1503804 out.go:177] * Using the kvm2 driver based on user configuration
I0214 03:02:06.479127 1503804 start.go:296] selected driver: kvm2
I0214 03:02:06.479142 1503804 start.go:900] validating driver "kvm2" against <nil>
I0214 03:02:06.479156 1503804 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:02:06.479902 1503804 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:02:06.479993 1503804 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 03:02:06.494422 1503804 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 03:02:06.494469 1503804 start_flags.go:308] no existing cluster config was found, will generate one from the flags
I0214 03:02:06.494682 1503804 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:02:06.494746 1503804 cni.go:84] Creating CNI manager for ""
I0214 03:02:06.494760 1503804 cni.go:136] multinode detected (0 nodes found), recommending kindnet
I0214 03:02:06.494767 1503804 start_flags.go:317] Found "CNI" CNI - setting NetworkPlugin=cni
I0214 03:02:06.494820 1503804 start.go:339] cluster config:
{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS
ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs:}
I0214 03:02:06.494920 1503804 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:02:06.496689 1503804 out.go:177] * Starting "ha-447944" primary control-plane node in "ha-447944" cluster
I0214 03:02:06.497883 1503804 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:02:06.497925 1503804 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 03:02:06.497939 1503804 cache.go:56] Caching tarball of preloaded images
I0214 03:02:06.498011 1503804 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:02:06.498021 1503804 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:02:06.499039 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:02:06.499080 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json: {Name:mk0f1e24861d2db2bb1ab285edfab3532643e5a1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:06.499332 1503804 start.go:360] acquireMachinesLock for ha-447944: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:02:06.499572 1503804 start.go:364] duration metric: took 196.45µs to acquireMachinesLock for "ha-447944"
I0214 03:02:06.499629 1503804 start.go:93] Provisioning new machine with config: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:
9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:02:06.500061 1503804 start.go:125] createHost starting for "" (driver="kvm2")
I0214 03:02:06.501824 1503804 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0214 03:02:06.501980 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:02:06.502021 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:02:06.516656 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38091
I0214 03:02:06.517182 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:02:06.517760 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:02:06.517785 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:02:06.518163 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:02:06.518348 1503804 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:02:06.518514 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:06.518653 1503804 start.go:159] libmachine.API.Create for "ha-447944" (driver="kvm2")
I0214 03:02:06.518673 1503804 client.go:168] LocalClient.Create starting
I0214 03:02:06.518696 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 03:02:06.518724 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:02:06.518738 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:02:06.518805 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 03:02:06.518828 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:02:06.518840 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:02:06.518865 1503804 main.go:141] libmachine: Running pre-create checks...
I0214 03:02:06.518877 1503804 main.go:141] libmachine: (ha-447944) Calling .PreCreateCheck
I0214 03:02:06.519291 1503804 main.go:141] libmachine: (ha-447944) Calling .GetConfigRaw
I0214 03:02:06.519670 1503804 main.go:141] libmachine: Creating machine...
I0214 03:02:06.519683 1503804 main.go:141] libmachine: (ha-447944) Calling .Create
I0214 03:02:06.519804 1503804 main.go:141] libmachine: (ha-447944) Creating KVM machine...
I0214 03:02:06.521016 1503804 main.go:141] libmachine: (ha-447944) DBG | found existing default KVM network
I0214 03:02:06.521755 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:06.521629 1503826 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015a40}
I0214 03:02:06.521806 1503804 main.go:141] libmachine: (ha-447944) DBG | created network xml:
I0214 03:02:06.521830 1503804 main.go:141] libmachine: (ha-447944) DBG | <network>
I0214 03:02:06.521838 1503804 main.go:141] libmachine: (ha-447944) DBG | <name>mk-ha-447944</name>
I0214 03:02:06.521851 1503804 main.go:141] libmachine: (ha-447944) DBG | <dns enable='no'/>
I0214 03:02:06.521865 1503804 main.go:141] libmachine: (ha-447944) DBG |
I0214 03:02:06.521877 1503804 main.go:141] libmachine: (ha-447944) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0214 03:02:06.521896 1503804 main.go:141] libmachine: (ha-447944) DBG | <dhcp>
I0214 03:02:06.521911 1503804 main.go:141] libmachine: (ha-447944) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0214 03:02:06.521921 1503804 main.go:141] libmachine: (ha-447944) DBG | </dhcp>
I0214 03:02:06.521939 1503804 main.go:141] libmachine: (ha-447944) DBG | </ip>
I0214 03:02:06.521952 1503804 main.go:141] libmachine: (ha-447944) DBG |
I0214 03:02:06.521964 1503804 main.go:141] libmachine: (ha-447944) DBG | </network>
I0214 03:02:06.521978 1503804 main.go:141] libmachine: (ha-447944) DBG |
I0214 03:02:06.526953 1503804 main.go:141] libmachine: (ha-447944) DBG | trying to create private KVM network mk-ha-447944 192.168.39.0/24...
I0214 03:02:06.597016 1503804 main.go:141] libmachine: (ha-447944) DBG | private KVM network mk-ha-447944 192.168.39.0/24 created
I0214 03:02:06.597052 1503804 main.go:141] libmachine: (ha-447944) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944 ...
I0214 03:02:06.597068 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:06.596959 1503826 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:02:06.597099 1503804 main.go:141] libmachine: (ha-447944) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 03:02:06.597118 1503804 main.go:141] libmachine: (ha-447944) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 03:02:06.844263 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:06.844129 1503826 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa...
I0214 03:02:07.024600 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:07.024464 1503826 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/ha-447944.rawdisk...
I0214 03:02:07.024633 1503804 main.go:141] libmachine: (ha-447944) DBG | Writing magic tar header
I0214 03:02:07.024649 1503804 main.go:141] libmachine: (ha-447944) DBG | Writing SSH key tar header
I0214 03:02:07.024666 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:07.024593 1503826 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944 ...
I0214 03:02:07.024736 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944
I0214 03:02:07.024777 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944 (perms=drwx------)
I0214 03:02:07.024789 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 03:02:07.024841 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 03:02:07.024882 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 03:02:07.024895 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:02:07.024918 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 03:02:07.024932 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 03:02:07.024945 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home/jenkins
I0214 03:02:07.024959 1503804 main.go:141] libmachine: (ha-447944) DBG | Checking permissions on dir: /home
I0214 03:02:07.024981 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 03:02:07.024994 1503804 main.go:141] libmachine: (ha-447944) DBG | Skipping /home - not owner
I0214 03:02:07.025011 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 03:02:07.025024 1503804 main.go:141] libmachine: (ha-447944) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 03:02:07.025040 1503804 main.go:141] libmachine: (ha-447944) Creating domain...
I0214 03:02:07.026147 1503804 main.go:141] libmachine: (ha-447944) define libvirt domain using xml:
I0214 03:02:07.026165 1503804 main.go:141] libmachine: (ha-447944) <domain type='kvm'>
I0214 03:02:07.026178 1503804 main.go:141] libmachine: (ha-447944) <name>ha-447944</name>
I0214 03:02:07.026187 1503804 main.go:141] libmachine: (ha-447944) <memory unit='MiB'>2200</memory>
I0214 03:02:07.026204 1503804 main.go:141] libmachine: (ha-447944) <vcpu>2</vcpu>
I0214 03:02:07.026212 1503804 main.go:141] libmachine: (ha-447944) <features>
I0214 03:02:07.026224 1503804 main.go:141] libmachine: (ha-447944) <acpi/>
I0214 03:02:07.026234 1503804 main.go:141] libmachine: (ha-447944) <apic/>
I0214 03:02:07.026288 1503804 main.go:141] libmachine: (ha-447944) <pae/>
I0214 03:02:07.026322 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.026332 1503804 main.go:141] libmachine: (ha-447944) </features>
I0214 03:02:07.026342 1503804 main.go:141] libmachine: (ha-447944) <cpu mode='host-passthrough'>
I0214 03:02:07.026352 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.026358 1503804 main.go:141] libmachine: (ha-447944) </cpu>
I0214 03:02:07.026366 1503804 main.go:141] libmachine: (ha-447944) <os>
I0214 03:02:07.026372 1503804 main.go:141] libmachine: (ha-447944) <type>hvm</type>
I0214 03:02:07.026381 1503804 main.go:141] libmachine: (ha-447944) <boot dev='cdrom'/>
I0214 03:02:07.026387 1503804 main.go:141] libmachine: (ha-447944) <boot dev='hd'/>
I0214 03:02:07.026396 1503804 main.go:141] libmachine: (ha-447944) <bootmenu enable='no'/>
I0214 03:02:07.026405 1503804 main.go:141] libmachine: (ha-447944) </os>
I0214 03:02:07.026412 1503804 main.go:141] libmachine: (ha-447944) <devices>
I0214 03:02:07.026424 1503804 main.go:141] libmachine: (ha-447944) <disk type='file' device='cdrom'>
I0214 03:02:07.026461 1503804 main.go:141] libmachine: (ha-447944) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/boot2docker.iso'/>
I0214 03:02:07.026490 1503804 main.go:141] libmachine: (ha-447944) <target dev='hdc' bus='scsi'/>
I0214 03:02:07.026506 1503804 main.go:141] libmachine: (ha-447944) <readonly/>
I0214 03:02:07.026518 1503804 main.go:141] libmachine: (ha-447944) </disk>
I0214 03:02:07.026534 1503804 main.go:141] libmachine: (ha-447944) <disk type='file' device='disk'>
I0214 03:02:07.026549 1503804 main.go:141] libmachine: (ha-447944) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 03:02:07.026569 1503804 main.go:141] libmachine: (ha-447944) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/ha-447944.rawdisk'/>
I0214 03:02:07.026587 1503804 main.go:141] libmachine: (ha-447944) <target dev='hda' bus='virtio'/>
I0214 03:02:07.026601 1503804 main.go:141] libmachine: (ha-447944) </disk>
I0214 03:02:07.026613 1503804 main.go:141] libmachine: (ha-447944) <interface type='network'>
I0214 03:02:07.026628 1503804 main.go:141] libmachine: (ha-447944) <source network='mk-ha-447944'/>
I0214 03:02:07.026640 1503804 main.go:141] libmachine: (ha-447944) <model type='virtio'/>
I0214 03:02:07.026654 1503804 main.go:141] libmachine: (ha-447944) </interface>
I0214 03:02:07.026667 1503804 main.go:141] libmachine: (ha-447944) <interface type='network'>
I0214 03:02:07.026682 1503804 main.go:141] libmachine: (ha-447944) <source network='default'/>
I0214 03:02:07.026695 1503804 main.go:141] libmachine: (ha-447944) <model type='virtio'/>
I0214 03:02:07.026709 1503804 main.go:141] libmachine: (ha-447944) </interface>
I0214 03:02:07.026726 1503804 main.go:141] libmachine: (ha-447944) <serial type='pty'>
I0214 03:02:07.026740 1503804 main.go:141] libmachine: (ha-447944) <target port='0'/>
I0214 03:02:07.026752 1503804 main.go:141] libmachine: (ha-447944) </serial>
I0214 03:02:07.026767 1503804 main.go:141] libmachine: (ha-447944) <console type='pty'>
I0214 03:02:07.026787 1503804 main.go:141] libmachine: (ha-447944) <target type='serial' port='0'/>
I0214 03:02:07.026800 1503804 main.go:141] libmachine: (ha-447944) </console>
I0214 03:02:07.026824 1503804 main.go:141] libmachine: (ha-447944) <rng model='virtio'>
I0214 03:02:07.026845 1503804 main.go:141] libmachine: (ha-447944) <backend model='random'>/dev/random</backend>
I0214 03:02:07.026861 1503804 main.go:141] libmachine: (ha-447944) </rng>
I0214 03:02:07.026873 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.026888 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.026901 1503804 main.go:141] libmachine: (ha-447944) </devices>
I0214 03:02:07.026924 1503804 main.go:141] libmachine: (ha-447944) </domain>
I0214 03:02:07.026943 1503804 main.go:141] libmachine: (ha-447944)
I0214 03:02:07.030918 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:b6:93:8c in network default
I0214 03:02:07.031537 1503804 main.go:141] libmachine: (ha-447944) Ensuring networks are active...
I0214 03:02:07.031566 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:07.032152 1503804 main.go:141] libmachine: (ha-447944) Ensuring network default is active
I0214 03:02:07.032440 1503804 main.go:141] libmachine: (ha-447944) Ensuring network mk-ha-447944 is active
I0214 03:02:07.032942 1503804 main.go:141] libmachine: (ha-447944) Getting domain xml...
I0214 03:02:07.033605 1503804 main.go:141] libmachine: (ha-447944) Creating domain...
I0214 03:02:08.200936 1503804 main.go:141] libmachine: (ha-447944) Waiting to get IP...
I0214 03:02:08.201721 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:08.202064 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:08.202125 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:08.202062 1503826 retry.go:31] will retry after 261.415024ms: waiting for machine to come up
I0214 03:02:08.465569 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:08.466098 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:08.466135 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:08.466043 1503826 retry.go:31] will retry after 298.375096ms: waiting for machine to come up
I0214 03:02:08.766519 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:08.767028 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:08.767060 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:08.766950 1503826 retry.go:31] will retry after 484.028678ms: waiting for machine to come up
I0214 03:02:09.252659 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:09.253166 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:09.253191 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:09.253125 1503826 retry.go:31] will retry after 511.297559ms: waiting for machine to come up
I0214 03:02:09.765825 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:09.766243 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:09.766273 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:09.766181 1503826 retry.go:31] will retry after 681.270558ms: waiting for machine to come up
I0214 03:02:10.449184 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:10.449660 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:10.449690 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:10.449604 1503826 retry.go:31] will retry after 813.721958ms: waiting for machine to come up
I0214 03:02:11.264660 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:11.265142 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:11.265167 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:11.265079 1503826 retry.go:31] will retry after 1.115840924s: waiting for machine to come up
I0214 03:02:12.382904 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:12.383359 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:12.383389 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:12.383308 1503826 retry.go:31] will retry after 1.155677584s: waiting for machine to come up
I0214 03:02:13.540618 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:13.541036 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:13.541074 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:13.540979 1503826 retry.go:31] will retry after 1.26741669s: waiting for machine to come up
I0214 03:02:14.810419 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:14.810845 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:14.810886 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:14.810793 1503826 retry.go:31] will retry after 1.868490026s: waiting for machine to come up
I0214 03:02:16.681022 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:16.681445 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:16.681511 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:16.681418 1503826 retry.go:31] will retry after 2.868404585s: waiting for machine to come up
I0214 03:02:19.551267 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:19.551720 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:19.551752 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:19.551661 1503826 retry.go:31] will retry after 2.870927106s: waiting for machine to come up
I0214 03:02:22.423787 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:22.424284 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:22.424311 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:22.424205 1503826 retry.go:31] will retry after 3.092953895s: waiting for machine to come up
I0214 03:02:25.520438 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:25.520791 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find current IP address of domain ha-447944 in network mk-ha-447944
I0214 03:02:25.520812 1503804 main.go:141] libmachine: (ha-447944) DBG | I0214 03:02:25.520753 1503826 retry.go:31] will retry after 5.073865047s: waiting for machine to come up
I0214 03:02:30.599483 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.599885 1503804 main.go:141] libmachine: (ha-447944) Found IP for machine: 192.168.39.41
I0214 03:02:30.599913 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has current primary IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.599922 1503804 main.go:141] libmachine: (ha-447944) Reserving static IP address...
I0214 03:02:30.600338 1503804 main.go:141] libmachine: (ha-447944) DBG | unable to find host DHCP lease matching {name: "ha-447944", mac: "52:54:00:c5:66:e2", ip: "192.168.39.41"} in network mk-ha-447944
I0214 03:02:30.675093 1503804 main.go:141] libmachine: (ha-447944) DBG | Getting to WaitForSSH function...
I0214 03:02:30.675135 1503804 main.go:141] libmachine: (ha-447944) Reserved static IP address: 192.168.39.41
I0214 03:02:30.675149 1503804 main.go:141] libmachine: (ha-447944) Waiting for SSH to be available...
I0214 03:02:30.677694 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.678089 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:30.678119 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.678254 1503804 main.go:141] libmachine: (ha-447944) DBG | Using SSH client type: external
I0214 03:02:30.678278 1503804 main.go:141] libmachine: (ha-447944) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa (-rw-------)
I0214 03:02:30.678310 1503804 main.go:141] libmachine: (ha-447944) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.41 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 03:02:30.678327 1503804 main.go:141] libmachine: (ha-447944) DBG | About to run SSH command:
I0214 03:02:30.678361 1503804 main.go:141] libmachine: (ha-447944) DBG | exit 0
I0214 03:02:30.769060 1503804 main.go:141] libmachine: (ha-447944) DBG | SSH cmd err, output: <nil>:
I0214 03:02:30.769301 1503804 main.go:141] libmachine: (ha-447944) KVM machine creation complete!
I0214 03:02:30.769762 1503804 main.go:141] libmachine: (ha-447944) Calling .GetConfigRaw
I0214 03:02:30.770309 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:30.770511 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:30.770619 1503804 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 03:02:30.770629 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:02:30.772010 1503804 main.go:141] libmachine: Detecting operating system of created instance...
I0214 03:02:30.772031 1503804 main.go:141] libmachine: Waiting for SSH to be available...
I0214 03:02:30.772038 1503804 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 03:02:30.772045 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:30.774403 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.774759 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:30.774796 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.774897 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:30.775118 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:30.775291 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:30.775458 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:30.775647 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:30.776084 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:30.776100 1503804 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 03:02:30.896212 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:02:30.896243 1503804 main.go:141] libmachine: Detecting the provisioner...
I0214 03:02:30.896256 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:30.898958 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.899283 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:30.899311 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:30.899498 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:30.899695 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:30.899863 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:30.899965 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:30.900125 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:30.900587 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:30.900605 1503804 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 03:02:31.021995 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:02:31.022076 1503804 main.go:141] libmachine: found compatible host: buildroot
I0214 03:02:31.022092 1503804 main.go:141] libmachine: Provisioning with buildroot...
I0214 03:02:31.022107 1503804 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:02:31.022392 1503804 buildroot.go:166] provisioning hostname "ha-447944"
I0214 03:02:31.022417 1503804 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:02:31.022627 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.025568 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.025922 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.025948 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.026059 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.026243 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.026416 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.026567 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.026747 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:31.027069 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:31.027082 1503804 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-447944 && echo "ha-447944" | sudo tee /etc/hostname
I0214 03:02:31.161199 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944
I0214 03:02:31.161229 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.164307 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.164779 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.164809 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.165004 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.165213 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.165415 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.165606 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.165781 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:31.166126 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:31.166151 1503804 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-447944' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-447944/g' /etc/hosts;
else
echo '127.0.1.1 ha-447944' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:02:31.292294 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:02:31.292334 1503804 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:02:31.292385 1503804 buildroot.go:174] setting up certificates
I0214 03:02:31.292398 1503804 provision.go:84] configureAuth start
I0214 03:02:31.292418 1503804 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:02:31.292691 1503804 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:02:31.295249 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.295672 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.295700 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.295804 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.298089 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.298420 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.298450 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.298557 1503804 provision.go:143] copyHostCerts
I0214 03:02:31.298591 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:02:31.298632 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:02:31.298649 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:02:31.298715 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:02:31.298792 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:02:31.298810 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:02:31.298816 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:02:31.298841 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:02:31.298901 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:02:31.298920 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:02:31.298924 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:02:31.298945 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:02:31.299039 1503804 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ha-447944 san=[127.0.0.1 192.168.39.41 ha-447944 localhost minikube]
I0214 03:02:31.485425 1503804 provision.go:177] copyRemoteCerts
I0214 03:02:31.485509 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:02:31.485540 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.488400 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.488852 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.488893 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.489090 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.489301 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.489470 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.489661 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:02:31.583003 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:02:31.583073 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:02:31.604312 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:02:31.604381 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)
I0214 03:02:31.625150 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:02:31.625232 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 03:02:31.645972 1503804 provision.go:87] duration metric: took 353.559512ms to configureAuth
I0214 03:02:31.646005 1503804 buildroot.go:189] setting minikube options for container-runtime
I0214 03:02:31.646192 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:02:31.646290 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.649166 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.649591 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.649619 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.649830 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.650037 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.650219 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.650349 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.650526 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:31.650975 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:31.651013 1503804 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:02:31.987159 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:02:31.987206 1503804 main.go:141] libmachine: Checking connection to Docker...
I0214 03:02:31.987216 1503804 main.go:141] libmachine: (ha-447944) Calling .GetURL
I0214 03:02:31.988510 1503804 main.go:141] libmachine: (ha-447944) DBG | Using libvirt version 6000000
I0214 03:02:31.991000 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.991343 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.991363 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.991566 1503804 main.go:141] libmachine: Docker is up and running!
I0214 03:02:31.991581 1503804 main.go:141] libmachine: Reticulating splines...
I0214 03:02:31.991591 1503804 client.go:171] duration metric: took 25.47290983s to LocalClient.Create
I0214 03:02:31.991619 1503804 start.go:167] duration metric: took 25.472964862s to libmachine.API.Create "ha-447944"
I0214 03:02:31.991633 1503804 start.go:293] postStartSetup for "ha-447944" (driver="kvm2")
I0214 03:02:31.991649 1503804 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:02:31.991673 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:31.991931 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:02:31.991954 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:31.994229 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.994574 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:31.994602 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:31.994763 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:31.994962 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:31.995131 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:31.995313 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:02:32.086822 1503804 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:02:32.091499 1503804 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:02:32.091527 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:02:32.091603 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:02:32.091712 1503804 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:02:32.091723 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:02:32.091841 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:02:32.100496 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:02:32.125858 1503804 start.go:296] duration metric: took 134.20566ms for postStartSetup
I0214 03:02:32.125907 1503804 main.go:141] libmachine: (ha-447944) Calling .GetConfigRaw
I0214 03:02:32.126499 1503804 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:02:32.129197 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.129572 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.129593 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.129857 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:02:32.130037 1503804 start.go:128] duration metric: took 25.629963219s to createHost
I0214 03:02:32.130060 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:32.132221 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.132564 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.132585 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.132730 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:32.132940 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:32.133095 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:32.133232 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:32.133381 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:02:32.133700 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:02:32.133712 1503804 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:02:32.258054 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707879752.229013129
I0214 03:02:32.258085 1503804 fix.go:216] guest clock: 1707879752.229013129
I0214 03:02:32.258096 1503804 fix.go:229] Guest: 2024-02-14 03:02:32.229013129 +0000 UTC Remote: 2024-02-14 03:02:32.130048524 +0000 UTC m=+25.752251823 (delta=98.964605ms)
I0214 03:02:32.258143 1503804 fix.go:200] guest clock delta is within tolerance: 98.964605ms
I0214 03:02:32.258152 1503804 start.go:83] releasing machines lock for "ha-447944", held for 25.758545602s
I0214 03:02:32.258184 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:32.258438 1503804 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:02:32.260956 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.261330 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.261375 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.261500 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:32.262008 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:32.262182 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:02:32.262271 1503804 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:02:32.262327 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:32.262370 1503804 ssh_runner.go:195] Run: cat /version.json
I0214 03:02:32.262397 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:02:32.265078 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.265121 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.265437 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.265479 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:32.265498 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.265522 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:32.265634 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:32.265861 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:32.265873 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:02:32.266062 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:32.266097 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:02:32.266239 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:02:32.266237 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:02:32.266367 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:02:32.350033 1503804 ssh_runner.go:195] Run: systemctl --version
I0214 03:02:32.380053 1503804 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:02:32.534686 1503804 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:02:32.540821 1503804 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:02:32.540905 1503804 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:02:32.555078 1503804 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 03:02:32.555107 1503804 start.go:494] detecting cgroup driver to use...
I0214 03:02:32.555205 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:02:32.568577 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:02:32.581203 1503804 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:02:32.581277 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:02:32.593477 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:02:32.605489 1503804 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:02:32.704529 1503804 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:02:32.830993 1503804 docker.go:233] disabling docker service ...
I0214 03:02:32.831063 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:02:32.844703 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:02:32.856763 1503804 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:02:32.970546 1503804 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:02:33.077589 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:02:33.090111 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:02:33.106290 1503804 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:02:33.106374 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:02:33.116458 1503804 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:02:33.116538 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:02:33.126400 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:02:33.136210 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:02:33.145779 1503804 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:02:33.155797 1503804 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:02:33.164658 1503804 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 03:02:33.164732 1503804 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 03:02:33.177818 1503804 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:02:33.186561 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:02:33.289562 1503804 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:02:33.447291 1503804 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:02:33.447363 1503804 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:02:33.452437 1503804 start.go:562] Will wait 60s for crictl version
I0214 03:02:33.452484 1503804 ssh_runner.go:195] Run: which crictl
I0214 03:02:33.456099 1503804 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:02:33.494745 1503804 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:02:33.494822 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:02:33.544007 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:02:33.592475 1503804 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:02:33.593863 1503804 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:02:33.596916 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:33.597376 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:02:33.597407 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:02:33.597623 1503804 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:02:33.601811 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:02:33.614034 1503804 kubeadm.go:877] updating cluster {Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cl
usterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mo
untType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 03:02:33.614149 1503804 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:02:33.614194 1503804 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:02:33.649014 1503804 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 03:02:33.649101 1503804 ssh_runner.go:195] Run: which lz4
I0214 03:02:33.653262 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4
I0214 03:02:33.653379 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 03:02:33.657809 1503804 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 03:02:33.657843 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 03:02:35.450509 1503804 crio.go:444] duration metric: took 1.797164405s to copy over tarball
I0214 03:02:35.450599 1503804 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 03:02:38.263977 1503804 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.813337239s)
I0214 03:02:38.264067 1503804 crio.go:451] duration metric: took 2.813517611s to extract the tarball
I0214 03:02:38.264082 1503804 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 03:02:38.307152 1503804 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:02:38.383125 1503804 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:02:38.383156 1503804 cache_images.go:84] Images are preloaded, skipping loading
I0214 03:02:38.383175 1503804 kubeadm.go:928] updating node { 192.168.39.41 8443 v1.28.4 crio true true} ...
I0214 03:02:38.383331 1503804 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-447944 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.41
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:02:38.383424 1503804 ssh_runner.go:195] Run: crio config
I0214 03:02:38.451263 1503804 cni.go:84] Creating CNI manager for ""
I0214 03:02:38.451295 1503804 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I0214 03:02:38.451310 1503804 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 03:02:38.451336 1503804 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.41 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-447944 NodeName:ha-447944 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.41 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/m
anifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 03:02:38.451556 1503804 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.41
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "ha-447944"
kubeletExtraArgs:
node-ip: 192.168.39.41
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.41"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 03:02:38.451636 1503804 kube-vip.go:101] generating kube-vip config ...
I0214 03:02:38.451722 1503804 kube-vip.go:121] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_ddns
value: "false"
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v0.7.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0214 03:02:38.451783 1503804 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:02:38.460623 1503804 binaries.go:44] Found k8s binaries, skipping transfer
I0214 03:02:38.460710 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
I0214 03:02:38.469080 1503804 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (308 bytes)
I0214 03:02:38.485205 1503804 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:02:38.500698 1503804 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2150 bytes)
I0214 03:02:38.516212 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1265 bytes)
I0214 03:02:38.531576 1503804 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0214 03:02:38.535268 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:02:38.547329 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:02:38.648020 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:02:38.662224 1503804 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944 for IP: 192.168.39.41
I0214 03:02:38.662257 1503804 certs.go:194] generating shared ca certs ...
I0214 03:02:38.662279 1503804 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:38.662494 1503804 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:02:38.662536 1503804 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:02:38.662547 1503804 certs.go:256] generating profile certs ...
I0214 03:02:38.662668 1503804 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key
I0214 03:02:38.662687 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt with IP's: []
I0214 03:02:38.883643 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt ...
I0214 03:02:38.883677 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt: {Name:mk715eb455d450fcc18dee3b4292ec9a94f5b3cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:38.883872 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key ...
I0214 03:02:38.883887 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key: {Name:mkfbf984e664759262e4d6294d4e94c39cdafe2d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:38.884009 1503804 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.a1c30460
I0214 03:02:38.884033 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.a1c30460 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41 192.168.39.254]
I0214 03:02:39.016938 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.a1c30460 ...
I0214 03:02:39.016973 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.a1c30460: {Name:mkd9280721df84084591dc9afbc28af8a8283b55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:39.017147 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.a1c30460 ...
I0214 03:02:39.017169 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.a1c30460: {Name:mkcae7fee47ff2703df685bf65ef58c5bb561973 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:39.017294 1503804 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.a1c30460 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt
I0214 03:02:39.017392 1503804 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.a1c30460 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key
I0214 03:02:39.017475 1503804 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key
I0214 03:02:39.017495 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt with IP's: []
I0214 03:02:39.066438 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt ...
I0214 03:02:39.066470 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt: {Name:mkcd5a5a6408fb078830c81b823b48b3e6e4b986 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:39.066636 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key ...
I0214 03:02:39.066655 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key: {Name:mkb12bbf65f35f264a3075eda0479430b90b2215 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:02:39.066746 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:02:39.066770 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:02:39.066789 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:02:39.066809 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:02:39.066836 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:02:39.066864 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:02:39.066884 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:02:39.066909 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:02:39.066974 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:02:39.067023 1503804 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:02:39.067038 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:02:39.067074 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:02:39.067115 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:02:39.067147 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:02:39.067199 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:02:39.067235 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:02:39.067255 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:02:39.067272 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:02:39.067895 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:02:39.091878 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:02:39.113839 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:02:39.135643 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:02:39.157850 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 03:02:39.180369 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 03:02:39.202648 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:02:39.224769 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:02:39.247075 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:02:39.269360 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:02:39.291566 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:02:39.313810 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 03:02:39.329261 1503804 ssh_runner.go:195] Run: openssl version
I0214 03:02:39.334529 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:02:39.343429 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:02:39.347583 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:02:39.347626 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:02:39.352800 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:02:39.361822 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:02:39.371020 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:02:39.375619 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:02:39.375679 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:02:39.380843 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:02:39.390215 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:02:39.399835 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:02:39.404538 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:02:39.404579 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:02:39.410340 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:02:39.421139 1503804 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:02:39.424981 1503804 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 03:02:39.425038 1503804 kubeadm.go:391] StartCluster: {Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Clust
erName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mount
Type:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:02:39.425130 1503804 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 03:02:39.425175 1503804 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 03:02:39.462656 1503804 cri.go:89] found id: ""
I0214 03:02:39.462743 1503804 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0214 03:02:39.474576 1503804 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 03:02:39.483389 1503804 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 03:02:39.506081 1503804 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 03:02:39.506113 1503804 kubeadm.go:156] found existing configuration files:
I0214 03:02:39.506174 1503804 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 03:02:39.518494 1503804 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 03:02:39.518551 1503804 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 03:02:39.531055 1503804 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 03:02:39.542552 1503804 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 03:02:39.542618 1503804 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 03:02:39.552136 1503804 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 03:02:39.563396 1503804 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 03:02:39.563482 1503804 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 03:02:39.575050 1503804 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 03:02:39.583653 1503804 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 03:02:39.583733 1503804 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 03:02:39.592502 1503804 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 03:02:39.702502 1503804 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 03:02:39.702747 1503804 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 03:02:39.824751 1503804 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 03:02:39.824898 1503804 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 03:02:39.824997 1503804 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 03:02:40.049625 1503804 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 03:02:40.132812 1503804 out.go:204] - Generating certificates and keys ...
I0214 03:02:40.132920 1503804 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 03:02:40.133018 1503804 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 03:02:40.149818 1503804 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 03:02:40.254961 1503804 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 03:02:40.358060 1503804 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 03:02:40.484404 1503804 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 03:02:40.595769 1503804 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 03:02:40.596185 1503804 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-447944 localhost] and IPs [192.168.39.41 127.0.0.1 ::1]
I0214 03:02:40.861906 1503804 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 03:02:40.862117 1503804 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-447944 localhost] and IPs [192.168.39.41 127.0.0.1 ::1]
I0214 03:02:41.009073 1503804 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 03:02:41.081786 1503804 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 03:02:41.163074 1503804 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 03:02:41.163427 1503804 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 03:02:41.225455 1503804 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 03:02:41.573963 1503804 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 03:02:41.908167 1503804 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 03:02:42.126990 1503804 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 03:02:42.127574 1503804 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 03:02:42.132715 1503804 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 03:02:42.134904 1503804 out.go:204] - Booting up control plane ...
I0214 03:02:42.134986 1503804 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 03:02:42.135051 1503804 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 03:02:42.135106 1503804 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 03:02:42.147938 1503804 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 03:02:42.148849 1503804 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 03:02:42.148901 1503804 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 03:02:42.260407 1503804 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 03:02:51.831896 1503804 kubeadm.go:309] [apiclient] All control plane components are healthy after 9.576249 seconds
I0214 03:02:51.832092 1503804 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 03:02:51.854298 1503804 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 03:02:52.394069 1503804 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 03:02:52.394340 1503804 kubeadm.go:309] [mark-control-plane] Marking the node ha-447944 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 03:02:52.908467 1503804 kubeadm.go:309] [bootstrap-token] Using token: isaxlc.jf8d2khhxbct4th6
I0214 03:02:52.909874 1503804 out.go:204] - Configuring RBAC rules ...
I0214 03:02:52.910038 1503804 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 03:02:52.916291 1503804 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 03:02:52.923485 1503804 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 03:02:52.930312 1503804 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 03:02:52.936606 1503804 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 03:02:52.940216 1503804 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 03:02:52.953914 1503804 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 03:02:53.169021 1503804 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 03:02:53.322925 1503804 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 03:02:53.322960 1503804 kubeadm.go:309]
I0214 03:02:53.323033 1503804 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 03:02:53.323044 1503804 kubeadm.go:309]
I0214 03:02:53.323125 1503804 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 03:02:53.323135 1503804 kubeadm.go:309]
I0214 03:02:53.323169 1503804 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 03:02:53.323246 1503804 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 03:02:53.323346 1503804 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 03:02:53.323373 1503804 kubeadm.go:309]
I0214 03:02:53.323461 1503804 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 03:02:53.323472 1503804 kubeadm.go:309]
I0214 03:02:53.323549 1503804 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 03:02:53.323566 1503804 kubeadm.go:309]
I0214 03:02:53.323654 1503804 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 03:02:53.323774 1503804 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 03:02:53.323873 1503804 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 03:02:53.323883 1503804 kubeadm.go:309]
I0214 03:02:53.323987 1503804 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 03:02:53.324095 1503804 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 03:02:53.324108 1503804 kubeadm.go:309]
I0214 03:02:53.324219 1503804 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token isaxlc.jf8d2khhxbct4th6 \
I0214 03:02:53.324366 1503804 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 03:02:53.324399 1503804 kubeadm.go:309] --control-plane
I0214 03:02:53.324423 1503804 kubeadm.go:309]
I0214 03:02:53.324537 1503804 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 03:02:53.324545 1503804 kubeadm.go:309]
I0214 03:02:53.324655 1503804 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token isaxlc.jf8d2khhxbct4th6 \
I0214 03:02:53.324795 1503804 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 03:02:53.324959 1503804 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 03:02:53.324986 1503804 cni.go:84] Creating CNI manager for ""
I0214 03:02:53.324999 1503804 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I0214 03:02:53.326762 1503804 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0214 03:02:53.328081 1503804 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0214 03:02:53.344602 1503804 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.4/kubectl ...
I0214 03:02:53.344630 1503804 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0214 03:02:53.380152 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0214 03:02:54.357399 1503804 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 03:02:54.357524 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:54.357539 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-447944 minikube.k8s.io/updated_at=2024_02_14T03_02_54_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=ha-447944 minikube.k8s.io/primary=true
I0214 03:02:54.561590 1503804 ops.go:34] apiserver oom_adj: -16
I0214 03:02:54.561757 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:55.062080 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:55.562833 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:56.062070 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:56.562125 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:57.061992 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:57.561838 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:58.062761 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:58.562482 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:59.062745 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:02:59.562508 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:00.061823 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:00.562473 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:01.061902 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:01.562331 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:02.061975 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:02.562086 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:03.062735 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:03.562472 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:03:03.702621 1503804 kubeadm.go:1106] duration metric: took 9.345179121s to wait for elevateKubeSystemPrivileges
W0214 03:03:03.702684 1503804 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 03:03:03.702695 1503804 kubeadm.go:393] duration metric: took 24.277662415s to StartCluster
I0214 03:03:03.702717 1503804 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:03.702801 1503804 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:03:03.703575 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:03.703846 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0214 03:03:03.703860 1503804 start.go:232] HA cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:03:03.703885 1503804 start.go:240] waiting for startup goroutines ...
I0214 03:03:03.703896 1503804 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 03:03:03.703954 1503804 addons.go:69] Setting storage-provisioner=true in profile "ha-447944"
I0214 03:03:03.703973 1503804 addons.go:69] Setting default-storageclass=true in profile "ha-447944"
I0214 03:03:03.704034 1503804 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-447944"
I0214 03:03:03.703985 1503804 addons.go:234] Setting addon storage-provisioner=true in "ha-447944"
I0214 03:03:03.704111 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:03:03.704154 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:03:03.704537 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.704565 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.704572 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.704590 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.719066 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40917
I0214 03:03:03.719492 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.719962 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.719983 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.720331 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.720553 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:03:03.722831 1503804 loader.go:395] Config loaded from file: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:03:03.723212 1503804 kapi.go:59] client config for ha-447944: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]strin
g(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0214 03:03:03.723944 1503804 cert_rotation.go:137] Starting client certificate rotation controller
I0214 03:03:03.724301 1503804 addons.go:234] Setting addon default-storageclass=true in "ha-447944"
I0214 03:03:03.724349 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:03:03.724661 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.724685 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.724834 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39961
I0214 03:03:03.725267 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.725742 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.725764 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.726131 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.726628 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.726655 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.739542 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33875
I0214 03:03:03.740011 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.740121 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33345
I0214 03:03:03.740592 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.740614 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.740633 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.740969 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.741083 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.741108 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.741471 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.741627 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:03:03.741726 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:03.741763 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:03.743342 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:03:03.745887 1503804 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 03:03:03.747354 1503804 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 03:03:03.747372 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 03:03:03.747385 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:03:03.750821 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:03.751303 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:03:03.751330 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:03.751543 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:03:03.751695 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:03:03.751813 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:03:03.751938 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:03:03.756311 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40603
I0214 03:03:03.756634 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:03.757063 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:03.757087 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:03.757416 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:03.757627 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:03:03.759052 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:03:03.759338 1503804 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 03:03:03.759354 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 03:03:03.759367 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:03:03.762236 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:03.762568 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:03:03.762611 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:03.762789 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:03:03.762962 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:03:03.763129 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:03:03.763301 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:03:03.862307 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0214 03:03:03.918088 1503804 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 03:03:03.931351 1503804 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 03:03:04.612774 1503804 start.go:948] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I0214 03:03:04.682143 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:04.682178 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:04.682478 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:04.682493 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:04.682503 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:04.682510 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:04.682781 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:04.682801 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:04.682937 1503804 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses
I0214 03:03:04.682952 1503804 round_trippers.go:469] Request Headers:
I0214 03:03:04.682963 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:03:04.682976 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:03:04.741577 1503804 round_trippers.go:574] Response Status: 200 OK in 58 milliseconds
I0214 03:03:04.743646 1503804 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard
I0214 03:03:04.743667 1503804 round_trippers.go:469] Request Headers:
I0214 03:03:04.743679 1503804 round_trippers.go:473] Content-Type: application/json
I0214 03:03:04.743687 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:03:04.743696 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:03:04.790312 1503804 round_trippers.go:574] Response Status: 200 OK in 46 milliseconds
I0214 03:03:04.811062 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:04.811107 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:04.811458 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:04.811484 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:05.022065 1503804 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.090672614s)
I0214 03:03:05.022124 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:05.022138 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:05.022481 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:05.022505 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:05.022517 1503804 main.go:141] libmachine: Making call to close driver server
I0214 03:03:05.022527 1503804 main.go:141] libmachine: (ha-447944) Calling .Close
I0214 03:03:05.022793 1503804 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:03:05.022813 1503804 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:03:05.024464 1503804 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I0214 03:03:05.025612 1503804 addons.go:505] duration metric: took 1.321714929s for enable addons: enabled=[default-storageclass storage-provisioner]
I0214 03:03:05.025647 1503804 start.go:245] waiting for cluster config update ...
I0214 03:03:05.025663 1503804 start.go:254] writing updated cluster config ...
I0214 03:03:05.027099 1503804 out.go:177]
I0214 03:03:05.028388 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:03:05.028460 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:03:05.029880 1503804 out.go:177] * Starting "ha-447944-m02" control-plane node in "ha-447944" cluster
I0214 03:03:05.030956 1503804 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:03:05.030975 1503804 cache.go:56] Caching tarball of preloaded images
I0214 03:03:05.031049 1503804 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:03:05.031059 1503804 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:03:05.031146 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:03:05.031328 1503804 start.go:360] acquireMachinesLock for ha-447944-m02: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:03:05.031385 1503804 start.go:364] duration metric: took 30.606µs to acquireMachinesLock for "ha-447944-m02"
I0214 03:03:05.031412 1503804 start.go:93] Provisioning new machine with config: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cert
Expiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:03:05.031504 1503804 start.go:125] createHost starting for "m02" (driver="kvm2")
I0214 03:03:05.033058 1503804 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0214 03:03:05.033143 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:05.033167 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:05.047737 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44665
I0214 03:03:05.048192 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:05.048773 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:05.048808 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:05.049131 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:05.049382 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetMachineName
I0214 03:03:05.049531 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:05.049661 1503804 start.go:159] libmachine.API.Create for "ha-447944" (driver="kvm2")
I0214 03:03:05.049692 1503804 client.go:168] LocalClient.Create starting
I0214 03:03:05.049735 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 03:03:05.049780 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:03:05.049800 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:03:05.049867 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 03:03:05.049899 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:03:05.049916 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:03:05.049941 1503804 main.go:141] libmachine: Running pre-create checks...
I0214 03:03:05.049954 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .PreCreateCheck
I0214 03:03:05.050087 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetConfigRaw
I0214 03:03:05.050532 1503804 main.go:141] libmachine: Creating machine...
I0214 03:03:05.050553 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .Create
I0214 03:03:05.050724 1503804 main.go:141] libmachine: (ha-447944-m02) Creating KVM machine...
I0214 03:03:05.051966 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found existing default KVM network
I0214 03:03:05.052088 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found existing private KVM network mk-ha-447944
I0214 03:03:05.052247 1503804 main.go:141] libmachine: (ha-447944-m02) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02 ...
I0214 03:03:05.052274 1503804 main.go:141] libmachine: (ha-447944-m02) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 03:03:05.052355 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:05.052229 1504170 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:03:05.052432 1503804 main.go:141] libmachine: (ha-447944-m02) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 03:03:05.293240 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:05.293059 1504170 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa...
I0214 03:03:05.380963 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:05.380834 1504170 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/ha-447944-m02.rawdisk...
I0214 03:03:05.380998 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Writing magic tar header
I0214 03:03:05.381008 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Writing SSH key tar header
I0214 03:03:05.381016 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:05.380977 1504170 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02 ...
I0214 03:03:05.381153 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02
I0214 03:03:05.381203 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02 (perms=drwx------)
I0214 03:03:05.381223 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 03:03:05.381245 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:03:05.381274 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 03:03:05.381289 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 03:03:05.381301 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 03:03:05.381318 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 03:03:05.381333 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 03:03:05.381348 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 03:03:05.381363 1503804 main.go:141] libmachine: (ha-447944-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 03:03:05.381374 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home/jenkins
I0214 03:03:05.381404 1503804 main.go:141] libmachine: (ha-447944-m02) Creating domain...
I0214 03:03:05.381417 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Checking permissions on dir: /home
I0214 03:03:05.381430 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Skipping /home - not owner
I0214 03:03:05.382416 1503804 main.go:141] libmachine: (ha-447944-m02) define libvirt domain using xml:
I0214 03:03:05.382441 1503804 main.go:141] libmachine: (ha-447944-m02) <domain type='kvm'>
I0214 03:03:05.382454 1503804 main.go:141] libmachine: (ha-447944-m02) <name>ha-447944-m02</name>
I0214 03:03:05.382467 1503804 main.go:141] libmachine: (ha-447944-m02) <memory unit='MiB'>2200</memory>
I0214 03:03:05.382479 1503804 main.go:141] libmachine: (ha-447944-m02) <vcpu>2</vcpu>
I0214 03:03:05.382497 1503804 main.go:141] libmachine: (ha-447944-m02) <features>
I0214 03:03:05.382505 1503804 main.go:141] libmachine: (ha-447944-m02) <acpi/>
I0214 03:03:05.382513 1503804 main.go:141] libmachine: (ha-447944-m02) <apic/>
I0214 03:03:05.382525 1503804 main.go:141] libmachine: (ha-447944-m02) <pae/>
I0214 03:03:05.382536 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.382548 1503804 main.go:141] libmachine: (ha-447944-m02) </features>
I0214 03:03:05.382557 1503804 main.go:141] libmachine: (ha-447944-m02) <cpu mode='host-passthrough'>
I0214 03:03:05.382563 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.382570 1503804 main.go:141] libmachine: (ha-447944-m02) </cpu>
I0214 03:03:05.382576 1503804 main.go:141] libmachine: (ha-447944-m02) <os>
I0214 03:03:05.382583 1503804 main.go:141] libmachine: (ha-447944-m02) <type>hvm</type>
I0214 03:03:05.382590 1503804 main.go:141] libmachine: (ha-447944-m02) <boot dev='cdrom'/>
I0214 03:03:05.382599 1503804 main.go:141] libmachine: (ha-447944-m02) <boot dev='hd'/>
I0214 03:03:05.382609 1503804 main.go:141] libmachine: (ha-447944-m02) <bootmenu enable='no'/>
I0214 03:03:05.382621 1503804 main.go:141] libmachine: (ha-447944-m02) </os>
I0214 03:03:05.382631 1503804 main.go:141] libmachine: (ha-447944-m02) <devices>
I0214 03:03:05.382644 1503804 main.go:141] libmachine: (ha-447944-m02) <disk type='file' device='cdrom'>
I0214 03:03:05.382661 1503804 main.go:141] libmachine: (ha-447944-m02) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/boot2docker.iso'/>
I0214 03:03:05.382672 1503804 main.go:141] libmachine: (ha-447944-m02) <target dev='hdc' bus='scsi'/>
I0214 03:03:05.382680 1503804 main.go:141] libmachine: (ha-447944-m02) <readonly/>
I0214 03:03:05.382685 1503804 main.go:141] libmachine: (ha-447944-m02) </disk>
I0214 03:03:05.382694 1503804 main.go:141] libmachine: (ha-447944-m02) <disk type='file' device='disk'>
I0214 03:03:05.382703 1503804 main.go:141] libmachine: (ha-447944-m02) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 03:03:05.382723 1503804 main.go:141] libmachine: (ha-447944-m02) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/ha-447944-m02.rawdisk'/>
I0214 03:03:05.382736 1503804 main.go:141] libmachine: (ha-447944-m02) <target dev='hda' bus='virtio'/>
I0214 03:03:05.382746 1503804 main.go:141] libmachine: (ha-447944-m02) </disk>
I0214 03:03:05.382759 1503804 main.go:141] libmachine: (ha-447944-m02) <interface type='network'>
I0214 03:03:05.382772 1503804 main.go:141] libmachine: (ha-447944-m02) <source network='mk-ha-447944'/>
I0214 03:03:05.382784 1503804 main.go:141] libmachine: (ha-447944-m02) <model type='virtio'/>
I0214 03:03:05.382795 1503804 main.go:141] libmachine: (ha-447944-m02) </interface>
I0214 03:03:05.382803 1503804 main.go:141] libmachine: (ha-447944-m02) <interface type='network'>
I0214 03:03:05.382813 1503804 main.go:141] libmachine: (ha-447944-m02) <source network='default'/>
I0214 03:03:05.382825 1503804 main.go:141] libmachine: (ha-447944-m02) <model type='virtio'/>
I0214 03:03:05.382837 1503804 main.go:141] libmachine: (ha-447944-m02) </interface>
I0214 03:03:05.382849 1503804 main.go:141] libmachine: (ha-447944-m02) <serial type='pty'>
I0214 03:03:05.382863 1503804 main.go:141] libmachine: (ha-447944-m02) <target port='0'/>
I0214 03:03:05.382882 1503804 main.go:141] libmachine: (ha-447944-m02) </serial>
I0214 03:03:05.382895 1503804 main.go:141] libmachine: (ha-447944-m02) <console type='pty'>
I0214 03:03:05.382905 1503804 main.go:141] libmachine: (ha-447944-m02) <target type='serial' port='0'/>
I0214 03:03:05.382912 1503804 main.go:141] libmachine: (ha-447944-m02) </console>
I0214 03:03:05.382924 1503804 main.go:141] libmachine: (ha-447944-m02) <rng model='virtio'>
I0214 03:03:05.382939 1503804 main.go:141] libmachine: (ha-447944-m02) <backend model='random'>/dev/random</backend>
I0214 03:03:05.382952 1503804 main.go:141] libmachine: (ha-447944-m02) </rng>
I0214 03:03:05.382964 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.382975 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.382987 1503804 main.go:141] libmachine: (ha-447944-m02) </devices>
I0214 03:03:05.383003 1503804 main.go:141] libmachine: (ha-447944-m02) </domain>
I0214 03:03:05.383015 1503804 main.go:141] libmachine: (ha-447944-m02)
I0214 03:03:05.390177 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:68:0a:ac in network default
I0214 03:03:05.390849 1503804 main.go:141] libmachine: (ha-447944-m02) Ensuring networks are active...
I0214 03:03:05.390879 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:05.391591 1503804 main.go:141] libmachine: (ha-447944-m02) Ensuring network default is active
I0214 03:03:05.391960 1503804 main.go:141] libmachine: (ha-447944-m02) Ensuring network mk-ha-447944 is active
I0214 03:03:05.392293 1503804 main.go:141] libmachine: (ha-447944-m02) Getting domain xml...
I0214 03:03:05.393073 1503804 main.go:141] libmachine: (ha-447944-m02) Creating domain...
I0214 03:03:06.596308 1503804 main.go:141] libmachine: (ha-447944-m02) Waiting to get IP...
I0214 03:03:06.597068 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:06.597519 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:06.597542 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:06.597492 1504170 retry.go:31] will retry after 275.546774ms: waiting for machine to come up
I0214 03:03:06.874971 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:06.875581 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:06.875615 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:06.875519 1504170 retry.go:31] will retry after 378.989959ms: waiting for machine to come up
I0214 03:03:07.256206 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:07.256697 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:07.256730 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:07.256634 1504170 retry.go:31] will retry after 357.175343ms: waiting for machine to come up
I0214 03:03:07.614994 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:07.615546 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:07.615579 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:07.615487 1504170 retry.go:31] will retry after 416.141863ms: waiting for machine to come up
I0214 03:03:08.032886 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:08.033284 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:08.033332 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:08.033225 1504170 retry.go:31] will retry after 489.283065ms: waiting for machine to come up
I0214 03:03:08.523858 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:08.524327 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:08.524362 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:08.524269 1504170 retry.go:31] will retry after 881.345438ms: waiting for machine to come up
I0214 03:03:09.407256 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:09.407740 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:09.407772 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:09.407698 1504170 retry.go:31] will retry after 893.378694ms: waiting for machine to come up
I0214 03:03:10.303158 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:10.303621 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:10.303687 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:10.303573 1504170 retry.go:31] will retry after 1.18385875s: waiting for machine to come up
I0214 03:03:11.488903 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:11.489368 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:11.489446 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:11.489345 1504170 retry.go:31] will retry after 1.752018652s: waiting for machine to come up
I0214 03:03:13.242608 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:13.243007 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:13.243035 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:13.242966 1504170 retry.go:31] will retry after 2.161859841s: waiting for machine to come up
I0214 03:03:15.406350 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:15.406780 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:15.406835 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:15.406744 1504170 retry.go:31] will retry after 2.101426673s: waiting for machine to come up
I0214 03:03:17.510686 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:17.511252 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:17.511290 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:17.511186 1504170 retry.go:31] will retry after 2.455890503s: waiting for machine to come up
I0214 03:03:19.969763 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:19.970191 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:19.970222 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:19.970119 1504170 retry.go:31] will retry after 3.297494106s: waiting for machine to come up
I0214 03:03:23.270286 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:23.270718 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find current IP address of domain ha-447944-m02 in network mk-ha-447944
I0214 03:03:23.270770 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | I0214 03:03:23.270677 1504170 retry.go:31] will retry after 5.486051669s: waiting for machine to come up
I0214 03:03:28.761383 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.761866 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has current primary IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.761903 1503804 main.go:141] libmachine: (ha-447944-m02) Found IP for machine: 192.168.39.218
I0214 03:03:28.761917 1503804 main.go:141] libmachine: (ha-447944-m02) Reserving static IP address...
I0214 03:03:28.762319 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | unable to find host DHCP lease matching {name: "ha-447944-m02", mac: "52:54:00:61:ed:46", ip: "192.168.39.218"} in network mk-ha-447944
I0214 03:03:28.836971 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Getting to WaitForSSH function...
I0214 03:03:28.837007 1503804 main.go:141] libmachine: (ha-447944-m02) Reserved static IP address: 192.168.39.218
I0214 03:03:28.837029 1503804 main.go:141] libmachine: (ha-447944-m02) Waiting for SSH to be available...
I0214 03:03:28.839580 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.840015 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:minikube Clientid:01:52:54:00:61:ed:46}
I0214 03:03:28.840044 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.840209 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Using SSH client type: external
I0214 03:03:28.840241 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa (-rw-------)
I0214 03:03:28.840283 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.218 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 03:03:28.840298 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | About to run SSH command:
I0214 03:03:28.840315 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | exit 0
I0214 03:03:28.933452 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | SSH cmd err, output: <nil>:
I0214 03:03:28.933687 1503804 main.go:141] libmachine: (ha-447944-m02) KVM machine creation complete!
I0214 03:03:28.934029 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetConfigRaw
I0214 03:03:28.934623 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:28.934856 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:28.935048 1503804 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 03:03:28.935064 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:03:28.936430 1503804 main.go:141] libmachine: Detecting operating system of created instance...
I0214 03:03:28.936455 1503804 main.go:141] libmachine: Waiting for SSH to be available...
I0214 03:03:28.936461 1503804 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 03:03:28.936467 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:28.938815 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.939199 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:28.939230 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:28.939407 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:28.939569 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:28.939712 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:28.939838 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:28.940041 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:28.940646 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:28.940664 1503804 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 03:03:29.060273 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:03:29.060301 1503804 main.go:141] libmachine: Detecting the provisioner...
I0214 03:03:29.060310 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.063089 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.063473 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.063502 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.063657 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.063896 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.064074 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.064205 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.064322 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:29.064632 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:29.064643 1503804 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 03:03:29.185978 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:03:29.186091 1503804 main.go:141] libmachine: found compatible host: buildroot
I0214 03:03:29.186103 1503804 main.go:141] libmachine: Provisioning with buildroot...
I0214 03:03:29.186115 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetMachineName
I0214 03:03:29.186424 1503804 buildroot.go:166] provisioning hostname "ha-447944-m02"
I0214 03:03:29.186457 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetMachineName
I0214 03:03:29.186666 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.190840 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.191196 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.191221 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.191388 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.191547 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.191734 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.191917 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.192097 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:29.192410 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:29.192424 1503804 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-447944-m02 && echo "ha-447944-m02" | sudo tee /etc/hostname
I0214 03:03:29.333762 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944-m02
I0214 03:03:29.333819 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.336668 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.337056 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.337087 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.337221 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.337436 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.337614 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.337731 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.337919 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:29.338386 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:29.338424 1503804 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-447944-m02' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-447944-m02/g' /etc/hosts;
else
echo '127.0.1.1 ha-447944-m02' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:03:29.473586 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:03:29.473630 1503804 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:03:29.473668 1503804 buildroot.go:174] setting up certificates
I0214 03:03:29.473685 1503804 provision.go:84] configureAuth start
I0214 03:03:29.473703 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetMachineName
I0214 03:03:29.474017 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:03:29.476704 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.477114 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.477146 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.477337 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.479930 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.480287 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.480308 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.480465 1503804 provision.go:143] copyHostCerts
I0214 03:03:29.480498 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:03:29.480548 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:03:29.480557 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:03:29.480624 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:03:29.480710 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:03:29.480727 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:03:29.480733 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:03:29.480757 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:03:29.480822 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:03:29.480844 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:03:29.480847 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:03:29.480871 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:03:29.480919 1503804 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ha-447944-m02 san=[127.0.0.1 192.168.39.218 ha-447944-m02 localhost minikube]
I0214 03:03:29.595313 1503804 provision.go:177] copyRemoteCerts
I0214 03:03:29.595396 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:03:29.595433 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.598227 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.598607 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.598648 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.598959 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.599161 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.599337 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.599435 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:03:29.690233 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:03:29.690324 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:03:29.714265 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:03:29.714357 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0214 03:03:29.737089 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:03:29.737162 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 03:03:29.761350 1503804 provision.go:87] duration metric: took 287.643885ms to configureAuth
I0214 03:03:29.761399 1503804 buildroot.go:189] setting minikube options for container-runtime
I0214 03:03:29.761640 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:03:29.761794 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:29.764629 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.765078 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:29.765110 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:29.765340 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:29.765568 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.765770 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:29.765924 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:29.766119 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:29.766502 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:29.766523 1503804 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:03:30.090505 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:03:30.090551 1503804 main.go:141] libmachine: Checking connection to Docker...
I0214 03:03:30.090564 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetURL
I0214 03:03:30.092103 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | Using libvirt version 6000000
I0214 03:03:30.094550 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.094943 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.094982 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.095126 1503804 main.go:141] libmachine: Docker is up and running!
I0214 03:03:30.095141 1503804 main.go:141] libmachine: Reticulating splines...
I0214 03:03:30.095149 1503804 client.go:171] duration metric: took 25.045445551s to LocalClient.Create
I0214 03:03:30.095184 1503804 start.go:167] duration metric: took 25.04552467s to libmachine.API.Create "ha-447944"
I0214 03:03:30.095198 1503804 start.go:293] postStartSetup for "ha-447944-m02" (driver="kvm2")
I0214 03:03:30.095215 1503804 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:03:30.095255 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.095514 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:03:30.095538 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:30.097900 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.098235 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.098264 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.098371 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:30.098566 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.098750 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:30.098900 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:03:30.190500 1503804 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:03:30.194831 1503804 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:03:30.194880 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:03:30.194972 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:03:30.195070 1503804 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:03:30.195083 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:03:30.195165 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:03:30.203237 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:03:30.226322 1503804 start.go:296] duration metric: took 131.103918ms for postStartSetup
I0214 03:03:30.226460 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetConfigRaw
I0214 03:03:30.227140 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:03:30.230278 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.230620 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.230648 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.230861 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:03:30.231100 1503804 start.go:128] duration metric: took 25.199582166s to createHost
I0214 03:03:30.231132 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:30.233520 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.233826 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.233857 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.233978 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:30.234171 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.234383 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.234555 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:30.234737 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:03:30.235068 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.218 22 <nil> <nil>}
I0214 03:03:30.235080 1503804 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:03:30.358150 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707879810.329974913
I0214 03:03:30.358177 1503804 fix.go:216] guest clock: 1707879810.329974913
I0214 03:03:30.358187 1503804 fix.go:229] Guest: 2024-02-14 03:03:30.329974913 +0000 UTC Remote: 2024-02-14 03:03:30.231115991 +0000 UTC m=+83.853319298 (delta=98.858922ms)
I0214 03:03:30.358207 1503804 fix.go:200] guest clock delta is within tolerance: 98.858922ms
I0214 03:03:30.358214 1503804 start.go:83] releasing machines lock for "ha-447944-m02", held for 25.326815322s
I0214 03:03:30.358253 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.358558 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:03:30.360977 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.361418 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.361453 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.363774 1503804 out.go:177] * Found network options:
I0214 03:03:30.365180 1503804 out.go:177] - NO_PROXY=192.168.39.41
W0214 03:03:30.366470 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
I0214 03:03:30.366500 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.367012 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.367187 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:03:30.367275 1503804 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:03:30.367322 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
W0214 03:03:30.367360 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
I0214 03:03:30.367449 1503804 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:03:30.367473 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:03:30.369918 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.370184 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.370309 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.370339 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.370499 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:30.370608 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:30.370636 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:30.370687 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.370774 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:03:30.370893 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:03:30.370893 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:30.371034 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:03:30.371118 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:03:30.371148 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:03:30.616761 1503804 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:03:30.622681 1503804 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:03:30.622764 1503804 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:03:30.638707 1503804 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 03:03:30.638735 1503804 start.go:494] detecting cgroup driver to use...
I0214 03:03:30.638811 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:03:30.658568 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:03:30.670605 1503804 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:03:30.670669 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:03:30.683968 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:03:30.696705 1503804 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:03:30.820632 1503804 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:03:30.938186 1503804 docker.go:233] disabling docker service ...
I0214 03:03:30.938277 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:03:30.952137 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:03:30.964393 1503804 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:03:31.082930 1503804 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:03:31.195491 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:03:31.208825 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:03:31.225923 1503804 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:03:31.225982 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:03:31.234946 1503804 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:03:31.235018 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:03:31.244101 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:03:31.253152 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:03:31.262045 1503804 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:03:31.273222 1503804 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:03:31.281572 1503804 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 03:03:31.281633 1503804 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 03:03:31.294588 1503804 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:03:31.302711 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:03:31.409573 1503804 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:03:31.579557 1503804 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:03:31.579627 1503804 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:03:31.584662 1503804 start.go:562] Will wait 60s for crictl version
I0214 03:03:31.584729 1503804 ssh_runner.go:195] Run: which crictl
I0214 03:03:31.588678 1503804 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:03:31.625336 1503804 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:03:31.625461 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:03:31.675299 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:03:31.724845 1503804 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:03:31.726313 1503804 out.go:177] - env NO_PROXY=192.168.39.41
I0214 03:03:31.727563 1503804 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:03:31.730296 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:31.730666 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:03:20 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:03:31.730695 1503804 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:03:31.730864 1503804 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:03:31.734983 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:03:31.747816 1503804 mustload.go:65] Loading cluster: ha-447944
I0214 03:03:31.748077 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:03:31.748364 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:31.748389 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:31.762867 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38927
I0214 03:03:31.763319 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:31.763794 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:31.763830 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:31.764153 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:31.764394 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:03:31.765977 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:03:31.766274 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:31.766301 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:31.780773 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45535
I0214 03:03:31.781236 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:31.781698 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:31.781724 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:31.782076 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:31.782276 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:03:31.782465 1503804 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944 for IP: 192.168.39.218
I0214 03:03:31.782480 1503804 certs.go:194] generating shared ca certs ...
I0214 03:03:31.782502 1503804 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:31.782643 1503804 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:03:31.782684 1503804 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:03:31.782694 1503804 certs.go:256] generating profile certs ...
I0214 03:03:31.782764 1503804 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key
I0214 03:03:31.782789 1503804 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.b3c69853
I0214 03:03:31.782803 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.b3c69853 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41 192.168.39.218 192.168.39.254]
I0214 03:03:31.969249 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.b3c69853 ...
I0214 03:03:31.969289 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.b3c69853: {Name:mk77b55ff6268bf8a98f0bc8d28204b4921fada3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:31.969456 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.b3c69853 ...
I0214 03:03:31.969469 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.b3c69853: {Name:mke73c8660d06807ef7f111701b87ad0d3af8c6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:03:31.969553 1503804 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.b3c69853 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt
I0214 03:03:31.969673 1503804 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.b3c69853 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key
I0214 03:03:31.969800 1503804 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key
I0214 03:03:31.969818 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:03:31.969830 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:03:31.969844 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:03:31.969857 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:03:31.969867 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:03:31.969879 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:03:31.969891 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:03:31.969902 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:03:31.969952 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:03:31.969986 1503804 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:03:31.969996 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:03:31.970027 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:03:31.970048 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:03:31.970069 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:03:31.970104 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:03:31.970130 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:03:31.970144 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:03:31.970161 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:03:31.970197 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:03:31.973605 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:31.974133 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:03:31.974158 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:31.974342 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:03:31.974553 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:03:31.974725 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:03:31.974870 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:03:32.061614 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub
I0214 03:03:32.068170 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
I0214 03:03:32.079272 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key
I0214 03:03:32.083631 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)
I0214 03:03:32.094654 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt
I0214 03:03:32.099002 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
I0214 03:03:32.110043 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key
I0214 03:03:32.114222 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)
I0214 03:03:32.124973 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt
I0214 03:03:32.128927 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
I0214 03:03:32.138123 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key
I0214 03:03:32.142696 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
I0214 03:03:32.152769 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:03:32.176737 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:03:32.199900 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:03:32.223148 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:03:32.245388 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
I0214 03:03:32.268405 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 03:03:32.290627 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:03:32.312575 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:03:32.335399 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:03:32.358071 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:03:32.380938 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:03:32.402946 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
I0214 03:03:32.418921 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)
I0214 03:03:32.434547 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
I0214 03:03:32.449355 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)
I0214 03:03:32.464432 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
I0214 03:03:32.479858 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
I0214 03:03:32.495050 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
I0214 03:03:32.510762 1503804 ssh_runner.go:195] Run: openssl version
I0214 03:03:32.516081 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:03:32.525012 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:03:32.529330 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:03:32.529383 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:03:32.534680 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:03:32.543641 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:03:32.553860 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:03:32.558324 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:03:32.558378 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:03:32.563677 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:03:32.572839 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:03:32.582011 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:03:32.586326 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:03:32.586378 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:03:32.591668 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:03:32.600687 1503804 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:03:32.604688 1503804 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 03:03:32.604747 1503804 kubeadm.go:928] updating node {m02 192.168.39.218 8443 v1.28.4 crio true true} ...
I0214 03:03:32.604860 1503804 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-447944-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.218
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:03:32.604887 1503804 kube-vip.go:101] generating kube-vip config ...
I0214 03:03:32.604917 1503804 kube-vip.go:121] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_ddns
value: "false"
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v0.7.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0214 03:03:32.604949 1503804 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:03:32.612704 1503804 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.28.4: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.28.4': No such file or directory
Initiating transfer...
I0214 03:03:32.612750 1503804 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.28.4
I0214 03:03:32.620724 1503804 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubectl.sha256
I0214 03:03:32.620749 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubectl -> /var/lib/minikube/binaries/v1.28.4/kubectl
I0214 03:03:32.620803 1503804 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet
I0214 03:03:32.620826 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubectl
I0214 03:03:32.620852 1503804 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm
I0214 03:03:32.628360 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubectl: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubectl': No such file or directory
I0214 03:03:32.628399 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubectl --> /var/lib/minikube/binaries/v1.28.4/kubectl (49885184 bytes)
I0214 03:03:33.360323 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm -> /var/lib/minikube/binaries/v1.28.4/kubeadm
I0214 03:03:33.360413 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubeadm
I0214 03:03:33.366277 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubeadm: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubeadm': No such file or directory
I0214 03:03:33.366317 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm --> /var/lib/minikube/binaries/v1.28.4/kubeadm (49102848 bytes)
I0214 03:03:33.880992 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:03:33.894244 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet -> /var/lib/minikube/binaries/v1.28.4/kubelet
I0214 03:03:33.894359 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubelet
I0214 03:03:33.898841 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubelet: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubelet': No such file or directory
I0214 03:03:33.898884 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet --> /var/lib/minikube/binaries/v1.28.4/kubelet (110850048 bytes)
I0214 03:03:34.426596 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
I0214 03:03:34.435201 1503804 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)
I0214 03:03:34.451103 1503804 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:03:34.466509 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1265 bytes)
I0214 03:03:34.483014 1503804 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0214 03:03:34.486856 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:03:34.499243 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:03:34.607695 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:03:34.623817 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:03:34.624253 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:03:34.624289 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:03:34.639230 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33639
I0214 03:03:34.639780 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:03:34.640305 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:03:34.640335 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:03:34.640777 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:03:34.641034 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:03:34.641210 1503804 start.go:316] joinCluster: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cluster
Name:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration
:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:03:34.641355 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm token create --print-join-command --ttl=0"
I0214 03:03:34.641384 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:03:34.644101 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:34.644528 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:03:34.644578 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:03:34.644735 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:03:34.644934 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:03:34.645109 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:03:34.645309 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:03:34.820814 1503804 start.go:342] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:03:34.820866 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm join control-plane.minikube.internal:8443 --token z4245n.isjg1bnvaxsd3tea --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-447944-m02 --control-plane --apiserver-advertise-address=192.168.39.218 --apiserver-bind-port=8443"
I0214 03:04:17.162207 1503804 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm join control-plane.minikube.internal:8443 --token z4245n.isjg1bnvaxsd3tea --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-447944-m02 --control-plane --apiserver-advertise-address=192.168.39.218 --apiserver-bind-port=8443": (42.341303783s)
I0214 03:04:17.162264 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
I0214 03:04:17.636529 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-447944-m02 minikube.k8s.io/updated_at=2024_02_14T03_04_17_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=ha-447944 minikube.k8s.io/primary=false
I0214 03:04:17.784809 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-447944-m02 node-role.kubernetes.io/control-plane:NoSchedule-
I0214 03:04:17.914278 1503804 start.go:318] duration metric: took 43.273055212s to joinCluster
I0214 03:04:17.914385 1503804 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:04:17.917214 1503804 out.go:177] * Verifying Kubernetes components...
I0214 03:04:17.914705 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:04:17.918949 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:04:18.203103 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:04:18.240635 1503804 loader.go:395] Config loaded from file: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:04:18.240981 1503804 kapi.go:59] client config for ha-447944: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]strin
g(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
W0214 03:04:18.241119 1503804 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.41:8443
I0214 03:04:18.241456 1503804 node_ready.go:35] waiting up to 6m0s for node "ha-447944-m02" to be "Ready" ...
I0214 03:04:18.241579 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:18.241592 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:18.241603 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:18.241613 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:18.255676 1503804 round_trippers.go:574] Response Status: 200 OK in 14 milliseconds
I0214 03:04:18.742593 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:18.742618 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:18.742626 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:18.742633 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:18.747050 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:19.241745 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:19.241773 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:19.241784 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:19.241793 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:19.250946 1503804 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds
I0214 03:04:19.742470 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:19.742497 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:19.742509 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:19.742517 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:19.755299 1503804 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds
I0214 03:04:20.242587 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:20.242616 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:20.242634 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:20.242641 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:20.247274 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:20.247978 1503804 node_ready.go:53] node "ha-447944-m02" has status "Ready":"False"
I0214 03:04:20.742315 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:20.742349 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:20.742361 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:20.742370 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:20.746157 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:21.242328 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:21.242360 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:21.242370 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:21.242385 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:21.246567 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:21.742083 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:21.742114 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:21.742127 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:21.742137 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:21.745678 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:22.242537 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:22.242562 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:22.242571 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:22.242577 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:22.247488 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:22.248365 1503804 node_ready.go:53] node "ha-447944-m02" has status "Ready":"False"
I0214 03:04:22.742699 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:22.742727 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:22.742740 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:22.742750 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:22.746544 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:23.241714 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:23.241744 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:23.241752 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:23.241758 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:23.246139 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:23.742384 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:23.742415 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:23.742428 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:23.742438 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:23.747144 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:24.242399 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:24.242430 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:24.242449 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:24.242460 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:24.247597 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:24.741749 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:24.741774 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:24.741783 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:24.741789 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:24.746754 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:24.747819 1503804 node_ready.go:53] node "ha-447944-m02" has status "Ready":"False"
I0214 03:04:25.241727 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:25.241750 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.241759 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.241766 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.247263 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:25.742518 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:25.742546 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.742555 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.742561 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.746678 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:25.747748 1503804 node_ready.go:49] node "ha-447944-m02" has status "Ready":"True"
I0214 03:04:25.747774 1503804 node_ready.go:38] duration metric: took 7.506292318s for node "ha-447944-m02" to be "Ready" ...
I0214 03:04:25.747787 1503804 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:04:25.747877 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:25.747890 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.747901 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.747910 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.753120 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:25.759699 1503804 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.759800 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-chs9l
I0214 03:04:25.759811 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.759822 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.759833 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.763363 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:25.764234 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:25.764252 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.764262 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.764269 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.774597 1503804 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds
I0214 03:04:25.775020 1503804 pod_ready.go:92] pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:25.775038 1503804 pod_ready.go:81] duration metric: took 15.316375ms for pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.775047 1503804 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.775124 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rpnsx
I0214 03:04:25.775134 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.775141 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.775147 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.782747 1503804 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds
I0214 03:04:25.783324 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:25.783338 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.783349 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.783377 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.788992 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:25.789567 1503804 pod_ready.go:92] pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:25.789596 1503804 pod_ready.go:81] duration metric: took 14.535895ms for pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.789608 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.789684 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944
I0214 03:04:25.789693 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.789700 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.789706 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.795886 1503804 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds
I0214 03:04:25.797439 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:25.797459 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.797470 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.797480 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.802132 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:25.803357 1503804 pod_ready.go:92] pod "etcd-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:25.803386 1503804 pod_ready.go:81] duration metric: took 13.763768ms for pod "etcd-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.803405 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.803479 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m02
I0214 03:04:25.803485 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.803496 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.803529 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.809192 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:25.809893 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:25.809913 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.809924 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.809934 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.816391 1503804 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds
I0214 03:04:25.816788 1503804 pod_ready.go:92] pod "etcd-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:25.816812 1503804 pod_ready.go:81] duration metric: took 13.396468ms for pod "etcd-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.816830 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:25.943268 1503804 request.go:629] Waited for 126.350377ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944
I0214 03:04:25.943350 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944
I0214 03:04:25.943356 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:25.943365 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:25.943371 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:25.947098 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:26.143243 1503804 request.go:629] Waited for 195.380547ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:26.143319 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:26.143326 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.143341 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.143360 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.147160 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:26.147713 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:26.147734 1503804 pod_ready.go:81] duration metric: took 330.893639ms for pod "kube-apiserver-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:26.147747 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:26.342985 1503804 request.go:629] Waited for 195.150246ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:26.343083 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:26.343093 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.343100 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.343107 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.347763 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:26.543246 1503804 request.go:629] Waited for 194.359317ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:26.543343 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:26.543356 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.543367 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.543377 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.549359 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:26.743201 1503804 request.go:629] Waited for 94.249579ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:26.743287 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:26.743297 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.743308 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.743322 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.750936 1503804 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds
I0214 03:04:26.943169 1503804 request.go:629] Waited for 190.664092ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:26.943247 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:26.943254 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:26.943266 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:26.943280 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:26.947742 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:27.148461 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:27.148491 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:27.148504 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:27.148514 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:27.152898 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:27.343015 1503804 request.go:629] Waited for 189.35968ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:27.343081 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:27.343085 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:27.343093 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:27.343100 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:27.348866 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:27.648575 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:27.648601 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:27.648610 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:27.648616 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:27.651978 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:27.742988 1503804 request.go:629] Waited for 90.257253ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:27.743055 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:27.743060 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:27.743067 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:27.743078 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:27.749784 1503804 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds
I0214 03:04:28.148299 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:04:28.148344 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.148352 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.148364 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.152002 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:28.152574 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:28.152590 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.152597 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.152603 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.155803 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:28.156313 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:28.156331 1503804 pod_ready.go:81] duration metric: took 2.008576982s for pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.156339 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.342722 1503804 request.go:629] Waited for 186.306919ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944
I0214 03:04:28.342807 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944
I0214 03:04:28.342812 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.342820 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.342827 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.347287 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:28.542677 1503804 request.go:629] Waited for 194.300509ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:28.542746 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:28.542750 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.542759 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.542769 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.547329 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:28.548103 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:28.548121 1503804 pod_ready.go:81] duration metric: took 391.775783ms for pod "kube-controller-manager-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.548131 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.743187 1503804 request.go:629] Waited for 194.970706ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m02
I0214 03:04:28.743274 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m02
I0214 03:04:28.743279 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.743288 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.743294 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.747878 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:28.942951 1503804 request.go:629] Waited for 194.39297ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:28.943024 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:28.943029 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:28.943037 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:28.943043 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:28.946853 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:28.947284 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:28.947303 1503804 pod_ready.go:81] duration metric: took 399.166234ms for pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:28.947318 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9cjk2" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.143434 1503804 request.go:629] Waited for 196.006984ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9cjk2
I0214 03:04:29.143539 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9cjk2
I0214 03:04:29.143548 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.143559 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.143573 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.147344 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:29.343380 1503804 request.go:629] Waited for 195.361602ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:29.343472 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:29.343483 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.343503 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.343516 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.347583 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:29.348299 1503804 pod_ready.go:92] pod "kube-proxy-9cjk2" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:29.348319 1503804 pod_ready.go:81] duration metric: took 400.993478ms for pod "kube-proxy-9cjk2" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.348328 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dpm4f" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.543497 1503804 request.go:629] Waited for 195.093843ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-dpm4f
I0214 03:04:29.543584 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-dpm4f
I0214 03:04:29.543589 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.543601 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.543612 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.547856 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:29.742871 1503804 request.go:629] Waited for 194.27753ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:29.742947 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:29.742955 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.742964 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.742972 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.748569 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:29.749372 1503804 pod_ready.go:92] pod "kube-proxy-dpm4f" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:29.749391 1503804 pod_ready.go:81] duration metric: took 401.057276ms for pod "kube-proxy-dpm4f" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.749400 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:29.943457 1503804 request.go:629] Waited for 193.957943ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944
I0214 03:04:29.943532 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944
I0214 03:04:29.943540 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:29.943548 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:29.943556 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:29.947716 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:30.142789 1503804 request.go:629] Waited for 194.472356ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:30.142870 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:04:30.142877 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.142888 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.142905 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.147368 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:30.148421 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:30.148444 1503804 pod_ready.go:81] duration metric: took 399.035036ms for pod "kube-scheduler-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:04:30.148457 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:30.342567 1503804 request.go:629] Waited for 193.995385ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m02
I0214 03:04:30.342643 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m02
I0214 03:04:30.342652 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.342663 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.342690 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.348475 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:30.542571 1503804 request.go:629] Waited for 192.294127ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:30.542642 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:04:30.542649 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.542660 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.542674 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.547660 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:30.548393 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:04:30.548412 1503804 pod_ready.go:81] duration metric: took 399.94779ms for pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:04:30.548423 1503804 pod_ready.go:38] duration metric: took 4.800619194s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:04:30.548437 1503804 api_server.go:52] waiting for apiserver process to appear ...
I0214 03:04:30.548489 1503804 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:04:30.563925 1503804 api_server.go:72] duration metric: took 12.649472625s to wait for apiserver process to appear ...
I0214 03:04:30.563959 1503804 api_server.go:88] waiting for apiserver healthz status ...
I0214 03:04:30.563981 1503804 api_server.go:253] Checking apiserver healthz at https://192.168.39.41:8443/healthz ...
I0214 03:04:30.570502 1503804 api_server.go:279] https://192.168.39.41:8443/healthz returned 200:
ok
I0214 03:04:30.570577 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/version
I0214 03:04:30.570585 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.570592 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.570601 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.571780 1503804 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0214 03:04:30.571932 1503804 api_server.go:141] control plane version: v1.28.4
I0214 03:04:30.571957 1503804 api_server.go:131] duration metric: took 7.990678ms to wait for apiserver health ...
I0214 03:04:30.571967 1503804 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 03:04:30.743384 1503804 request.go:629] Waited for 171.333128ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:30.743463 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:30.743468 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.743476 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.743482 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.754475 1503804 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds
I0214 03:04:30.759922 1503804 system_pods.go:59] 17 kube-system pods found
I0214 03:04:30.759957 1503804 system_pods.go:61] "coredns-5dd5756b68-chs9l" [224031c4-3d57-4119-921f-0e3fcdceec9c] Running
I0214 03:04:30.759965 1503804 system_pods.go:61] "coredns-5dd5756b68-rpnsx" [cef2a300-e8ff-4099-a5c4-4906889e902c] Running
I0214 03:04:30.759971 1503804 system_pods.go:61] "etcd-ha-447944" [b9879f26-9700-4bee-8e37-f132f15a4582] Running
I0214 03:04:30.759976 1503804 system_pods.go:61] "etcd-ha-447944-m02" [7a7cc3b5-6f9d-42ef-926b-2644763f6072] Running
I0214 03:04:30.759985 1503804 system_pods.go:61] "kindnet-pjrmh" [5cc39f50-0de5-40b5-b670-b33acc977740] Running
I0214 03:04:30.759990 1503804 system_pods.go:61] "kindnet-xkmkd" [534c4261-88a5-4120-89c4-c94bdfb2be76] Running
I0214 03:04:30.759996 1503804 system_pods.go:61] "kube-apiserver-ha-447944" [d48bd5fd-0acd-438c-8b9b-625fcc96d2c0] Running
I0214 03:04:30.760002 1503804 system_pods.go:61] "kube-apiserver-ha-447944-m02" [b36af3a6-21cc-47ae-910d-443dea7db747] Running
I0214 03:04:30.760009 1503804 system_pods.go:61] "kube-controller-manager-ha-447944" [136c8014-5e6e-4af5-aa70-c041e62fb725] Running
I0214 03:04:30.760018 1503804 system_pods.go:61] "kube-controller-manager-ha-447944-m02" [f3bc1826-4323-4c0c-8255-855ffab6cf3d] Running
I0214 03:04:30.760023 1503804 system_pods.go:61] "kube-proxy-9cjk2" [87b6de90-7a92-4c40-bfe1-41353a81d40b] Running
I0214 03:04:30.760029 1503804 system_pods.go:61] "kube-proxy-dpm4f" [2e0eb813-44c4-4623-8789-d37194b83ecd] Running
I0214 03:04:30.760034 1503804 system_pods.go:61] "kube-scheduler-ha-447944" [39ba6921-10a6-4a43-8ecd-8afc7092ba98] Running
I0214 03:04:30.760039 1503804 system_pods.go:61] "kube-scheduler-ha-447944-m02" [f8de4bcd-f5ba-4172-a461-7c2cc73ea6f2] Running
I0214 03:04:30.760044 1503804 system_pods.go:61] "kube-vip-ha-447944" [8e505ede-4ac8-4482-97ba-08943265ce41] Running
I0214 03:04:30.760050 1503804 system_pods.go:61] "kube-vip-ha-447944-m02" [80c89449-01b1-414b-bf1a-c727d4b03e8d] Running
I0214 03:04:30.760057 1503804 system_pods.go:61] "storage-provisioner" [7da2937f-2d9b-40d4-a521-5bf4a2585de7] Running
I0214 03:04:30.760066 1503804 system_pods.go:74] duration metric: took 188.086947ms to wait for pod list to return data ...
I0214 03:04:30.760076 1503804 default_sa.go:34] waiting for default service account to be created ...
I0214 03:04:30.943563 1503804 request.go:629] Waited for 183.379135ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:04:30.943635 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:04:30.943639 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:30.943647 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:30.943653 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:30.948619 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:04:30.948926 1503804 default_sa.go:45] found service account: "default"
I0214 03:04:30.948949 1503804 default_sa.go:55] duration metric: took 188.864284ms for default service account to be created ...
I0214 03:04:30.948960 1503804 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 03:04:31.143433 1503804 request.go:629] Waited for 194.367116ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:31.143516 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:04:31.143526 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:31.143537 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:31.143548 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:31.148947 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:04:31.154025 1503804 system_pods.go:86] 17 kube-system pods found
I0214 03:04:31.154050 1503804 system_pods.go:89] "coredns-5dd5756b68-chs9l" [224031c4-3d57-4119-921f-0e3fcdceec9c] Running
I0214 03:04:31.154055 1503804 system_pods.go:89] "coredns-5dd5756b68-rpnsx" [cef2a300-e8ff-4099-a5c4-4906889e902c] Running
I0214 03:04:31.154061 1503804 system_pods.go:89] "etcd-ha-447944" [b9879f26-9700-4bee-8e37-f132f15a4582] Running
I0214 03:04:31.154065 1503804 system_pods.go:89] "etcd-ha-447944-m02" [7a7cc3b5-6f9d-42ef-926b-2644763f6072] Running
I0214 03:04:31.154070 1503804 system_pods.go:89] "kindnet-pjrmh" [5cc39f50-0de5-40b5-b670-b33acc977740] Running
I0214 03:04:31.154077 1503804 system_pods.go:89] "kindnet-xkmkd" [534c4261-88a5-4120-89c4-c94bdfb2be76] Running
I0214 03:04:31.154084 1503804 system_pods.go:89] "kube-apiserver-ha-447944" [d48bd5fd-0acd-438c-8b9b-625fcc96d2c0] Running
I0214 03:04:31.154088 1503804 system_pods.go:89] "kube-apiserver-ha-447944-m02" [b36af3a6-21cc-47ae-910d-443dea7db747] Running
I0214 03:04:31.154093 1503804 system_pods.go:89] "kube-controller-manager-ha-447944" [136c8014-5e6e-4af5-aa70-c041e62fb725] Running
I0214 03:04:31.154097 1503804 system_pods.go:89] "kube-controller-manager-ha-447944-m02" [f3bc1826-4323-4c0c-8255-855ffab6cf3d] Running
I0214 03:04:31.154102 1503804 system_pods.go:89] "kube-proxy-9cjk2" [87b6de90-7a92-4c40-bfe1-41353a81d40b] Running
I0214 03:04:31.154108 1503804 system_pods.go:89] "kube-proxy-dpm4f" [2e0eb813-44c4-4623-8789-d37194b83ecd] Running
I0214 03:04:31.154113 1503804 system_pods.go:89] "kube-scheduler-ha-447944" [39ba6921-10a6-4a43-8ecd-8afc7092ba98] Running
I0214 03:04:31.154120 1503804 system_pods.go:89] "kube-scheduler-ha-447944-m02" [f8de4bcd-f5ba-4172-a461-7c2cc73ea6f2] Running
I0214 03:04:31.154124 1503804 system_pods.go:89] "kube-vip-ha-447944" [8e505ede-4ac8-4482-97ba-08943265ce41] Running
I0214 03:04:31.154128 1503804 system_pods.go:89] "kube-vip-ha-447944-m02" [80c89449-01b1-414b-bf1a-c727d4b03e8d] Running
I0214 03:04:31.154132 1503804 system_pods.go:89] "storage-provisioner" [7da2937f-2d9b-40d4-a521-5bf4a2585de7] Running
I0214 03:04:31.154139 1503804 system_pods.go:126] duration metric: took 205.17312ms to wait for k8s-apps to be running ...
I0214 03:04:31.154147 1503804 system_svc.go:44] waiting for kubelet service to be running ....
I0214 03:04:31.154193 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:04:31.170383 1503804 system_svc.go:56] duration metric: took 16.229012ms WaitForService to wait for kubelet
I0214 03:04:31.170422 1503804 kubeadm.go:576] duration metric: took 13.255974288s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:04:31.170445 1503804 node_conditions.go:102] verifying NodePressure condition ...
I0214 03:04:31.342918 1503804 request.go:629] Waited for 172.369583ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes
I0214 03:04:31.343004 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes
I0214 03:04:31.343014 1503804 round_trippers.go:469] Request Headers:
I0214 03:04:31.343023 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:04:31.343031 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:04:31.346976 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:04:31.347797 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:04:31.347826 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:04:31.347842 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:04:31.347849 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:04:31.347855 1503804 node_conditions.go:105] duration metric: took 177.400006ms to run NodePressure ...
I0214 03:04:31.347870 1503804 start.go:240] waiting for startup goroutines ...
I0214 03:04:31.347906 1503804 start.go:254] writing updated cluster config ...
I0214 03:04:31.350431 1503804 out.go:177]
I0214 03:04:31.351944 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:04:31.352049 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:04:31.353902 1503804 out.go:177] * Starting "ha-447944-m03" control-plane node in "ha-447944" cluster
I0214 03:04:31.355167 1503804 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:04:31.355193 1503804 cache.go:56] Caching tarball of preloaded images
I0214 03:04:31.355291 1503804 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:04:31.355304 1503804 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:04:31.355414 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:04:31.355594 1503804 start.go:360] acquireMachinesLock for ha-447944-m03: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:04:31.355655 1503804 start.go:364] duration metric: took 39.081µs to acquireMachinesLock for "ha-447944-m03"
I0214 03:04:31.355680 1503804 start.go:93] Provisioning new machine with config: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-d
ns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimi
zations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:04:31.355778 1503804 start.go:125] createHost starting for "m03" (driver="kvm2")
I0214 03:04:31.357477 1503804 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0214 03:04:31.357579 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:04:31.357614 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:04:31.372497 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38061
I0214 03:04:31.372951 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:04:31.373473 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:04:31.373502 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:04:31.373894 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:04:31.374073 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetMachineName
I0214 03:04:31.374234 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:31.374403 1503804 start.go:159] libmachine.API.Create for "ha-447944" (driver="kvm2")
I0214 03:04:31.374433 1503804 client.go:168] LocalClient.Create starting
I0214 03:04:31.374462 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 03:04:31.374493 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:04:31.374509 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:04:31.374564 1503804 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 03:04:31.374582 1503804 main.go:141] libmachine: Decoding PEM data...
I0214 03:04:31.374594 1503804 main.go:141] libmachine: Parsing certificate...
I0214 03:04:31.374609 1503804 main.go:141] libmachine: Running pre-create checks...
I0214 03:04:31.374618 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .PreCreateCheck
I0214 03:04:31.374851 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetConfigRaw
I0214 03:04:31.375259 1503804 main.go:141] libmachine: Creating machine...
I0214 03:04:31.375275 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .Create
I0214 03:04:31.375466 1503804 main.go:141] libmachine: (ha-447944-m03) Creating KVM machine...
I0214 03:04:31.376773 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found existing default KVM network
I0214 03:04:31.376871 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found existing private KVM network mk-ha-447944
I0214 03:04:31.377053 1503804 main.go:141] libmachine: (ha-447944-m03) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03 ...
I0214 03:04:31.377079 1503804 main.go:141] libmachine: (ha-447944-m03) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 03:04:31.377181 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:31.377047 1504508 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:04:31.377289 1503804 main.go:141] libmachine: (ha-447944-m03) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 03:04:31.613659 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:31.613496 1504508 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa...
I0214 03:04:31.754507 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:31.754378 1504508 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/ha-447944-m03.rawdisk...
I0214 03:04:31.754538 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Writing magic tar header
I0214 03:04:31.754552 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Writing SSH key tar header
I0214 03:04:31.754687 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:31.754584 1504508 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03 ...
I0214 03:04:31.754764 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03
I0214 03:04:31.754787 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 03:04:31.754802 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03 (perms=drwx------)
I0214 03:04:31.754816 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 03:04:31.754831 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 03:04:31.754872 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 03:04:31.754912 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 03:04:31.754924 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:04:31.754978 1503804 main.go:141] libmachine: (ha-447944-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 03:04:31.755006 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 03:04:31.755022 1503804 main.go:141] libmachine: (ha-447944-m03) Creating domain...
I0214 03:04:31.755041 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 03:04:31.755055 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home/jenkins
I0214 03:04:31.755071 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Checking permissions on dir: /home
I0214 03:04:31.755086 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Skipping /home - not owner
I0214 03:04:31.755929 1503804 main.go:141] libmachine: (ha-447944-m03) define libvirt domain using xml:
I0214 03:04:31.755952 1503804 main.go:141] libmachine: (ha-447944-m03) <domain type='kvm'>
I0214 03:04:31.755962 1503804 main.go:141] libmachine: (ha-447944-m03) <name>ha-447944-m03</name>
I0214 03:04:31.755968 1503804 main.go:141] libmachine: (ha-447944-m03) <memory unit='MiB'>2200</memory>
I0214 03:04:31.755974 1503804 main.go:141] libmachine: (ha-447944-m03) <vcpu>2</vcpu>
I0214 03:04:31.755981 1503804 main.go:141] libmachine: (ha-447944-m03) <features>
I0214 03:04:31.755993 1503804 main.go:141] libmachine: (ha-447944-m03) <acpi/>
I0214 03:04:31.756009 1503804 main.go:141] libmachine: (ha-447944-m03) <apic/>
I0214 03:04:31.756021 1503804 main.go:141] libmachine: (ha-447944-m03) <pae/>
I0214 03:04:31.756029 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.756035 1503804 main.go:141] libmachine: (ha-447944-m03) </features>
I0214 03:04:31.756043 1503804 main.go:141] libmachine: (ha-447944-m03) <cpu mode='host-passthrough'>
I0214 03:04:31.756086 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.756112 1503804 main.go:141] libmachine: (ha-447944-m03) </cpu>
I0214 03:04:31.756123 1503804 main.go:141] libmachine: (ha-447944-m03) <os>
I0214 03:04:31.756141 1503804 main.go:141] libmachine: (ha-447944-m03) <type>hvm</type>
I0214 03:04:31.756154 1503804 main.go:141] libmachine: (ha-447944-m03) <boot dev='cdrom'/>
I0214 03:04:31.756166 1503804 main.go:141] libmachine: (ha-447944-m03) <boot dev='hd'/>
I0214 03:04:31.756179 1503804 main.go:141] libmachine: (ha-447944-m03) <bootmenu enable='no'/>
I0214 03:04:31.756187 1503804 main.go:141] libmachine: (ha-447944-m03) </os>
I0214 03:04:31.756194 1503804 main.go:141] libmachine: (ha-447944-m03) <devices>
I0214 03:04:31.756205 1503804 main.go:141] libmachine: (ha-447944-m03) <disk type='file' device='cdrom'>
I0214 03:04:31.756232 1503804 main.go:141] libmachine: (ha-447944-m03) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/boot2docker.iso'/>
I0214 03:04:31.756249 1503804 main.go:141] libmachine: (ha-447944-m03) <target dev='hdc' bus='scsi'/>
I0214 03:04:31.756262 1503804 main.go:141] libmachine: (ha-447944-m03) <readonly/>
I0214 03:04:31.756273 1503804 main.go:141] libmachine: (ha-447944-m03) </disk>
I0214 03:04:31.756287 1503804 main.go:141] libmachine: (ha-447944-m03) <disk type='file' device='disk'>
I0214 03:04:31.756301 1503804 main.go:141] libmachine: (ha-447944-m03) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 03:04:31.756318 1503804 main.go:141] libmachine: (ha-447944-m03) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/ha-447944-m03.rawdisk'/>
I0214 03:04:31.756334 1503804 main.go:141] libmachine: (ha-447944-m03) <target dev='hda' bus='virtio'/>
I0214 03:04:31.756346 1503804 main.go:141] libmachine: (ha-447944-m03) </disk>
I0214 03:04:31.756378 1503804 main.go:141] libmachine: (ha-447944-m03) <interface type='network'>
I0214 03:04:31.756392 1503804 main.go:141] libmachine: (ha-447944-m03) <source network='mk-ha-447944'/>
I0214 03:04:31.756401 1503804 main.go:141] libmachine: (ha-447944-m03) <model type='virtio'/>
I0214 03:04:31.756421 1503804 main.go:141] libmachine: (ha-447944-m03) </interface>
I0214 03:04:31.756442 1503804 main.go:141] libmachine: (ha-447944-m03) <interface type='network'>
I0214 03:04:31.756458 1503804 main.go:141] libmachine: (ha-447944-m03) <source network='default'/>
I0214 03:04:31.756471 1503804 main.go:141] libmachine: (ha-447944-m03) <model type='virtio'/>
I0214 03:04:31.756484 1503804 main.go:141] libmachine: (ha-447944-m03) </interface>
I0214 03:04:31.756496 1503804 main.go:141] libmachine: (ha-447944-m03) <serial type='pty'>
I0214 03:04:31.756507 1503804 main.go:141] libmachine: (ha-447944-m03) <target port='0'/>
I0214 03:04:31.756519 1503804 main.go:141] libmachine: (ha-447944-m03) </serial>
I0214 03:04:31.756542 1503804 main.go:141] libmachine: (ha-447944-m03) <console type='pty'>
I0214 03:04:31.756555 1503804 main.go:141] libmachine: (ha-447944-m03) <target type='serial' port='0'/>
I0214 03:04:31.756568 1503804 main.go:141] libmachine: (ha-447944-m03) </console>
I0214 03:04:31.756580 1503804 main.go:141] libmachine: (ha-447944-m03) <rng model='virtio'>
I0214 03:04:31.756595 1503804 main.go:141] libmachine: (ha-447944-m03) <backend model='random'>/dev/random</backend>
I0214 03:04:31.756608 1503804 main.go:141] libmachine: (ha-447944-m03) </rng>
I0214 03:04:31.756621 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.756629 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.756642 1503804 main.go:141] libmachine: (ha-447944-m03) </devices>
I0214 03:04:31.756654 1503804 main.go:141] libmachine: (ha-447944-m03) </domain>
I0214 03:04:31.756667 1503804 main.go:141] libmachine: (ha-447944-m03)
I0214 03:04:31.763871 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:62:3e:57 in network default
I0214 03:04:31.764439 1503804 main.go:141] libmachine: (ha-447944-m03) Ensuring networks are active...
I0214 03:04:31.764460 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:31.765314 1503804 main.go:141] libmachine: (ha-447944-m03) Ensuring network default is active
I0214 03:04:31.765607 1503804 main.go:141] libmachine: (ha-447944-m03) Ensuring network mk-ha-447944 is active
I0214 03:04:31.765954 1503804 main.go:141] libmachine: (ha-447944-m03) Getting domain xml...
I0214 03:04:31.766632 1503804 main.go:141] libmachine: (ha-447944-m03) Creating domain...
I0214 03:04:32.985140 1503804 main.go:141] libmachine: (ha-447944-m03) Waiting to get IP...
I0214 03:04:32.985872 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:32.986307 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:32.986400 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:32.986307 1504508 retry.go:31] will retry after 231.206952ms: waiting for machine to come up
I0214 03:04:33.219742 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:33.220329 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:33.220365 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:33.220258 1504508 retry.go:31] will retry after 328.180423ms: waiting for machine to come up
I0214 03:04:33.549698 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:33.550227 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:33.550264 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:33.550163 1504508 retry.go:31] will retry after 371.452955ms: waiting for machine to come up
I0214 03:04:33.923313 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:33.923793 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:33.923831 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:33.923704 1504508 retry.go:31] will retry after 385.703961ms: waiting for machine to come up
I0214 03:04:34.311384 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:34.311872 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:34.311909 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:34.311811 1504508 retry.go:31] will retry after 539.263627ms: waiting for machine to come up
I0214 03:04:34.853366 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:34.853810 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:34.853841 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:34.853744 1504508 retry.go:31] will retry after 651.069109ms: waiting for machine to come up
I0214 03:04:35.506508 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:35.506934 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:35.506956 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:35.506911 1504508 retry.go:31] will retry after 931.243329ms: waiting for machine to come up
I0214 03:04:36.439377 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:36.439840 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:36.439881 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:36.439803 1504508 retry.go:31] will retry after 937.425624ms: waiting for machine to come up
I0214 03:04:37.380044 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:37.380519 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:37.380550 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:37.380472 1504508 retry.go:31] will retry after 1.840284587s: waiting for machine to come up
I0214 03:04:39.223232 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:39.223698 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:39.223730 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:39.223635 1504508 retry.go:31] will retry after 1.807475488s: waiting for machine to come up
I0214 03:04:41.032873 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:41.033487 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:41.033526 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:41.033422 1504508 retry.go:31] will retry after 2.1212585s: waiting for machine to come up
I0214 03:04:43.156767 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:43.157431 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:43.157466 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:43.157399 1504508 retry.go:31] will retry after 3.177450242s: waiting for machine to come up
I0214 03:04:46.338803 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:46.339336 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:46.339368 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:46.339283 1504508 retry.go:31] will retry after 4.440671603s: waiting for machine to come up
I0214 03:04:50.785287 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:50.785808 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find current IP address of domain ha-447944-m03 in network mk-ha-447944
I0214 03:04:50.785843 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | I0214 03:04:50.785740 1504508 retry.go:31] will retry after 4.939727768s: waiting for machine to come up
I0214 03:04:55.727404 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.727832 1503804 main.go:141] libmachine: (ha-447944-m03) Found IP for machine: 192.168.39.133
I0214 03:04:55.727858 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has current primary IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.727872 1503804 main.go:141] libmachine: (ha-447944-m03) Reserving static IP address...
I0214 03:04:55.728267 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | unable to find host DHCP lease matching {name: "ha-447944-m03", mac: "52:54:00:2e:2c:af", ip: "192.168.39.133"} in network mk-ha-447944
I0214 03:04:55.806016 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Getting to WaitForSSH function...
I0214 03:04:55.806052 1503804 main.go:141] libmachine: (ha-447944-m03) Reserved static IP address: 192.168.39.133
I0214 03:04:55.806064 1503804 main.go:141] libmachine: (ha-447944-m03) Waiting for SSH to be available...
I0214 03:04:55.809012 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.809591 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:minikube Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:55.809628 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.809819 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Using SSH client type: external
I0214 03:04:55.809856 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa (-rw-------)
I0214 03:04:55.809922 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.133 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 03:04:55.809943 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | About to run SSH command:
I0214 03:04:55.809957 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | exit 0
I0214 03:04:55.909818 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | SSH cmd err, output: <nil>:
I0214 03:04:55.910170 1503804 main.go:141] libmachine: (ha-447944-m03) KVM machine creation complete!
I0214 03:04:55.910452 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetConfigRaw
I0214 03:04:55.911054 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:55.911289 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:55.911511 1503804 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 03:04:55.911527 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:04:55.913003 1503804 main.go:141] libmachine: Detecting operating system of created instance...
I0214 03:04:55.913024 1503804 main.go:141] libmachine: Waiting for SSH to be available...
I0214 03:04:55.913031 1503804 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 03:04:55.913038 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:55.915586 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.915974 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:55.916012 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:55.916133 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:55.916325 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:55.916491 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:55.916646 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:55.916819 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:55.917436 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:55.917454 1503804 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 03:04:56.052977 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:04:56.053011 1503804 main.go:141] libmachine: Detecting the provisioner...
I0214 03:04:56.053025 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.056141 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.056546 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.056580 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.056758 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.056982 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.057160 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.057347 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.057549 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:56.057883 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:56.057897 1503804 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 03:04:56.198380 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:04:56.198507 1503804 main.go:141] libmachine: found compatible host: buildroot
I0214 03:04:56.198532 1503804 main.go:141] libmachine: Provisioning with buildroot...
I0214 03:04:56.198561 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetMachineName
I0214 03:04:56.198896 1503804 buildroot.go:166] provisioning hostname "ha-447944-m03"
I0214 03:04:56.198934 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetMachineName
I0214 03:04:56.199148 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.202348 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.202788 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.202816 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.202986 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.203193 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.203379 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.203520 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.203747 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:56.204073 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:56.204087 1503804 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-447944-m03 && echo "ha-447944-m03" | sudo tee /etc/hostname
I0214 03:04:56.350529 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944-m03
I0214 03:04:56.350563 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.353678 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.354211 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.354240 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.354453 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.354703 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.354873 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.355068 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.355237 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:56.355694 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:56.355725 1503804 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-447944-m03' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-447944-m03/g' /etc/hosts;
else
echo '127.0.1.1 ha-447944-m03' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:04:56.499722 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:04:56.499800 1503804 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:04:56.499899 1503804 buildroot.go:174] setting up certificates
I0214 03:04:56.499945 1503804 provision.go:84] configureAuth start
I0214 03:04:56.499975 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetMachineName
I0214 03:04:56.500291 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:04:56.503319 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.503718 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.503751 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.503926 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.506405 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.506818 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.506848 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.507050 1503804 provision.go:143] copyHostCerts
I0214 03:04:56.507096 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:04:56.507129 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:04:56.507138 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:04:56.507210 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:04:56.507284 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:04:56.507301 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:04:56.507308 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:04:56.507334 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:04:56.507384 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:04:56.507401 1503804 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:04:56.507407 1503804 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:04:56.507429 1503804 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:04:56.507483 1503804 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ha-447944-m03 san=[127.0.0.1 192.168.39.133 ha-447944-m03 localhost minikube]
I0214 03:04:56.687635 1503804 provision.go:177] copyRemoteCerts
I0214 03:04:56.687698 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:04:56.687722 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.690531 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.690875 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.690921 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.691059 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.691314 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.691543 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.691733 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:04:56.790228 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:04:56.790314 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0214 03:04:56.816182 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:04:56.816248 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 03:04:56.838278 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:04:56.838355 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:04:56.861954 1503804 provision.go:87] duration metric: took 361.990462ms to configureAuth
I0214 03:04:56.861990 1503804 buildroot.go:189] setting minikube options for container-runtime
I0214 03:04:56.862231 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:04:56.862334 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:56.865587 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.865956 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:56.865994 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:56.866194 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:56.866430 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.866645 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:56.866826 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:56.867080 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:56.867405 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:56.867427 1503804 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:04:57.196183 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:04:57.196213 1503804 main.go:141] libmachine: Checking connection to Docker...
I0214 03:04:57.196222 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetURL
I0214 03:04:57.197525 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | Using libvirt version 6000000
I0214 03:04:57.199996 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.200397 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.200424 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.200623 1503804 main.go:141] libmachine: Docker is up and running!
I0214 03:04:57.200647 1503804 main.go:141] libmachine: Reticulating splines...
I0214 03:04:57.200658 1503804 client.go:171] duration metric: took 25.826216301s to LocalClient.Create
I0214 03:04:57.200688 1503804 start.go:167] duration metric: took 25.826285624s to libmachine.API.Create "ha-447944"
I0214 03:04:57.200700 1503804 start.go:293] postStartSetup for "ha-447944-m03" (driver="kvm2")
I0214 03:04:57.200719 1503804 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:04:57.200743 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.201048 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:04:57.201084 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:57.203493 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.203831 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.203860 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.203927 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:57.204139 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.204328 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:57.204504 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:04:57.302762 1503804 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:04:57.307252 1503804 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:04:57.307280 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:04:57.307343 1503804 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:04:57.307419 1503804 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:04:57.307429 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:04:57.307514 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:04:57.316667 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:04:57.339187 1503804 start.go:296] duration metric: took 138.467672ms for postStartSetup
I0214 03:04:57.339248 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetConfigRaw
I0214 03:04:57.339926 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:04:57.342531 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.342920 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.342949 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.343186 1503804 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:04:57.343405 1503804 start.go:128] duration metric: took 25.98761485s to createHost
I0214 03:04:57.343428 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:57.345718 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.346055 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.346074 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.346243 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:57.346418 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.346571 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.346737 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:57.346879 1503804 main.go:141] libmachine: Using SSH client type: native
I0214 03:04:57.347186 1503804 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.133 22 <nil> <nil>}
I0214 03:04:57.347196 1503804 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:04:57.482449 1503804 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707879897.465586791
I0214 03:04:57.482484 1503804 fix.go:216] guest clock: 1707879897.465586791
I0214 03:04:57.482495 1503804 fix.go:229] Guest: 2024-02-14 03:04:57.465586791 +0000 UTC Remote: 2024-02-14 03:04:57.343417122 +0000 UTC m=+170.965620422 (delta=122.169669ms)
I0214 03:04:57.482518 1503804 fix.go:200] guest clock delta is within tolerance: 122.169669ms
I0214 03:04:57.482538 1503804 start.go:83] releasing machines lock for "ha-447944-m03", held for 26.126856879s
I0214 03:04:57.482566 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.482885 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:04:57.485974 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.486404 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.486429 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.489049 1503804 out.go:177] * Found network options:
I0214 03:04:57.490678 1503804 out.go:177] - NO_PROXY=192.168.39.41,192.168.39.218
W0214 03:04:57.492366 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
W0214 03:04:57.492395 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
I0214 03:04:57.492414 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.493080 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.493317 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:04:57.493424 1503804 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:04:57.493469 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
W0214 03:04:57.493492 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
W0214 03:04:57.493516 1503804 proxy.go:119] fail to check proxy env: Error ip not in block
I0214 03:04:57.493583 1503804 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:04:57.493633 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:04:57.496442 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.496734 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.496950 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.496976 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.497163 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:57.497193 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:57.497219 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:57.497350 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.497445 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:04:57.497536 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:57.497618 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:04:57.497697 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:04:57.497794 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:04:57.497968 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:04:57.753773 1503804 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:04:57.759578 1503804 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:04:57.759653 1503804 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:04:57.774954 1503804 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 03:04:57.774977 1503804 start.go:494] detecting cgroup driver to use...
I0214 03:04:57.775043 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:04:57.793982 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:04:57.807458 1503804 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:04:57.807524 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:04:57.820908 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:04:57.834126 1503804 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:04:57.951122 1503804 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:04:58.067897 1503804 docker.go:233] disabling docker service ...
I0214 03:04:58.067965 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:04:58.082392 1503804 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:04:58.093653 1503804 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:04:58.211315 1503804 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:04:58.335852 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:04:58.349955 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:04:58.368796 1503804 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:04:58.368877 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:04:58.378423 1503804 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:04:58.378502 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:04:58.387764 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:04:58.396856 1503804 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:04:58.406073 1503804 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:04:58.415892 1503804 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:04:58.424179 1503804 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 03:04:58.424235 1503804 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 03:04:58.437377 1503804 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:04:58.445669 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:04:58.561727 1503804 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:04:58.743858 1503804 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:04:58.743957 1503804 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:04:58.749202 1503804 start.go:562] Will wait 60s for crictl version
I0214 03:04:58.749289 1503804 ssh_runner.go:195] Run: which crictl
I0214 03:04:58.753577 1503804 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:04:58.796883 1503804 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:04:58.796991 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:04:58.848076 1503804 ssh_runner.go:195] Run: crio --version
I0214 03:04:58.904953 1503804 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:04:58.906624 1503804 out.go:177] - env NO_PROXY=192.168.39.41
I0214 03:04:58.908343 1503804 out.go:177] - env NO_PROXY=192.168.39.41,192.168.39.218
I0214 03:04:58.909969 1503804 main.go:141] libmachine: (ha-447944-m03) Calling .GetIP
I0214 03:04:58.913103 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:58.913674 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:04:58.913710 1503804 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:04:58.913903 1503804 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:04:58.918407 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:04:58.931995 1503804 mustload.go:65] Loading cluster: ha-447944
I0214 03:04:58.932249 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:04:58.932540 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:04:58.932597 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:04:58.949409 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34805
I0214 03:04:58.949947 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:04:58.950440 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:04:58.950466 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:04:58.950808 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:04:58.951061 1503804 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:04:58.952823 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:04:58.953209 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:04:58.953276 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:04:58.969332 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36187
I0214 03:04:58.969758 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:04:58.970353 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:04:58.970394 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:04:58.970749 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:04:58.970957 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:04:58.971122 1503804 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944 for IP: 192.168.39.133
I0214 03:04:58.971137 1503804 certs.go:194] generating shared ca certs ...
I0214 03:04:58.971194 1503804 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:04:58.971345 1503804 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:04:58.971394 1503804 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:04:58.971407 1503804 certs.go:256] generating profile certs ...
I0214 03:04:58.971516 1503804 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key
I0214 03:04:58.971547 1503804 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.3a606c76
I0214 03:04:58.971564 1503804 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.3a606c76 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41 192.168.39.218 192.168.39.133 192.168.39.254]
I0214 03:04:59.220510 1503804 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.3a606c76 ...
I0214 03:04:59.220549 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.3a606c76: {Name:mk805b6f304bd194a1321a4575b34094c01fa699 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:04:59.220755 1503804 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.3a606c76 ...
I0214 03:04:59.220769 1503804 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.3a606c76: {Name:mk60b7ba845904cfe971c4063495cbf9fbaf9905 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:04:59.220848 1503804 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.3a606c76 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt
I0214 03:04:59.221001 1503804 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.3a606c76 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key
I0214 03:04:59.221143 1503804 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key
I0214 03:04:59.221165 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:04:59.221182 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:04:59.221197 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:04:59.221213 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:04:59.221225 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:04:59.221239 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:04:59.221275 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:04:59.221290 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:04:59.221356 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:04:59.221387 1503804 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:04:59.221402 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:04:59.221432 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:04:59.221459 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:04:59.221484 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:04:59.221526 1503804 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:04:59.221556 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:04:59.221572 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:04:59.221588 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:04:59.221627 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:04:59.224880 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:04:59.225348 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:04:59.225404 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:04:59.225527 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:04:59.225734 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:04:59.225927 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:04:59.226109 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:04:59.309626 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub
I0214 03:04:59.316586 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
I0214 03:04:59.328547 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key
I0214 03:04:59.332884 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)
I0214 03:04:59.342552 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt
I0214 03:04:59.347190 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
I0214 03:04:59.359716 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key
I0214 03:04:59.364194 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)
I0214 03:04:59.374190 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt
I0214 03:04:59.378330 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
I0214 03:04:59.388203 1503804 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key
I0214 03:04:59.392789 1503804 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
I0214 03:04:59.403942 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:04:59.429552 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:04:59.452429 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:04:59.475620 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:04:59.501056 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)
I0214 03:04:59.525594 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 03:04:59.550003 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:04:59.572951 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:04:59.596226 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:04:59.621159 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:04:59.644773 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:04:59.668889 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
I0214 03:04:59.684765 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)
I0214 03:04:59.700761 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
I0214 03:04:59.716083 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)
I0214 03:04:59.732131 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
I0214 03:04:59.747655 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
I0214 03:04:59.762701 1503804 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
I0214 03:04:59.777808 1503804 ssh_runner.go:195] Run: openssl version
I0214 03:04:59.783105 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:04:59.792199 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:04:59.796960 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:04:59.797030 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:04:59.802740 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:04:59.813125 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:04:59.822502 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:04:59.827104 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:04:59.827147 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:04:59.833177 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:04:59.843743 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:04:59.854374 1503804 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:04:59.859111 1503804 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:04:59.859165 1503804 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:04:59.864699 1503804 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:04:59.874218 1503804 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:04:59.878086 1503804 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 03:04:59.878140 1503804 kubeadm.go:928] updating node {m03 192.168.39.133 8443 v1.28.4 crio true true} ...
I0214 03:04:59.878230 1503804 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-447944-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.133
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:04:59.878276 1503804 kube-vip.go:101] generating kube-vip config ...
I0214 03:04:59.878302 1503804 kube-vip.go:121] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_ddns
value: "false"
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v0.7.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0214 03:04:59.878337 1503804 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:04:59.886487 1503804 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.28.4: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.28.4': No such file or directory
Initiating transfer...
I0214 03:04:59.886554 1503804 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.28.4
I0214 03:04:59.895014 1503804 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubectl.sha256
I0214 03:04:59.895038 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubectl -> /var/lib/minikube/binaries/v1.28.4/kubectl
I0214 03:04:59.895041 1503804 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubeadm.sha256
I0214 03:04:59.895041 1503804 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/linux/amd64/kubelet.sha256
I0214 03:04:59.895061 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm -> /var/lib/minikube/binaries/v1.28.4/kubeadm
I0214 03:04:59.895096 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubectl
I0214 03:04:59.895137 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:04:59.895154 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubeadm
I0214 03:04:59.904085 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubectl: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubectl': No such file or directory
I0214 03:04:59.904114 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubectl --> /var/lib/minikube/binaries/v1.28.4/kubectl (49885184 bytes)
I0214 03:04:59.909938 1503804 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet -> /var/lib/minikube/binaries/v1.28.4/kubelet
I0214 03:04:59.909978 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubeadm: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubeadm': No such file or directory
I0214 03:04:59.910011 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubeadm --> /var/lib/minikube/binaries/v1.28.4/kubeadm (49102848 bytes)
I0214 03:04:59.910023 1503804 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubelet
I0214 03:04:59.951100 1503804 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.28.4/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.28.4/kubelet: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.28.4/kubelet': No such file or directory
I0214 03:04:59.951139 1503804 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.28.4/kubelet --> /var/lib/minikube/binaries/v1.28.4/kubelet (110850048 bytes)
I0214 03:05:00.780613 1503804 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
I0214 03:05:00.790380 1503804 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)
I0214 03:05:00.806724 1503804 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:05:00.823575 1503804 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1265 bytes)
I0214 03:05:00.840021 1503804 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0214 03:05:00.844054 1503804 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:05:00.855678 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:05:00.973446 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:05:00.989381 1503804 host.go:66] Checking if "ha-447944" exists ...
I0214 03:05:00.989762 1503804 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:05:00.989806 1503804 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:05:01.004600 1503804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35847
I0214 03:05:01.005109 1503804 main.go:141] libmachine: () Calling .GetVersion
I0214 03:05:01.005659 1503804 main.go:141] libmachine: Using API Version 1
I0214 03:05:01.005689 1503804 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:05:01.006081 1503804 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:05:01.006296 1503804 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:05:01.006482 1503804 start.go:316] joinCluster: &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cluster
Name:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false i
nspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fa
lse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:05:01.006649 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm token create --print-join-command --ttl=0"
I0214 03:05:01.006677 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:05:01.010223 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:05:01.010705 1503804 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:05:01.010738 1503804 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:05:01.010909 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:05:01.011130 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:05:01.011302 1503804 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:05:01.011461 1503804 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:05:01.206354 1503804 start.go:342] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:05:01.206398 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm join control-plane.minikube.internal:8443 --token fk9mvz.ya6fw7u33bxwi51m --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-447944-m03 --control-plane --apiserver-advertise-address=192.168.39.133 --apiserver-bind-port=8443"
I0214 03:05:31.831546 1503804 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm join control-plane.minikube.internal:8443 --token fk9mvz.ya6fw7u33bxwi51m --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-447944-m03 --control-plane --apiserver-advertise-address=192.168.39.133 --apiserver-bind-port=8443": (30.625111543s)
I0214 03:05:31.831601 1503804 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
I0214 03:05:32.351229 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-447944-m03 minikube.k8s.io/updated_at=2024_02_14T03_05_32_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=ha-447944 minikube.k8s.io/primary=false
I0214 03:05:32.500973 1503804 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-447944-m03 node-role.kubernetes.io/control-plane:NoSchedule-
I0214 03:05:32.643802 1503804 start.go:318] duration metric: took 31.637304929s to joinCluster
I0214 03:05:32.643952 1503804 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:05:32.645690 1503804 out.go:177] * Verifying Kubernetes components...
I0214 03:05:32.644304 1503804 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:05:32.647101 1503804 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:05:32.909964 1503804 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:05:32.928628 1503804 loader.go:395] Config loaded from file: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:05:32.928877 1503804 kapi.go:59] client config for ha-447944: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]strin
g(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
W0214 03:05:32.928957 1503804 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.41:8443
I0214 03:05:32.929189 1503804 node_ready.go:35] waiting up to 6m0s for node "ha-447944-m03" to be "Ready" ...
I0214 03:05:32.929303 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:32.929312 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:32.929320 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:32.929326 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:32.934053 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:33.430283 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:33.430314 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:33.430327 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:33.430335 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:33.434481 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:33.929483 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:33.929513 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:33.929525 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:33.929536 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:33.934711 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:34.429487 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:34.429519 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:34.429536 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:34.429545 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:34.434761 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:34.930319 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:34.930354 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:34.930366 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:34.930375 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:34.935203 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:34.936276 1503804 node_ready.go:53] node "ha-447944-m03" has status "Ready":"False"
I0214 03:05:35.430064 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:35.430088 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:35.430097 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:35.430103 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:35.433577 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:35.929463 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:35.929492 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:35.929503 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:35.929512 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:35.933411 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:36.429709 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:36.431085 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:36.431106 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:36.431117 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:36.435689 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:36.930172 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:36.930202 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:36.930215 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:36.930233 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:36.933964 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:37.430213 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:37.430235 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:37.430243 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:37.430249 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:37.434881 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:37.436351 1503804 node_ready.go:53] node "ha-447944-m03" has status "Ready":"False"
I0214 03:05:37.929469 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:37.929513 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:37.929534 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:37.929541 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:37.933747 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:38.429461 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:38.429490 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:38.429503 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:38.429513 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:38.433922 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:38.930388 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:38.930422 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:38.930434 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:38.930443 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:38.934229 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.430291 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:39.430322 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.430333 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.430343 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.435510 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:39.929823 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:39.929850 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.929857 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.929864 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.934204 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:39.934774 1503804 node_ready.go:49] node "ha-447944-m03" has status "Ready":"True"
I0214 03:05:39.934796 1503804 node_ready.go:38] duration metric: took 7.005591557s for node "ha-447944-m03" to be "Ready" ...
I0214 03:05:39.934806 1503804 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:05:39.934894 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:39.934907 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.934918 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.934931 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.943462 1503804 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds
I0214 03:05:39.951605 1503804 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.951695 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-chs9l
I0214 03:05:39.951709 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.951717 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.951722 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.955282 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.955991 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:39.956007 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.956015 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.956021 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.960383 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:39.961514 1503804 pod_ready.go:92] pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:39.961533 1503804 pod_ready.go:81] duration metric: took 9.903069ms for pod "coredns-5dd5756b68-chs9l" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.961543 1503804 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.961598 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/coredns-5dd5756b68-rpnsx
I0214 03:05:39.961605 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.961613 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.961621 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.965506 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.966906 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:39.966925 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.966932 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.966938 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.970379 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.971713 1503804 pod_ready.go:92] pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:39.971730 1503804 pod_ready.go:81] duration metric: took 10.181405ms for pod "coredns-5dd5756b68-rpnsx" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.971739 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.971800 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944
I0214 03:05:39.971809 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.971816 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.971824 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.977326 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:39.977844 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:39.977857 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.977864 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.977869 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.983271 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:39.983946 1503804 pod_ready.go:92] pod "etcd-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:39.983976 1503804 pod_ready.go:81] duration metric: took 12.230345ms for pod "etcd-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.983989 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.984059 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m02
I0214 03:05:39.984067 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.984074 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.984080 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.988573 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:39.989835 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:39.989849 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:39.989857 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:39.989862 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:39.993206 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:39.994370 1503804 pod_ready.go:92] pod "etcd-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:39.994394 1503804 pod_ready.go:81] duration metric: took 10.393577ms for pod "etcd-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:39.994406 1503804 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:40.130983 1503804 request.go:629] Waited for 136.474266ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:40.131095 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:40.131103 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.131114 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:40.131125 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.135382 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:40.330722 1503804 request.go:629] Waited for 194.381098ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:40.330817 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:40.330834 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.330845 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:40.330857 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.335067 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:40.530524 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:40.530558 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.530570 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:40.530580 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.540798 1503804 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds
I0214 03:05:40.730316 1503804 request.go:629] Waited for 188.386871ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:40.730415 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:40.730421 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.730438 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:40.730444 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.734514 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:40.995458 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:40.995484 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:40.995493 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:40.995499 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.000447 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:41.130730 1503804 request.go:629] Waited for 129.334873ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:41.131242 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:41.131322 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.131334 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.131346 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.136384 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:41.494892 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/etcd-ha-447944-m03
I0214 03:05:41.494916 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.494924 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.494931 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.499495 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:41.529916 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:41.529940 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.529952 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.529959 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.534090 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:41.534642 1503804 pod_ready.go:92] pod "etcd-ha-447944-m03" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:41.534662 1503804 pod_ready.go:81] duration metric: took 1.540246847s for pod "etcd-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:41.534692 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:41.730233 1503804 request.go:629] Waited for 195.410449ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944
I0214 03:05:41.730312 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944
I0214 03:05:41.730318 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.730325 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.730333 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.735497 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:41.930504 1503804 request.go:629] Waited for 194.037217ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:41.930592 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:41.930603 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:41.930617 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:41.930640 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:41.934264 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:41.934764 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:41.934784 1503804 pod_ready.go:81] duration metric: took 400.077766ms for pod "kube-apiserver-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:41.934794 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.129991 1503804 request.go:629] Waited for 195.090379ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:05:42.130087 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m02
I0214 03:05:42.130099 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.130112 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.130124 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.134428 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:42.330689 1503804 request.go:629] Waited for 195.426457ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:42.330791 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:42.330799 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.330811 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.330820 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.335217 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:42.336228 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:42.336257 1503804 pod_ready.go:81] duration metric: took 401.455111ms for pod "kube-apiserver-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.336271 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.530433 1503804 request.go:629] Waited for 194.069646ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m03
I0214 03:05:42.530541 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944-m03
I0214 03:05:42.530553 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.530564 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.530577 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.534575 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:42.730832 1503804 request.go:629] Waited for 195.372279ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:42.730899 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:42.730904 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.730914 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.730920 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.735002 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:42.735629 1503804 pod_ready.go:92] pod "kube-apiserver-ha-447944-m03" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:42.735651 1503804 pod_ready.go:81] duration metric: took 399.372275ms for pod "kube-apiserver-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.735663 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:42.930749 1503804 request.go:629] Waited for 195.003759ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944
I0214 03:05:42.930838 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944
I0214 03:05:42.930853 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:42.930862 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:42.930868 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:42.935037 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.130317 1503804 request.go:629] Waited for 194.445455ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:43.130408 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:43.130417 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.130433 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.130447 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.134549 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.135321 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:43.135350 1503804 pod_ready.go:81] duration metric: took 399.679407ms for pod "kube-controller-manager-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:43.135360 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:43.330505 1503804 request.go:629] Waited for 194.97349ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m02
I0214 03:05:43.330590 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m02
I0214 03:05:43.330599 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.330610 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.330624 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.335228 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.530465 1503804 request.go:629] Waited for 194.33279ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:43.530583 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:43.530594 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.530606 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.530618 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.535053 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.535633 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:43.535658 1503804 pod_ready.go:81] duration metric: took 400.290286ms for pod "kube-controller-manager-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:43.535668 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:43.730882 1503804 request.go:629] Waited for 195.123709ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m03
I0214 03:05:43.730970 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m03
I0214 03:05:43.730977 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.730991 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.731001 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.735220 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:43.930378 1503804 request.go:629] Waited for 194.399955ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:43.930478 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:43.930485 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:43.930496 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:43.930508 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:43.934312 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:44.130512 1503804 request.go:629] Waited for 94.313935ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m03
I0214 03:05:44.130595 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-447944-m03
I0214 03:05:44.130602 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.130613 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.130623 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.135107 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:44.330299 1503804 request.go:629] Waited for 194.442093ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:44.330387 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:44.330392 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.330401 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.330408 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.334465 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:44.335194 1503804 pod_ready.go:92] pod "kube-controller-manager-ha-447944-m03" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:44.335220 1503804 pod_ready.go:81] duration metric: took 799.54483ms for pod "kube-controller-manager-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:44.335230 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9cjk2" in "kube-system" namespace to be "Ready" ...
I0214 03:05:44.530759 1503804 request.go:629] Waited for 195.426151ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9cjk2
I0214 03:05:44.530858 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-9cjk2
I0214 03:05:44.530887 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.530898 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.530909 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.535038 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:44.730476 1503804 request.go:629] Waited for 194.566717ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:44.730556 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:44.730561 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.730571 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.730583 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.735465 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:44.736382 1503804 pod_ready.go:92] pod "kube-proxy-9cjk2" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:44.736417 1503804 pod_ready.go:81] duration metric: took 401.180862ms for pod "kube-proxy-9cjk2" in "kube-system" namespace to be "Ready" ...
I0214 03:05:44.736428 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dpm4f" in "kube-system" namespace to be "Ready" ...
I0214 03:05:44.930623 1503804 request.go:629] Waited for 194.118805ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-dpm4f
I0214 03:05:44.930706 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-dpm4f
I0214 03:05:44.930716 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:44.930727 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:44.930738 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:44.935262 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:45.130559 1503804 request.go:629] Waited for 194.419279ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:45.130626 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:45.130630 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.130638 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.130645 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.135159 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:45.136181 1503804 pod_ready.go:92] pod "kube-proxy-dpm4f" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:45.136222 1503804 pod_ready.go:81] duration metric: took 399.777167ms for pod "kube-proxy-dpm4f" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.136237 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-rz6vt" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.330230 1503804 request.go:629] Waited for 193.904155ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-rz6vt
I0214 03:05:45.330307 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-proxy-rz6vt
I0214 03:05:45.330315 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.330326 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.330335 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.334810 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:45.530157 1503804 request.go:629] Waited for 194.388263ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:45.530225 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:45.530234 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.530242 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.530252 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.534191 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:45.534904 1503804 pod_ready.go:92] pod "kube-proxy-rz6vt" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:45.534929 1503804 pod_ready.go:81] duration metric: took 398.68278ms for pod "kube-proxy-rz6vt" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.534942 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.730152 1503804 request.go:629] Waited for 195.104415ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944
I0214 03:05:45.730240 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944
I0214 03:05:45.730251 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.730263 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.730272 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.734034 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:45.929888 1503804 request.go:629] Waited for 195.292662ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:45.930008 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944
I0214 03:05:45.930020 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:45.930032 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:45.930042 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:45.934067 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:45.934790 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:45.934819 1503804 pod_ready.go:81] duration metric: took 399.86818ms for pod "kube-scheduler-ha-447944" in "kube-system" namespace to be "Ready" ...
I0214 03:05:45.934838 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:46.130325 1503804 request.go:629] Waited for 195.394801ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m02
I0214 03:05:46.130418 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m02
I0214 03:05:46.130423 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.130431 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.130438 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.134695 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:46.330461 1503804 request.go:629] Waited for 195.250466ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:46.330551 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m02
I0214 03:05:46.330564 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.330579 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.330595 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.335020 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:46.336067 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:46.336089 1503804 pod_ready.go:81] duration metric: took 401.239194ms for pod "kube-scheduler-ha-447944-m02" in "kube-system" namespace to be "Ready" ...
I0214 03:05:46.336102 1503804 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:46.530201 1503804 request.go:629] Waited for 193.991421ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m03
I0214 03:05:46.530302 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-447944-m03
I0214 03:05:46.530312 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.530320 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.530327 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.534170 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:46.730300 1503804 request.go:629] Waited for 195.206006ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:46.730375 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes/ha-447944-m03
I0214 03:05:46.730380 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.730388 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.730394 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.734407 1503804 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0214 03:05:46.735070 1503804 pod_ready.go:92] pod "kube-scheduler-ha-447944-m03" in "kube-system" namespace has status "Ready":"True"
I0214 03:05:46.735093 1503804 pod_ready.go:81] duration metric: took 398.984598ms for pod "kube-scheduler-ha-447944-m03" in "kube-system" namespace to be "Ready" ...
I0214 03:05:46.735107 1503804 pod_ready.go:38] duration metric: took 6.80028443s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:05:46.735128 1503804 api_server.go:52] waiting for apiserver process to appear ...
I0214 03:05:46.735203 1503804 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:05:46.751047 1503804 api_server.go:72] duration metric: took 14.107051273s to wait for apiserver process to appear ...
I0214 03:05:46.751081 1503804 api_server.go:88] waiting for apiserver healthz status ...
I0214 03:05:46.751113 1503804 api_server.go:253] Checking apiserver healthz at https://192.168.39.41:8443/healthz ...
I0214 03:05:46.756613 1503804 api_server.go:279] https://192.168.39.41:8443/healthz returned 200:
ok
I0214 03:05:46.756686 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/version
I0214 03:05:46.756691 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.756699 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.756706 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.758276 1503804 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0214 03:05:46.758408 1503804 api_server.go:141] control plane version: v1.28.4
I0214 03:05:46.758429 1503804 api_server.go:131] duration metric: took 7.341489ms to wait for apiserver health ...
I0214 03:05:46.758437 1503804 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 03:05:46.930585 1503804 request.go:629] Waited for 172.073514ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:46.930665 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:46.930670 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:46.930678 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:46.930684 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:46.938039 1503804 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds
I0214 03:05:46.945232 1503804 system_pods.go:59] 24 kube-system pods found
I0214 03:05:46.945275 1503804 system_pods.go:61] "coredns-5dd5756b68-chs9l" [224031c4-3d57-4119-921f-0e3fcdceec9c] Running
I0214 03:05:46.945285 1503804 system_pods.go:61] "coredns-5dd5756b68-rpnsx" [cef2a300-e8ff-4099-a5c4-4906889e902c] Running
I0214 03:05:46.945291 1503804 system_pods.go:61] "etcd-ha-447944" [b9879f26-9700-4bee-8e37-f132f15a4582] Running
I0214 03:05:46.945296 1503804 system_pods.go:61] "etcd-ha-447944-m02" [7a7cc3b5-6f9d-42ef-926b-2644763f6072] Running
I0214 03:05:46.945300 1503804 system_pods.go:61] "etcd-ha-447944-m03" [333b2788-49e2-4eb2-ab37-1bcf2e3a36b9] Running
I0214 03:05:46.945303 1503804 system_pods.go:61] "kindnet-pjrmh" [5cc39f50-0de5-40b5-b670-b33acc977740] Running
I0214 03:05:46.945307 1503804 system_pods.go:61] "kindnet-xkmkd" [534c4261-88a5-4120-89c4-c94bdfb2be76] Running
I0214 03:05:46.945311 1503804 system_pods.go:61] "kindnet-xwqhp" [f6cb2716-1303-433e-b2b7-53cc035ffc7a] Running
I0214 03:05:46.945315 1503804 system_pods.go:61] "kube-apiserver-ha-447944" [d48bd5fd-0acd-438c-8b9b-625fcc96d2c0] Running
I0214 03:05:46.945319 1503804 system_pods.go:61] "kube-apiserver-ha-447944-m02" [b36af3a6-21cc-47ae-910d-443dea7db747] Running
I0214 03:05:46.945323 1503804 system_pods.go:61] "kube-apiserver-ha-447944-m03" [e70600fa-8bc4-4321-b1d9-2f93d1c634a3] Running
I0214 03:05:46.945327 1503804 system_pods.go:61] "kube-controller-manager-ha-447944" [136c8014-5e6e-4af5-aa70-c041e62fb725] Running
I0214 03:05:46.945332 1503804 system_pods.go:61] "kube-controller-manager-ha-447944-m02" [f3bc1826-4323-4c0c-8255-855ffab6cf3d] Running
I0214 03:05:46.945337 1503804 system_pods.go:61] "kube-controller-manager-ha-447944-m03" [04928942-0b40-404f-9c46-53846956c358] Running
I0214 03:05:46.945343 1503804 system_pods.go:61] "kube-proxy-9cjk2" [87b6de90-7a92-4c40-bfe1-41353a81d40b] Running
I0214 03:05:46.945347 1503804 system_pods.go:61] "kube-proxy-dpm4f" [2e0eb813-44c4-4623-8789-d37194b83ecd] Running
I0214 03:05:46.945351 1503804 system_pods.go:61] "kube-proxy-rz6vt" [d396cc98-4175-4364-a84e-6e29c647be56] Running
I0214 03:05:46.945354 1503804 system_pods.go:61] "kube-scheduler-ha-447944" [39ba6921-10a6-4a43-8ecd-8afc7092ba98] Running
I0214 03:05:46.945358 1503804 system_pods.go:61] "kube-scheduler-ha-447944-m02" [f8de4bcd-f5ba-4172-a461-7c2cc73ea6f2] Running
I0214 03:05:46.945362 1503804 system_pods.go:61] "kube-scheduler-ha-447944-m03" [873867e0-f4fe-4450-95e8-860b2af6e116] Running
I0214 03:05:46.945365 1503804 system_pods.go:61] "kube-vip-ha-447944" [8e505ede-4ac8-4482-97ba-08943265ce41] Running
I0214 03:05:46.945372 1503804 system_pods.go:61] "kube-vip-ha-447944-m02" [80c89449-01b1-414b-bf1a-c727d4b03e8d] Running
I0214 03:05:46.945375 1503804 system_pods.go:61] "kube-vip-ha-447944-m03" [3ad2afab-b960-4b65-8357-2fd24e022ee4] Running
I0214 03:05:46.945381 1503804 system_pods.go:61] "storage-provisioner" [7da2937f-2d9b-40d4-a521-5bf4a2585de7] Running
I0214 03:05:46.945387 1503804 system_pods.go:74] duration metric: took 186.94533ms to wait for pod list to return data ...
I0214 03:05:46.945396 1503804 default_sa.go:34] waiting for default service account to be created ...
I0214 03:05:47.130887 1503804 request.go:629] Waited for 185.38484ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:05:47.130975 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:05:47.130984 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:47.130996 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:47.131011 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:47.135082 1503804 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0214 03:05:47.135267 1503804 default_sa.go:45] found service account: "default"
I0214 03:05:47.135287 1503804 default_sa.go:55] duration metric: took 189.883221ms for default service account to be created ...
I0214 03:05:47.135299 1503804 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 03:05:47.330768 1503804 request.go:629] Waited for 195.356807ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:47.330873 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/namespaces/kube-system/pods
I0214 03:05:47.330892 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:47.330908 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:47.330923 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:47.340805 1503804 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds
I0214 03:05:47.347992 1503804 system_pods.go:86] 24 kube-system pods found
I0214 03:05:47.348030 1503804 system_pods.go:89] "coredns-5dd5756b68-chs9l" [224031c4-3d57-4119-921f-0e3fcdceec9c] Running
I0214 03:05:47.348038 1503804 system_pods.go:89] "coredns-5dd5756b68-rpnsx" [cef2a300-e8ff-4099-a5c4-4906889e902c] Running
I0214 03:05:47.348045 1503804 system_pods.go:89] "etcd-ha-447944" [b9879f26-9700-4bee-8e37-f132f15a4582] Running
I0214 03:05:47.348052 1503804 system_pods.go:89] "etcd-ha-447944-m02" [7a7cc3b5-6f9d-42ef-926b-2644763f6072] Running
I0214 03:05:47.348069 1503804 system_pods.go:89] "etcd-ha-447944-m03" [333b2788-49e2-4eb2-ab37-1bcf2e3a36b9] Running
I0214 03:05:47.348076 1503804 system_pods.go:89] "kindnet-pjrmh" [5cc39f50-0de5-40b5-b670-b33acc977740] Running
I0214 03:05:47.348082 1503804 system_pods.go:89] "kindnet-xkmkd" [534c4261-88a5-4120-89c4-c94bdfb2be76] Running
I0214 03:05:47.348088 1503804 system_pods.go:89] "kindnet-xwqhp" [f6cb2716-1303-433e-b2b7-53cc035ffc7a] Running
I0214 03:05:47.348095 1503804 system_pods.go:89] "kube-apiserver-ha-447944" [d48bd5fd-0acd-438c-8b9b-625fcc96d2c0] Running
I0214 03:05:47.348102 1503804 system_pods.go:89] "kube-apiserver-ha-447944-m02" [b36af3a6-21cc-47ae-910d-443dea7db747] Running
I0214 03:05:47.348110 1503804 system_pods.go:89] "kube-apiserver-ha-447944-m03" [e70600fa-8bc4-4321-b1d9-2f93d1c634a3] Running
I0214 03:05:47.348121 1503804 system_pods.go:89] "kube-controller-manager-ha-447944" [136c8014-5e6e-4af5-aa70-c041e62fb725] Running
I0214 03:05:47.348129 1503804 system_pods.go:89] "kube-controller-manager-ha-447944-m02" [f3bc1826-4323-4c0c-8255-855ffab6cf3d] Running
I0214 03:05:47.348146 1503804 system_pods.go:89] "kube-controller-manager-ha-447944-m03" [04928942-0b40-404f-9c46-53846956c358] Running
I0214 03:05:47.348153 1503804 system_pods.go:89] "kube-proxy-9cjk2" [87b6de90-7a92-4c40-bfe1-41353a81d40b] Running
I0214 03:05:47.348161 1503804 system_pods.go:89] "kube-proxy-dpm4f" [2e0eb813-44c4-4623-8789-d37194b83ecd] Running
I0214 03:05:47.348171 1503804 system_pods.go:89] "kube-proxy-rz6vt" [d396cc98-4175-4364-a84e-6e29c647be56] Running
I0214 03:05:47.348180 1503804 system_pods.go:89] "kube-scheduler-ha-447944" [39ba6921-10a6-4a43-8ecd-8afc7092ba98] Running
I0214 03:05:47.348191 1503804 system_pods.go:89] "kube-scheduler-ha-447944-m02" [f8de4bcd-f5ba-4172-a461-7c2cc73ea6f2] Running
I0214 03:05:47.348201 1503804 system_pods.go:89] "kube-scheduler-ha-447944-m03" [873867e0-f4fe-4450-95e8-860b2af6e116] Running
I0214 03:05:47.348210 1503804 system_pods.go:89] "kube-vip-ha-447944" [8e505ede-4ac8-4482-97ba-08943265ce41] Running
I0214 03:05:47.348219 1503804 system_pods.go:89] "kube-vip-ha-447944-m02" [80c89449-01b1-414b-bf1a-c727d4b03e8d] Running
I0214 03:05:47.348226 1503804 system_pods.go:89] "kube-vip-ha-447944-m03" [3ad2afab-b960-4b65-8357-2fd24e022ee4] Running
I0214 03:05:47.348236 1503804 system_pods.go:89] "storage-provisioner" [7da2937f-2d9b-40d4-a521-5bf4a2585de7] Running
I0214 03:05:47.348247 1503804 system_pods.go:126] duration metric: took 212.941224ms to wait for k8s-apps to be running ...
I0214 03:05:47.348257 1503804 system_svc.go:44] waiting for kubelet service to be running ....
I0214 03:05:47.348318 1503804 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:05:47.372595 1503804 system_svc.go:56] duration metric: took 24.327654ms WaitForService to wait for kubelet
I0214 03:05:47.372633 1503804 kubeadm.go:576] duration metric: took 14.728643642s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:05:47.372660 1503804 node_conditions.go:102] verifying NodePressure condition ...
I0214 03:05:47.529977 1503804 request.go:629] Waited for 157.219728ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.41:8443/api/v1/nodes
I0214 03:05:47.530075 1503804 round_trippers.go:463] GET https://192.168.39.41:8443/api/v1/nodes
I0214 03:05:47.530086 1503804 round_trippers.go:469] Request Headers:
I0214 03:05:47.530099 1503804 round_trippers.go:473] Accept: application/json, */*
I0214 03:05:47.530113 1503804 round_trippers.go:473] User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format
I0214 03:05:47.535210 1503804 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0214 03:05:47.536402 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:05:47.536428 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:05:47.536445 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:05:47.536451 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:05:47.536457 1503804 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:05:47.536462 1503804 node_conditions.go:123] node cpu capacity is 2
I0214 03:05:47.536468 1503804 node_conditions.go:105] duration metric: took 163.801705ms to run NodePressure ...
I0214 03:05:47.536500 1503804 start.go:240] waiting for startup goroutines ...
I0214 03:05:47.536529 1503804 start.go:254] writing updated cluster config ...
I0214 03:05:47.536857 1503804 ssh_runner.go:195] Run: rm -f paused
I0214 03:05:47.593595 1503804 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 03:05:47.596482 1503804 out.go:177] * Done! kubectl is now configured to use "ha-447944" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 03:02:18 UTC, ends at Wed 2024-02-14 03:10:28 UTC. --
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.719648529Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880228719636394,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=09e85c74-a212-4674-9e93-cfbdaa46b498 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.720862578Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=5a223973-11fa-44a7-ae2b-c760caa22113 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.720911406Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=5a223973-11fa-44a7-ae2b-c760caa22113 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.721220540Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707879954982427495,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.kubernetes.c
ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:494e2397438cea9012a91d71f80adbf747b0858fd8662088495857ea4f140083,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707879852742368720,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 1,io.kubernetes.co
ntainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:671171bd8cc89d2576e6f5d6e07feb4d4fe4fe637d7d07167f06fbea9e5d6b6b,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707879851739185075,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termi
nation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8391be96f5e7718850233a5934e8c5ac915c361d787452a4b2598203fa35b35b,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707879791703352562,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termina
tion-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791123663122,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPo
rt\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791194984160,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,}
,Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f,PodSandboxId:1ca3a54100ad9ab99099afc853b6b90438667b23b57ced2e2ab3c7924b545a33,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707879788029642996,Labels:map[string
]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707879785332012948,Labels:map[string]string{io.kubernetes.container.name:
kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:58b16160dd3050fdc7935e70e6c54431cebba2778995362d8867ac9d9e0f5bbe,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_EXITED,CreatedAt:1707879769405613391,Labels:map[string]string{io.kubernetes.container.name: kube-
vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707879764450387680,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernete
s.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707879764472168051,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: ku
be-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe,PodSandboxId:bdbc6964aad0947d1c3dff295a66352141a9d317183b9ed66532e1a16e5d5f7e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707879763880134071,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubern
etes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72,PodSandboxId:6bfe5642286cbee97891f6cd9fbe7cab921cb6c5bf987613e215ebcd93f36e3f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707879763901103124,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube
-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=5a223973-11fa-44a7-ae2b-c760caa22113 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.763240650Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=4af45f2b-9011-4d34-a549-7805dfc42282 name=/runtime.v1.RuntimeService/Version
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.763324316Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=4af45f2b-9011-4d34-a549-7805dfc42282 name=/runtime.v1.RuntimeService/Version
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.764632902Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=19909e5d-4023-4631-b2f3-b2d475436cfc name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.765109019Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880228765094288,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=19909e5d-4023-4631-b2f3-b2d475436cfc name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.765613139Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=8cb32fc7-2926-42f9-b200-59697e915df5 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.765661033Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=8cb32fc7-2926-42f9-b200-59697e915df5 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.766008661Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707879954982427495,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.kubernetes.c
ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:494e2397438cea9012a91d71f80adbf747b0858fd8662088495857ea4f140083,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707879852742368720,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 1,io.kubernetes.co
ntainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:671171bd8cc89d2576e6f5d6e07feb4d4fe4fe637d7d07167f06fbea9e5d6b6b,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707879851739185075,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termi
nation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8391be96f5e7718850233a5934e8c5ac915c361d787452a4b2598203fa35b35b,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707879791703352562,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termina
tion-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791123663122,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPo
rt\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791194984160,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,}
,Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f,PodSandboxId:1ca3a54100ad9ab99099afc853b6b90438667b23b57ced2e2ab3c7924b545a33,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707879788029642996,Labels:map[string
]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707879785332012948,Labels:map[string]string{io.kubernetes.container.name:
kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:58b16160dd3050fdc7935e70e6c54431cebba2778995362d8867ac9d9e0f5bbe,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_EXITED,CreatedAt:1707879769405613391,Labels:map[string]string{io.kubernetes.container.name: kube-
vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707879764450387680,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernete
s.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707879764472168051,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: ku
be-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe,PodSandboxId:bdbc6964aad0947d1c3dff295a66352141a9d317183b9ed66532e1a16e5d5f7e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707879763880134071,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubern
etes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72,PodSandboxId:6bfe5642286cbee97891f6cd9fbe7cab921cb6c5bf987613e215ebcd93f36e3f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707879763901103124,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube
-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=8cb32fc7-2926-42f9-b200-59697e915df5 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.811785856Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=b18fb966-5917-4050-8ded-0bbf09b46208 name=/runtime.v1.RuntimeService/Version
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.811852521Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=b18fb966-5917-4050-8ded-0bbf09b46208 name=/runtime.v1.RuntimeService/Version
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.813574149Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=14633557-93da-4ec4-9691-fea77d58e7ed name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.814132642Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880228814117460,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=14633557-93da-4ec4-9691-fea77d58e7ed name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.815039046Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=f9e0d118-b00a-4439-b92e-ce0f8c091c04 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.815084088Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=f9e0d118-b00a-4439-b92e-ce0f8c091c04 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.816049282Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707879954982427495,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.kubernetes.c
ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:494e2397438cea9012a91d71f80adbf747b0858fd8662088495857ea4f140083,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707879852742368720,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 1,io.kubernetes.co
ntainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:671171bd8cc89d2576e6f5d6e07feb4d4fe4fe637d7d07167f06fbea9e5d6b6b,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707879851739185075,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termi
nation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8391be96f5e7718850233a5934e8c5ac915c361d787452a4b2598203fa35b35b,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707879791703352562,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termina
tion-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791123663122,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPo
rt\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791194984160,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,}
,Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f,PodSandboxId:1ca3a54100ad9ab99099afc853b6b90438667b23b57ced2e2ab3c7924b545a33,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707879788029642996,Labels:map[string
]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707879785332012948,Labels:map[string]string{io.kubernetes.container.name:
kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:58b16160dd3050fdc7935e70e6c54431cebba2778995362d8867ac9d9e0f5bbe,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_EXITED,CreatedAt:1707879769405613391,Labels:map[string]string{io.kubernetes.container.name: kube-
vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707879764450387680,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernete
s.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707879764472168051,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: ku
be-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe,PodSandboxId:bdbc6964aad0947d1c3dff295a66352141a9d317183b9ed66532e1a16e5d5f7e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707879763880134071,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubern
etes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72,PodSandboxId:6bfe5642286cbee97891f6cd9fbe7cab921cb6c5bf987613e215ebcd93f36e3f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707879763901103124,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube
-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=f9e0d118-b00a-4439-b92e-ce0f8c091c04 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.881911363Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=c5922de4-1966-4815-88a9-a11d0690b574 name=/runtime.v1.RuntimeService/Version
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.881994605Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=c5922de4-1966-4815-88a9-a11d0690b574 name=/runtime.v1.RuntimeService/Version
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.884175148Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=6ef2075a-a0a9-44e4-9bbf-1c6548aea6e2 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.884813972Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880228884793384,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=6ef2075a-a0a9-44e4-9bbf-1c6548aea6e2 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.885899317Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=c6bf0998-1c59-483d-a817-5c2977448fcb name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.885953916Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=c6bf0998-1c59-483d-a817-5c2977448fcb name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:10:28 ha-447944 crio[718]: time="2024-02-14 03:10:28.886238270Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707879954982427495,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.kubernetes.c
ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:494e2397438cea9012a91d71f80adbf747b0858fd8662088495857ea4f140083,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707879852742368720,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 1,io.kubernetes.co
ntainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:671171bd8cc89d2576e6f5d6e07feb4d4fe4fe637d7d07167f06fbea9e5d6b6b,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:1,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707879851739185075,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termi
nation-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8391be96f5e7718850233a5934e8c5ac915c361d787452a4b2598203fa35b35b,PodSandboxId:952b8ac262ad9f0894be591c8fa0c433b53f390deab5764b11cccdd49a699a3e,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707879791703352562,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termina
tion-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791123663122,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPo
rt\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707879791194984160,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,}
,Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f,PodSandboxId:1ca3a54100ad9ab99099afc853b6b90438667b23b57ced2e2ab3c7924b545a33,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707879788029642996,Labels:map[string
]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707879785332012948,Labels:map[string]string{io.kubernetes.container.name:
kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:58b16160dd3050fdc7935e70e6c54431cebba2778995362d8867ac9d9e0f5bbe,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_EXITED,CreatedAt:1707879769405613391,Labels:map[string]string{io.kubernetes.container.name: kube-
vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707879764450387680,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernete
s.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707879764472168051,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: ku
be-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe,PodSandboxId:bdbc6964aad0947d1c3dff295a66352141a9d317183b9ed66532e1a16e5d5f7e,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707879763880134071,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubern
etes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72,PodSandboxId:6bfe5642286cbee97891f6cd9fbe7cab921cb6c5bf987613e215ebcd93f36e3f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707879763901103124,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube
-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=c6bf0998-1c59-483d-a817-5c2977448fcb name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
158ed81c1ad09 gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 4 minutes ago Running busybox 0 ae707b68d26d7 busybox-5b5d89c9d6-szrmk
494e2397438ce 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 6 minutes ago Running storage-provisioner 1 952b8ac262ad9 storage-provisioner
671171bd8cc89 77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e 6 minutes ago Running kube-vip 1 40d66b939fbde kube-vip-ha-447944
8391be96f5e77 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 7 minutes ago Exited storage-provisioner 0 952b8ac262ad9 storage-provisioner
f046573e5c613 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 7 minutes ago Running coredns 0 f5b7a259c6576 coredns-5dd5756b68-rpnsx
7e9bb46f5e644 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 7 minutes ago Running coredns 0 9646d9ad7639e coredns-5dd5756b68-chs9l
2d1d563ca45e6 c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc 7 minutes ago Running kindnet-cni 0 1ca3a54100ad9 kindnet-pjrmh
9d1286d601bde 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 7 minutes ago Running kube-proxy 0 c168dfe284262 kube-proxy-dpm4f
58b16160dd305 ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244 7 minutes ago Exited kube-vip 0 40d66b939fbde kube-vip-ha-447944
322a42a79321e e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 7 minutes ago Running kube-scheduler 0 fc67797793fd2 kube-scheduler-ha-447944
a8ad5c38dc289 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 7 minutes ago Running etcd 0 bb35989a47301 etcd-ha-447944
31292f46771fe d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 7 minutes ago Running kube-controller-manager 0 6bfe5642286cb kube-controller-manager-ha-447944
7fe5eed784edf 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 7 minutes ago Running kube-apiserver 0 bdbc6964aad09 kube-apiserver-ha-447944
==> coredns [7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb] <==
[INFO] 10.244.0.4:40217 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000330072s
[INFO] 10.244.0.4:52264 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.0007017s
[INFO] 10.244.2.2:58826 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000263967s
[INFO] 10.244.2.2:58742 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000106317s
[INFO] 10.244.1.2:54246 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000345097s
[INFO] 10.244.1.2:56830 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000207364s
[INFO] 10.244.1.2:53196 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000201609s
[INFO] 10.244.0.4:57282 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000255022s
[INFO] 10.244.0.4:42175 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000101666s
[INFO] 10.244.0.4:47990 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001543994s
[INFO] 10.244.2.2:36297 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000098014s
[INFO] 10.244.2.2:55624 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001606173s
[INFO] 10.244.1.2:42215 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000164975s
[INFO] 10.244.1.2:56863 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00013524s
[INFO] 10.244.0.4:54854 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000077245s
[INFO] 10.244.2.2:47287 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000112202s
[INFO] 10.244.2.2:57185 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000259211s
[INFO] 10.244.2.2:34362 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00020542s
[INFO] 10.244.2.2:35530 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000085011s
[INFO] 10.244.1.2:55025 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000219197s
[INFO] 10.244.1.2:41871 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000278055s
[INFO] 10.244.0.4:34459 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000106414s
[INFO] 10.244.0.4:49400 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000157055s
[INFO] 10.244.0.4:45347 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000226252s
[INFO] 10.244.2.2:56178 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000172264s
==> coredns [f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e] <==
[INFO] 10.244.1.2:53609 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000230567s
[INFO] 10.244.1.2:42733 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003471408s
[INFO] 10.244.1.2:59825 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000162339s
[INFO] 10.244.0.4:35367 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000075576s
[INFO] 10.244.0.4:60738 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001978154s
[INFO] 10.244.0.4:59564 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00011757s
[INFO] 10.244.0.4:57775 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000059017s
[INFO] 10.244.0.4:50120 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000078756s
[INFO] 10.244.2.2:49507 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000141378s
[INFO] 10.244.2.2:49171 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001957068s
[INFO] 10.244.2.2:33740 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000387227s
[INFO] 10.244.2.2:35506 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000108121s
[INFO] 10.244.2.2:58270 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000096656s
[INFO] 10.244.2.2:47275 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000113722s
[INFO] 10.244.1.2:39124 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000232628s
[INFO] 10.244.1.2:36677 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000104764s
[INFO] 10.244.0.4:52867 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000150283s
[INFO] 10.244.0.4:39534 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000098645s
[INFO] 10.244.0.4:52205 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000134847s
[INFO] 10.244.1.2:57709 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000561618s
[INFO] 10.244.1.2:44823 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000149413s
[INFO] 10.244.0.4:53053 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000090637s
[INFO] 10.244.2.2:59333 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000158454s
[INFO] 10.244.2.2:48734 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000320234s
[INFO] 10.244.2.2:57167 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000155417s
==> describe nodes <==
Name: ha-447944
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T03_02_54_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:02:50 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:10:23 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:06:31 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:06:31 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:06:31 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:06:31 +0000 Wed, 14 Feb 2024 03:03:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.41
Hostname: ha-447944
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: a6361e2fe77648efb80ef77ef65e19b9
System UUID: a6361e2f-e776-48ef-b80e-f77ef65e19b9
Boot ID: 028eaefa-0af8-4862-9bdb-3627e617e5df
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-szrmk 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m41s
kube-system coredns-5dd5756b68-chs9l 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 7m25s
kube-system coredns-5dd5756b68-rpnsx 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 7m25s
kube-system etcd-ha-447944 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 7m37s
kube-system kindnet-pjrmh 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 7m25s
kube-system kube-apiserver-ha-447944 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m36s
kube-system kube-controller-manager-ha-447944 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m36s
kube-system kube-proxy-dpm4f 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m25s
kube-system kube-scheduler-ha-447944 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m36s
kube-system kube-vip-ha-447944 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m36s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m24s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 290Mi (13%!)(MISSING) 390Mi (18%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 7m23s kube-proxy
Normal NodeHasSufficientPID 7m47s (x7 over 7m47s) kubelet Node ha-447944 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 7m47s kubelet Updated Node Allocatable limit across pods
Normal Starting 7m47s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 7m47s (x8 over 7m47s) kubelet Node ha-447944 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m47s (x8 over 7m47s) kubelet Node ha-447944 status is now: NodeHasNoDiskPressure
Normal Starting 7m36s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 7m36s kubelet Node ha-447944 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m36s kubelet Node ha-447944 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 7m36s kubelet Node ha-447944 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 7m36s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 7m26s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal NodeReady 7m20s kubelet Node ha-447944 status is now: NodeReady
Normal RegisteredNode 6m node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal RegisteredNode 4m42s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Name: ha-447944-m02
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_04_17_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:04:00 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m02
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:07:01 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:07:42 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:07:42 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:07:42 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:07:42 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.168.39.218
Hostname: ha-447944-m02
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 535bf6eb4ee34dd6b837047738e23b84
System UUID: 535bf6eb-4ee3-4dd6-b837-047738e23b84
Boot ID: c6ea1ad7-9a18-4b88-8bc1-82e5f8a7909f
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-mjds9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m41s
kube-system etcd-ha-447944-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 6m29s
kube-system kindnet-xkmkd 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 6m29s
kube-system kube-apiserver-ha-447944-m02 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m28s
kube-system kube-controller-manager-ha-447944-m02 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m27s
kube-system kube-proxy-9cjk2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m29s
kube-system kube-scheduler-ha-447944-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m27s
kube-system kube-vip-ha-447944-m02 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m11s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 100m (5%!)(MISSING)
memory 150Mi (7%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m10s kube-proxy
Normal RegisteredNode 6m node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal RegisteredNode 4m42s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal NodeNotReady 2m47s node-controller Node ha-447944-m02 status is now: NodeNotReady
Name: ha-447944-m03
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m03
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_05_32_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:05:28 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m03
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:10:25 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:05:59 +0000 Wed, 14 Feb 2024 03:05:39 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.133
Hostname: ha-447944-m03
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: c5406b0ff7684df1879332816ce20376
System UUID: c5406b0f-f768-4df1-8793-32816ce20376
Boot ID: 1dc7d320-b8b7-4207-965c-2882293aabcf
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.2.0/24
PodCIDRs: 10.244.2.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-v4857 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m41s
kube-system etcd-ha-447944-m03 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 4m59s
kube-system kindnet-xwqhp 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 5m1s
kube-system kube-apiserver-ha-447944-m03 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m59s
kube-system kube-controller-manager-ha-447944-m03 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m59s
kube-system kube-proxy-rz6vt 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m1s
kube-system kube-scheduler-ha-447944-m03 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m59s
kube-system kube-vip-ha-447944-m03 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m54s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 100m (5%!)(MISSING)
memory 150Mi (7%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4m57s kube-proxy
Normal RegisteredNode 5m1s node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal RegisteredNode 5m node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal RegisteredNode 4m42s node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Name: ha-447944-m04
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m04
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_06_31_0700
minikube.k8s.io/version=v1.32.0
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:06:30 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m04
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:10:26 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:07:01 +0000 Wed, 14 Feb 2024 03:06:30 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:07:01 +0000 Wed, 14 Feb 2024 03:06:30 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:07:01 +0000 Wed, 14 Feb 2024 03:06:30 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:07:01 +0000 Wed, 14 Feb 2024 03:06:40 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.98
Hostname: ha-447944-m04
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: d8594ac4943e4e6ca3585573b6de953f
System UUID: d8594ac4-943e-4e6c-a358-5573b6de953f
Boot ID: c1118fb4-c335-4d7e-8ea0-62ae7e640d77
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.3.0/24
PodCIDRs: 10.244.3.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system kindnet-ldndh 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 3m59s
kube-system kube-proxy-jrhq2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m59s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 3m53s kube-proxy
Normal NodeHasSufficientMemory 3m59s (x5 over 4m) kubelet Node ha-447944-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 3m59s (x5 over 4m) kubelet Node ha-447944-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 3m59s (x5 over 4m) kubelet Node ha-447944-m04 status is now: NodeHasSufficientPID
Normal RegisteredNode 3m57s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 3m56s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 3m55s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal NodeReady 3m49s kubelet Node ha-447944-m04 status is now: NodeReady
==> dmesg <==
[Feb14 03:02] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.067171] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.354129] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.296154] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.134944] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.012559] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +9.434119] systemd-fstab-generator[642]: Ignoring "noauto" for root device
[ +0.104064] systemd-fstab-generator[653]: Ignoring "noauto" for root device
[ +0.157556] systemd-fstab-generator[666]: Ignoring "noauto" for root device
[ +0.109767] systemd-fstab-generator[677]: Ignoring "noauto" for root device
[ +0.213788] systemd-fstab-generator[702]: Ignoring "noauto" for root device
[ +5.352315] systemd-fstab-generator[804]: Ignoring "noauto" for root device
[ +3.604175] systemd-fstab-generator[984]: Ignoring "noauto" for root device
[ +10.810722] systemd-fstab-generator[1413]: Ignoring "noauto" for root device
[Feb14 03:03] kauditd_printk_skb: 18 callbacks suppressed
==> etcd [a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721] <==
{"level":"warn","ts":"2024-02-14T03:10:28.901532Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.001448Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.101834Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.186504Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.234827Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.247889Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.254964Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.259228Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.27154Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.28045Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.288959Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.29717Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.301483Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.301859Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.305622Z","caller":"etcdserver/cluster_util.go:288","msg":"failed to reach the peer URL","address":"https://192.168.39.218:2380/version","remote-member-id":"3c62304b6daead5d","error":"Get \"https://192.168.39.218:2380/version\": dial tcp 192.168.39.218:2380: i/o timeout"}
{"level":"warn","ts":"2024-02-14T03:10:29.305786Z","caller":"etcdserver/cluster_util.go:155","msg":"failed to get version","remote-member-id":"3c62304b6daead5d","error":"Get \"https://192.168.39.218:2380/version\": dial tcp 192.168.39.218:2380: i/o timeout"}
{"level":"warn","ts":"2024-02-14T03:10:29.31104Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.319022Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.3265Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.33052Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.334114Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.34083Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.349831Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.35769Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
{"level":"warn","ts":"2024-02-14T03:10:29.401339Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"903e0dada8362847","from":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d","remote-peer-name":"pipeline","remote-peer-active":false}
==> kernel <==
03:10:29 up 8 min, 0 users, load average: 0.25, 0.41, 0.27
Linux ha-447944 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kindnet [2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f] <==
I0214 03:09:56.327166 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:10:06.335487 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:10:06.335588 1 main.go:227] handling current node
I0214 03:10:06.335624 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:10:06.335653 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:10:06.335889 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:10:06.335932 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:10:06.335992 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:10:06.336010 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:10:16.352805 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:10:16.353053 1 main.go:227] handling current node
I0214 03:10:16.353174 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:10:16.353286 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:10:16.353680 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:10:16.353974 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:10:16.354162 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:10:16.354202 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:10:26.362314 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:10:26.362621 1 main.go:227] handling current node
I0214 03:10:26.363203 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:10:26.363378 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:10:26.363959 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:10:26.364013 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:10:26.364075 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:10:26.364094 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
==> kube-apiserver [7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe] <==
Trace[728426027]: ["List(recursive=true) etcd3" audit-id:6f5aa269-2300-43cb-8d43-bf2794351d86,key:/resourcequotas/kube-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 998ms (03:04:14.742)]
Trace[728426027]: [998.657885ms] [998.657885ms] END
I0214 03:04:15.743594 1 trace.go:236] Trace[1420950922]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b1ca4b01-ab7d-4f68-afe6-30cfa863ee5c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-63gc6a7uuokcsluwb54fia3rja,user-agent:kube-apiserver/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:PUT (14-Feb-2024 03:04:10.493) (total time: 5249ms):
Trace[1420950922]: ["GuaranteedUpdate etcd3" audit-id:b1ca4b01-ab7d-4f68-afe6-30cfa863ee5c,key:/leases/kube-system/apiserver-63gc6a7uuokcsluwb54fia3rja,type:*coordination.Lease,resource:leases.coordination.k8s.io 5249ms (03:04:10.493)
Trace[1420950922]: ---"Txn call completed" 5248ms (03:04:15.743)]
Trace[1420950922]: [5.249964994s] [5.249964994s] END
I0214 03:04:15.747424 1 trace.go:236] Trace[978088035]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e7bcd4e9-f14d-442f-8d4a-4002822baa52,client:192.168.39.218,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/ha-447944-m02/status,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:PATCH (14-Feb-2024 03:04:10.577) (total time: 5170ms):
Trace[978088035]: ["GuaranteedUpdate etcd3" audit-id:e7bcd4e9-f14d-442f-8d4a-4002822baa52,key:/minions/ha-447944-m02,type:*core.Node,resource:nodes 5170ms (03:04:10.577)
Trace[978088035]: ---"Txn call completed" 5168ms (03:04:15.747)]
Trace[978088035]: ---"Object stored in database" 5168ms (03:04:15.747)
Trace[978088035]: [5.170278508s] [5.170278508s] END
I0214 03:04:15.749224 1 trace.go:236] Trace[1314965335]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d9d10802-214d-4dd0-ad4f-51ae8f8c2932,client:192.168.39.41,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/ha-447944-m02,user-agent:kube-controller-manager/v1.28.4 (linux/amd64) kubernetes/bae2c62/system:serviceaccount:kube-system:node-controller,verb:PATCH (14-Feb-2024 03:04:13.630) (total time: 2118ms):
Trace[1314965335]: ["GuaranteedUpdate etcd3" audit-id:d9d10802-214d-4dd0-ad4f-51ae8f8c2932,key:/minions/ha-447944-m02,type:*core.Node,resource:nodes 2118ms (03:04:13.631)
Trace[1314965335]: ---"Txn call completed" 2110ms (03:04:15.747)]
Trace[1314965335]: ---"About to apply patch" 2111ms (03:04:15.747)
Trace[1314965335]: [2.118243434s] [2.118243434s] END
I0214 03:04:15.791888 1 trace.go:236] Trace[296307785]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e9b31557-5e60-4ff2-8991-bb0f1441bbb3,client:192.168.39.218,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:POST (14-Feb-2024 03:04:09.107) (total time: 6684ms):
Trace[296307785]: [6.684341931s] [6.684341931s] END
I0214 03:04:15.792320 1 trace.go:236] Trace[849006311]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:512c83fd-d30d-48ee-865e-1235a70004ca,client:192.168.39.218,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:POST (14-Feb-2024 03:04:09.107) (total time: 6685ms):
Trace[849006311]: [6.685077448s] [6.685077448s] END
I0214 03:04:15.792813 1 trace.go:236] Trace[390025235]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:17327b02-2020-4908-9ce1-58031c3b2d98,client:192.168.39.218,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:POST (14-Feb-2024 03:04:09.108) (total time: 6684ms):
Trace[390025235]: [6.6847903s] [6.6847903s] END
I0214 03:04:15.793138 1 trace.go:236] Trace[222849487]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2821f3f3-b613-494b-a527-08a721f64e94,client:192.168.39.218,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.4 (linux/amd64) kubernetes/bae2c62,verb:POST (14-Feb-2024 03:04:08.100) (total time: 7693ms):
Trace[222849487]: [7.693074269s] [7.693074269s] END
E0214 03:05:56.054359 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 192.168.39.41:38710->192.168.39.41:10250: write: broken pipe
==> kube-controller-manager [31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72] <==
I0214 03:05:49.275537 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="64.526µs"
I0214 03:05:49.275635 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="63.776µs"
I0214 03:05:49.394310 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="39.606802ms"
I0214 03:05:49.394492 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="94.908µs"
I0214 03:05:53.146296 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="15.608875ms"
I0214 03:05:53.146437 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="59.169µs"
I0214 03:05:53.522357 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="29.831829ms"
I0214 03:05:53.522598 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="73.392µs"
I0214 03:05:55.220048 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="49.617416ms"
I0214 03:05:55.220204 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="76.516µs"
E0214 03:06:29.402064 1 certificate_controller.go:146] Sync csr-jvwkv failed with : error updating approval for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-jvwkv": the object has been modified; please apply your changes to the latest version and try again
I0214 03:06:30.915182 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-447944-m04\" does not exist"
I0214 03:06:30.936136 1 range_allocator.go:380] "Set node PodCIDR" node="ha-447944-m04" podCIDRs=["10.244.3.0/24"]
I0214 03:06:30.976269 1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-ldndh"
I0214 03:06:30.976385 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-jrhq2"
I0214 03:06:31.110212 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: kube-proxy-w9hpm"
I0214 03:06:31.110271 1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: kindnet-l52ch"
I0214 03:06:31.255979 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: kube-proxy-dc9jr"
I0214 03:06:31.320869 1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: kindnet-4cfh5"
I0214 03:06:33.630609 1 event.go:307] "Event occurred" object="ha-447944-m04" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller"
I0214 03:06:33.650159 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="ha-447944-m04"
I0214 03:06:40.026196 1 topologycache.go:237] "Can't get CPU or zone information for node" node="ha-447944-m04"
I0214 03:07:42.552683 1 topologycache.go:237] "Can't get CPU or zone information for node" node="ha-447944-m04"
I0214 03:07:42.670288 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="18.391265ms"
I0214 03:07:42.670451 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="60.771µs"
==> kube-proxy [9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62] <==
I0214 03:03:05.588684 1 server_others.go:69] "Using iptables proxy"
I0214 03:03:05.606023 1 node.go:141] Successfully retrieved node IP: 192.168.39.41
I0214 03:03:05.654459 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 03:03:05.654501 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 03:03:05.657217 1 server_others.go:152] "Using iptables Proxier"
I0214 03:03:05.657536 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 03:03:05.657962 1 server.go:846] "Version info" version="v1.28.4"
I0214 03:03:05.657999 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:03:05.659980 1 config.go:188] "Starting service config controller"
I0214 03:03:05.660645 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 03:03:05.660884 1 config.go:97] "Starting endpoint slice config controller"
I0214 03:03:05.660893 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 03:03:05.663335 1 config.go:315] "Starting node config controller"
I0214 03:03:05.663384 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 03:03:05.760872 1 shared_informer.go:318] Caches are synced for service config
I0214 03:03:05.761831 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 03:03:05.763783 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2] <==
W0214 03:02:49.711804 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 03:02:49.711885 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 03:02:49.728517 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:02:49.728585 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 03:02:49.739934 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 03:02:49.740024 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0214 03:02:49.757835 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:02:49.757958 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 03:02:49.808506 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 03:02:49.808642 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 03:02:49.833386 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:02:49.833515 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:02:50.030922 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 03:02:50.030975 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0214 03:02:50.041490 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:02:50.041552 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
I0214 03:02:52.040022 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0214 03:06:31.002236 1 framework.go:1206] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-ldndh\": pod kindnet-ldndh is already assigned to node \"ha-447944-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-ldndh" node="ha-447944-m04"
E0214 03:06:31.002516 1 schedule_one.go:989] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-ldndh\": pod kindnet-ldndh is already assigned to node \"ha-447944-m04\"" pod="kube-system/kindnet-ldndh"
E0214 03:06:31.019870 1 framework.go:1206] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-jrhq2\": pod kube-proxy-jrhq2 is already assigned to node \"ha-447944-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-jrhq2" node="ha-447944-m04"
E0214 03:06:31.019981 1 schedule_one.go:319] "scheduler cache ForgetPod failed" err="pod a8dc7b7f-ff43-4e8f-8867-7bbd9b8aca8d(kube-system/kube-proxy-jrhq2) wasn't assumed so cannot be forgotten"
E0214 03:06:31.020025 1 schedule_one.go:989] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-jrhq2\": pod kube-proxy-jrhq2 is already assigned to node \"ha-447944-m04\"" pod="kube-system/kube-proxy-jrhq2"
I0214 03:06:31.020051 1 schedule_one.go:1002] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-jrhq2" node="ha-447944-m04"
E0214 03:06:31.213062 1 framework.go:1206] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-4cfh5\": pod kindnet-4cfh5 is already assigned to node \"ha-447944-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-4cfh5" node="ha-447944-m04"
E0214 03:06:31.213171 1 schedule_one.go:989] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-4cfh5\": pod kindnet-4cfh5 is already assigned to node \"ha-447944-m04\"" pod="kube-system/kindnet-4cfh5"
==> kubelet <==
-- Journal begins at Wed 2024-02-14 03:02:18 UTC, ends at Wed 2024-02-14 03:10:29 UTC. --
Feb 14 03:04:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:05:48 ha-447944 kubelet[1420]: I0214 03:05:48.795986 1420 topology_manager.go:215] "Topology Admit Handler" podUID="56ad0ee8-8c4a-4894-b742-a0b3f225feac" podNamespace="default" podName="busybox-5b5d89c9d6-szrmk"
Feb 14 03:05:48 ha-447944 kubelet[1420]: I0214 03:05:48.896919 1420 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t8j9\" (UniqueName: \"kubernetes.io/projected/56ad0ee8-8c4a-4894-b742-a0b3f225feac-kube-api-access-4t8j9\") pod \"busybox-5b5d89c9d6-szrmk\" (UID: \"56ad0ee8-8c4a-4894-b742-a0b3f225feac\") " pod="default/busybox-5b5d89c9d6-szrmk"
Feb 14 03:05:53 ha-447944 kubelet[1420]: E0214 03:05:53.433809 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:05:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:05:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:05:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:05:55 ha-447944 kubelet[1420]: I0214 03:05:55.172088 1420 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="default/busybox-5b5d89c9d6-szrmk" podStartSLOduration=2.397878518 podCreationTimestamp="2024-02-14 03:05:48 +0000 UTC" firstStartedPulling="2024-02-14 03:05:50.181843371 +0000 UTC m=+177.055993906" lastFinishedPulling="2024-02-14 03:05:54.955923543 +0000 UTC m=+181.830074080" observedRunningTime="2024-02-14 03:05:55.171520141 +0000 UTC m=+182.045670686" watchObservedRunningTime="2024-02-14 03:05:55.171958692 +0000 UTC m=+182.046109241"
Feb 14 03:06:53 ha-447944 kubelet[1420]: E0214 03:06:53.428684 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:06:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:06:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:06:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:07:53 ha-447944 kubelet[1420]: E0214 03:07:53.427017 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:07:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:07:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:07:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:07:53 ha-447944 kubelet[1420]: E0214 03:07:53.440089 1420 container_manager_linux.go:514] "Failed to find cgroups of kubelet" err="cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service"
Feb 14 03:08:53 ha-447944 kubelet[1420]: E0214 03:08:53.441032 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:08:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:08:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:08:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:09:53 ha-447944 kubelet[1420]: E0214 03:09:53.428680 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:09:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:09:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:09:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-447944 -n ha-447944
helpers_test.go:261: (dbg) Run: kubectl --context ha-447944 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestHA/serial/RestartSecondaryNode FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestHA/serial/RestartSecondaryNode (62.02s)
=== RUN TestHA/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run: out/minikube-linux-amd64 node list -p ha-447944 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run: out/minikube-linux-amd64 stop -p ha-447944 -v=7 --alsologtostderr
E0214 03:10:56.223026 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:11:13.611456 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:11:41.296555 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
ha_test.go:462: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p ha-447944 -v=7 --alsologtostderr: exit status 82 (2m2.598925106s)
-- stdout --
* Stopping node "ha-447944-m04" ...
* Stopping node "ha-447944-m03" ...
-- /stdout --
** stderr **
I0214 03:10:31.040278 1509157 out.go:291] Setting OutFile to fd 1 ...
I0214 03:10:31.040553 1509157 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:10:31.040564 1509157 out.go:304] Setting ErrFile to fd 2...
I0214 03:10:31.040569 1509157 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:10:31.040814 1509157 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:10:31.041108 1509157 out.go:298] Setting JSON to false
I0214 03:10:31.041358 1509157 mustload.go:65] Loading cluster: ha-447944
I0214 03:10:31.041763 1509157 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:10:31.041860 1509157 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:10:31.042080 1509157 mustload.go:65] Loading cluster: ha-447944
I0214 03:10:31.042231 1509157 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:10:31.042275 1509157 stop.go:39] StopHost: ha-447944-m04
I0214 03:10:31.042737 1509157 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:31.042791 1509157 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:31.058957 1509157 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33383
I0214 03:10:31.059514 1509157 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:31.060286 1509157 main.go:141] libmachine: Using API Version 1
I0214 03:10:31.060319 1509157 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:31.060702 1509157 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:31.063537 1509157 out.go:177] * Stopping node "ha-447944-m04" ...
I0214 03:10:31.065201 1509157 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]
I0214 03:10:31.065233 1509157 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:10:31.065641 1509157 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup
I0214 03:10:31.065674 1509157 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:10:31.068635 1509157 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:31.069091 1509157 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:06:16 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:10:31.069139 1509157 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:10:31.069280 1509157 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:10:31.069483 1509157 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:10:31.069661 1509157 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:10:31.069785 1509157 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:10:31.156101 1509157 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/cni /var/lib/minikube/backup
I0214 03:10:31.166302 1509157 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/kubernetes /var/lib/minikube/backup
I0214 03:10:31.176199 1509157 main.go:141] libmachine: Stopping "ha-447944-m04"...
I0214 03:10:31.176236 1509157 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:10:31.177976 1509157 main.go:141] libmachine: (ha-447944-m04) Calling .Stop
I0214 03:10:31.181702 1509157 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 0/120
I0214 03:10:32.184051 1509157 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 1/120
I0214 03:10:33.186824 1509157 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:10:33.188203 1509157 main.go:141] libmachine: Machine "ha-447944-m04" was stopped.
I0214 03:10:33.188223 1509157 stop.go:75] duration metric: took 2.123032337s to stop
I0214 03:10:33.188249 1509157 stop.go:39] StopHost: ha-447944-m03
I0214 03:10:33.188679 1509157 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:10:33.188738 1509157 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:10:33.205909 1509157 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43693
I0214 03:10:33.206491 1509157 main.go:141] libmachine: () Calling .GetVersion
I0214 03:10:33.207175 1509157 main.go:141] libmachine: Using API Version 1
I0214 03:10:33.207216 1509157 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:10:33.207656 1509157 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:10:33.211880 1509157 out.go:177] * Stopping node "ha-447944-m03" ...
I0214 03:10:33.213637 1509157 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]
I0214 03:10:33.213675 1509157 main.go:141] libmachine: (ha-447944-m03) Calling .DriverName
I0214 03:10:33.214043 1509157 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup
I0214 03:10:33.214077 1509157 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHHostname
I0214 03:10:33.217656 1509157 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:33.218207 1509157 main.go:141] libmachine: (ha-447944-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:2c:af", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:04:47 +0000 UTC Type:0 Mac:52:54:00:2e:2c:af Iaid: IPaddr:192.168.39.133 Prefix:24 Hostname:ha-447944-m03 Clientid:01:52:54:00:2e:2c:af}
I0214 03:10:33.218274 1509157 main.go:141] libmachine: (ha-447944-m03) DBG | domain ha-447944-m03 has defined IP address 192.168.39.133 and MAC address 52:54:00:2e:2c:af in network mk-ha-447944
I0214 03:10:33.218389 1509157 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHPort
I0214 03:10:33.218596 1509157 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHKeyPath
I0214 03:10:33.218792 1509157 main.go:141] libmachine: (ha-447944-m03) Calling .GetSSHUsername
I0214 03:10:33.218962 1509157 sshutil.go:53] new ssh client: &{IP:192.168.39.133 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m03/id_rsa Username:docker}
I0214 03:10:33.324333 1509157 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/cni /var/lib/minikube/backup
I0214 03:10:33.337953 1509157 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/kubernetes /var/lib/minikube/backup
I0214 03:10:33.350748 1509157 main.go:141] libmachine: Stopping "ha-447944-m03"...
I0214 03:10:33.350798 1509157 main.go:141] libmachine: (ha-447944-m03) Calling .GetState
I0214 03:10:33.352353 1509157 main.go:141] libmachine: (ha-447944-m03) Calling .Stop
I0214 03:10:33.356236 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 0/120
I0214 03:10:34.357975 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 1/120
I0214 03:10:35.360594 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 2/120
I0214 03:10:36.362038 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 3/120
I0214 03:10:37.363634 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 4/120
I0214 03:10:38.366039 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 5/120
I0214 03:10:39.367960 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 6/120
I0214 03:10:40.369742 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 7/120
I0214 03:10:41.371131 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 8/120
I0214 03:10:42.372798 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 9/120
I0214 03:10:43.375008 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 10/120
I0214 03:10:44.376737 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 11/120
I0214 03:10:45.378315 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 12/120
I0214 03:10:46.379847 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 13/120
I0214 03:10:47.381298 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 14/120
I0214 03:10:48.383324 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 15/120
I0214 03:10:49.385373 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 16/120
I0214 03:10:50.387069 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 17/120
I0214 03:10:51.388821 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 18/120
I0214 03:10:52.390423 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 19/120
I0214 03:10:53.392465 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 20/120
I0214 03:10:54.394174 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 21/120
I0214 03:10:55.395855 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 22/120
I0214 03:10:56.397198 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 23/120
I0214 03:10:57.398696 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 24/120
I0214 03:10:58.400712 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 25/120
I0214 03:10:59.402412 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 26/120
I0214 03:11:00.404089 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 27/120
I0214 03:11:01.405811 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 28/120
I0214 03:11:02.407593 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 29/120
I0214 03:11:03.409985 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 30/120
I0214 03:11:04.411564 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 31/120
I0214 03:11:05.412956 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 32/120
I0214 03:11:06.414602 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 33/120
I0214 03:11:07.415922 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 34/120
I0214 03:11:08.418250 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 35/120
I0214 03:11:09.420123 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 36/120
I0214 03:11:10.421488 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 37/120
I0214 03:11:11.423022 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 38/120
I0214 03:11:12.424771 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 39/120
I0214 03:11:13.426906 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 40/120
I0214 03:11:14.428719 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 41/120
I0214 03:11:15.430134 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 42/120
I0214 03:11:16.432074 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 43/120
I0214 03:11:17.433472 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 44/120
I0214 03:11:18.435665 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 45/120
I0214 03:11:19.438117 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 46/120
I0214 03:11:20.440013 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 47/120
I0214 03:11:21.441543 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 48/120
I0214 03:11:22.443882 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 49/120
I0214 03:11:23.445381 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 50/120
I0214 03:11:24.446957 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 51/120
I0214 03:11:25.448816 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 52/120
I0214 03:11:26.450502 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 53/120
I0214 03:11:27.451989 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 54/120
I0214 03:11:28.453878 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 55/120
I0214 03:11:29.455537 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 56/120
I0214 03:11:30.457099 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 57/120
I0214 03:11:31.458658 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 58/120
I0214 03:11:32.460031 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 59/120
I0214 03:11:33.461871 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 60/120
I0214 03:11:34.463375 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 61/120
I0214 03:11:35.464962 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 62/120
I0214 03:11:36.466489 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 63/120
I0214 03:11:37.467966 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 64/120
I0214 03:11:38.470166 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 65/120
I0214 03:11:39.471722 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 66/120
I0214 03:11:40.473476 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 67/120
I0214 03:11:41.474975 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 68/120
I0214 03:11:42.476583 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 69/120
I0214 03:11:43.479019 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 70/120
I0214 03:11:44.480542 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 71/120
I0214 03:11:45.482122 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 72/120
I0214 03:11:46.483659 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 73/120
I0214 03:11:47.485180 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 74/120
I0214 03:11:48.487714 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 75/120
I0214 03:11:49.489356 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 76/120
I0214 03:11:50.490756 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 77/120
I0214 03:11:51.492218 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 78/120
I0214 03:11:52.493809 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 79/120
I0214 03:11:53.495729 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 80/120
I0214 03:11:54.497470 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 81/120
I0214 03:11:55.498983 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 82/120
I0214 03:11:56.500696 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 83/120
I0214 03:11:57.502257 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 84/120
I0214 03:11:58.504644 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 85/120
I0214 03:11:59.506279 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 86/120
I0214 03:12:00.507742 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 87/120
I0214 03:12:01.509461 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 88/120
I0214 03:12:02.511019 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 89/120
I0214 03:12:03.513669 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 90/120
I0214 03:12:04.515493 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 91/120
I0214 03:12:05.517452 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 92/120
I0214 03:12:06.518893 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 93/120
I0214 03:12:07.520573 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 94/120
I0214 03:12:08.522628 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 95/120
I0214 03:12:09.524310 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 96/120
I0214 03:12:10.525860 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 97/120
I0214 03:12:11.527924 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 98/120
I0214 03:12:12.529398 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 99/120
I0214 03:12:13.531714 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 100/120
I0214 03:12:14.533454 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 101/120
I0214 03:12:15.535169 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 102/120
I0214 03:12:16.536981 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 103/120
I0214 03:12:17.538554 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 104/120
I0214 03:12:18.540085 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 105/120
I0214 03:12:19.541851 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 106/120
I0214 03:12:20.543250 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 107/120
I0214 03:12:21.545612 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 108/120
I0214 03:12:22.547093 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 109/120
I0214 03:12:23.549178 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 110/120
I0214 03:12:24.550894 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 111/120
I0214 03:12:25.552329 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 112/120
I0214 03:12:26.553772 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 113/120
I0214 03:12:27.555428 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 114/120
I0214 03:12:28.557229 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 115/120
I0214 03:12:29.558774 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 116/120
I0214 03:12:30.560202 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 117/120
I0214 03:12:31.561903 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 118/120
I0214 03:12:32.563301 1509157 main.go:141] libmachine: (ha-447944-m03) Waiting for machine to stop 119/120
I0214 03:12:33.564555 1509157 stop.go:66] stop err: unable to stop vm, current state "Running"
W0214 03:12:33.564638 1509157 stop.go:165] stop host returned error: Temporary Error: stop: unable to stop vm, current state "Running"
I0214 03:12:33.566977 1509157 out.go:177]
W0214 03:12:33.568424 1509157 out.go:239] X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
W0214 03:12:33.568447 1509157 out.go:239] *
*
W0214 03:12:33.573483 1509157 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0214 03:12:33.575241 1509157 out.go:177]
** /stderr **
ha_test.go:464: failed to run minikube stop. args "out/minikube-linux-amd64 node list -p ha-447944 -v=7 --alsologtostderr" : exit status 82
ha_test.go:467: (dbg) Run: out/minikube-linux-amd64 start -p ha-447944 --wait=true -v=7 --alsologtostderr
E0214 03:15:56.222435 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:16:13.611255 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
ha_test.go:467: (dbg) Done: out/minikube-linux-amd64 start -p ha-447944 --wait=true -v=7 --alsologtostderr: (4m13.4843644s)
ha_test.go:472: (dbg) Run: out/minikube-linux-amd64 node list -p ha-447944
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p ha-447944 -n ha-447944
helpers_test.go:244: <<< TestHA/serial/RestartClusterKeepsNodes FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestHA/serial/RestartClusterKeepsNodes]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-447944 logs -n 25: (2.020504494s)
helpers_test.go:252: TestHA/serial/RestartClusterKeepsNodes logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m02:/home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04:/home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m04 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt | | | | | |
| cp | ha-447944 cp testdata/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04:/home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944-m04.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944:/home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m02:/home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m03:/home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m03 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| node | ha-447944 node stop m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | |
| | --alsologtostderr | | | | | |
| node | ha-447944 node start m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:09 UTC | |
| | --alsologtostderr | | | | | |
| node | list -p ha-447944 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:10 UTC | |
| | --alsologtostderr | | | | | |
| stop | -p ha-447944 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:10 UTC | |
| | --alsologtostderr | | | | | |
| start | -p ha-447944 --wait=true -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:12 UTC | 14 Feb 24 03:16 UTC |
| | --alsologtostderr | | | | | |
| node | list -p ha-447944 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:16 UTC | |
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 03:12:33
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 03:12:33.645080 1509522 out.go:291] Setting OutFile to fd 1 ...
I0214 03:12:33.645231 1509522 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:12:33.645241 1509522 out.go:304] Setting ErrFile to fd 2...
I0214 03:12:33.645246 1509522 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:12:33.645498 1509522 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:12:33.646121 1509522 out.go:298] Setting JSON to false
I0214 03:12:33.647228 1509522 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":21301,"bootTime":1707859053,"procs":185,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:12:33.647293 1509522 start.go:138] virtualization: kvm guest
I0214 03:12:33.650211 1509522 out.go:177] * [ha-447944] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 03:12:33.651940 1509522 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:12:33.652059 1509522 notify.go:220] Checking for updates...
I0214 03:12:33.653736 1509522 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:12:33.655602 1509522 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:12:33.657306 1509522 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:12:33.658786 1509522 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:12:33.660213 1509522 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:12:33.661988 1509522 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:12:33.662082 1509522 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:12:33.662521 1509522 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:12:33.662575 1509522 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:12:33.678968 1509522 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36709
I0214 03:12:33.679489 1509522 main.go:141] libmachine: () Calling .GetVersion
I0214 03:12:33.680081 1509522 main.go:141] libmachine: Using API Version 1
I0214 03:12:33.680113 1509522 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:12:33.680493 1509522 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:12:33.680742 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:12:33.718362 1509522 out.go:177] * Using the kvm2 driver based on existing profile
I0214 03:12:33.719849 1509522 start.go:296] selected driver: kvm2
I0214 03:12:33.719873 1509522 start.go:900] validating driver "kvm2" against &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer
sion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.98 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk
:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGI
D:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:12:33.720023 1509522 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:12:33.720440 1509522 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:12:33.720563 1509522 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 03:12:33.737659 1509522 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 03:12:33.738392 1509522 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:12:33.738469 1509522 cni.go:84] Creating CNI manager for ""
I0214 03:12:33.738488 1509522 cni.go:136] multinode detected (4 nodes found), recommending kindnet
I0214 03:12:33.738557 1509522 start.go:339] cluster config:
{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39
.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.98 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-till
er:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:
9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:12:33.738696 1509522 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:12:33.741186 1509522 out.go:177] * Starting "ha-447944" primary control-plane node in "ha-447944" cluster
I0214 03:12:33.742982 1509522 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:12:33.743049 1509522 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 03:12:33.743059 1509522 cache.go:56] Caching tarball of preloaded images
I0214 03:12:33.743178 1509522 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:12:33.743195 1509522 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:12:33.743373 1509522 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:12:33.743594 1509522 start.go:360] acquireMachinesLock for ha-447944: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:12:33.743647 1509522 start.go:364] duration metric: took 29.371µs to acquireMachinesLock for "ha-447944"
I0214 03:12:33.743664 1509522 start.go:96] Skipping create...Using existing machine configuration
I0214 03:12:33.743672 1509522 fix.go:54] fixHost starting:
I0214 03:12:33.744003 1509522 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:12:33.744048 1509522 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:12:33.759244 1509522 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41133
I0214 03:12:33.759750 1509522 main.go:141] libmachine: () Calling .GetVersion
I0214 03:12:33.760308 1509522 main.go:141] libmachine: Using API Version 1
I0214 03:12:33.760340 1509522 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:12:33.760789 1509522 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:12:33.761027 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:12:33.761236 1509522 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:12:33.763223 1509522 fix.go:112] recreateIfNeeded on ha-447944: state=Running err=<nil>
W0214 03:12:33.763260 1509522 fix.go:138] unexpected machine state, will restart: <nil>
I0214 03:12:33.765890 1509522 out.go:177] * Updating the running kvm2 "ha-447944" VM ...
I0214 03:12:33.767360 1509522 machine.go:94] provisionDockerMachine start ...
I0214 03:12:33.767392 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:12:33.767746 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:33.770528 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:33.771080 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:33.771117 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:33.771276 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:33.771469 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:33.771635 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:33.771770 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:33.771975 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:12:33.772352 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:12:33.772366 1509522 main.go:141] libmachine: About to run SSH command:
hostname
I0214 03:12:33.902822 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944
I0214 03:12:33.902862 1509522 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:12:33.903140 1509522 buildroot.go:166] provisioning hostname "ha-447944"
I0214 03:12:33.903173 1509522 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:12:33.903454 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:33.906210 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:33.906608 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:33.906640 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:33.906734 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:33.906970 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:33.907115 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:33.907259 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:33.907451 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:12:33.907938 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:12:33.907957 1509522 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-447944 && echo "ha-447944" | sudo tee /etc/hostname
I0214 03:12:34.049457 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944
I0214 03:12:34.049498 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:34.052431 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.052855 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.052891 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.053022 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:34.053185 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.053392 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.053586 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:34.053758 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:12:34.054075 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:12:34.054092 1509522 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-447944' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-447944/g' /etc/hosts;
else
echo '127.0.1.1 ha-447944' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:12:34.190606 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:12:34.190643 1509522 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:12:34.190701 1509522 buildroot.go:174] setting up certificates
I0214 03:12:34.190715 1509522 provision.go:84] configureAuth start
I0214 03:12:34.190729 1509522 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:12:34.191038 1509522 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:12:34.194271 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.194632 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.194662 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.194788 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:34.197424 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.197884 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.197913 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.198103 1509522 provision.go:143] copyHostCerts
I0214 03:12:34.198138 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:12:34.198198 1509522 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:12:34.198207 1509522 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:12:34.198268 1509522 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:12:34.198400 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:12:34.198423 1509522 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:12:34.198430 1509522 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:12:34.198460 1509522 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:12:34.198521 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:12:34.198542 1509522 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:12:34.198548 1509522 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:12:34.198569 1509522 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:12:34.198643 1509522 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ha-447944 san=[127.0.0.1 192.168.39.41 ha-447944 localhost minikube]
I0214 03:12:34.693567 1509522 provision.go:177] copyRemoteCerts
I0214 03:12:34.693645 1509522 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:12:34.693671 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:34.696813 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.697137 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.697173 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.697404 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:34.697616 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.697785 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:34.697959 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:12:34.792042 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:12:34.792126 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:12:34.818862 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:12:34.818950 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)
I0214 03:12:34.847632 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:12:34.847712 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 03:12:34.874153 1509522 provision.go:87] duration metric: took 683.423417ms to configureAuth
I0214 03:12:34.874183 1509522 buildroot.go:189] setting minikube options for container-runtime
I0214 03:12:34.874507 1509522 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:12:34.874613 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:34.877287 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.877794 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.877829 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.878014 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:34.878235 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.878503 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.878719 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:34.878929 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:12:34.879260 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:12:34.879277 1509522 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:14:05.884769 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:14:05.884836 1509522 machine.go:97] duration metric: took 1m32.117458789s to provisionDockerMachine
I0214 03:14:05.884860 1509522 start.go:293] postStartSetup for "ha-447944" (driver="kvm2")
I0214 03:14:05.884878 1509522 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:14:05.884900 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:05.885292 1509522 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:14:05.885333 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:05.888723 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:05.889271 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:05.889306 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:05.889518 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:05.889727 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:05.889924 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:05.890109 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:14:05.984607 1509522 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:14:05.988774 1509522 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:14:05.988801 1509522 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:14:05.988880 1509522 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:14:05.989041 1509522 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:14:05.989058 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:14:05.989148 1509522 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:14:05.998129 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:14:06.020440 1509522 start.go:296] duration metric: took 135.561868ms for postStartSetup
I0214 03:14:06.020497 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.020821 1509522 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup
I0214 03:14:06.020858 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:06.023825 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.024281 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.024306 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.024503 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:06.024716 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.024872 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:06.025011 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
W0214 03:14:06.115301 1509522 fix.go:99] cannot read backup folder, skipping restore: read dir: sudo ls --almost-all -1 /var/lib/minikube/backup: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/backup': No such file or directory
I0214 03:14:06.115337 1509522 fix.go:56] duration metric: took 1m32.371665422s for fixHost
I0214 03:14:06.115363 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:06.118400 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.118801 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.118850 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.118996 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:06.119207 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.119366 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.119461 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:06.119624 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:14:06.119974 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:14:06.119991 1509522 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:14:06.242271 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707880446.229501600
I0214 03:14:06.242303 1509522 fix.go:216] guest clock: 1707880446.229501600
I0214 03:14:06.242314 1509522 fix.go:229] Guest: 2024-02-14 03:14:06.2295016 +0000 UTC Remote: 2024-02-14 03:14:06.115345339 +0000 UTC m=+92.527766207 (delta=114.156261ms)
I0214 03:14:06.242345 1509522 fix.go:200] guest clock delta is within tolerance: 114.156261ms
I0214 03:14:06.242365 1509522 start.go:83] releasing machines lock for "ha-447944", held for 1m32.498707188s
I0214 03:14:06.242399 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.242677 1509522 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:14:06.245380 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.245726 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.245762 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.245864 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.246414 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.246594 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.246683 1509522 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:14:06.246748 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:06.246873 1509522 ssh_runner.go:195] Run: cat /version.json
I0214 03:14:06.246899 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:06.249622 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.249919 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.250059 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.250082 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.250216 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:06.250377 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.250500 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.250529 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.250548 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:06.250700 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:06.250769 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:14:06.250838 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.250991 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:06.251128 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:14:06.363423 1509522 ssh_runner.go:195] Run: systemctl --version
I0214 03:14:06.369290 1509522 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:14:06.526223 1509522 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:14:06.532254 1509522 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:14:06.532327 1509522 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:14:06.542364 1509522 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0214 03:14:06.542394 1509522 start.go:494] detecting cgroup driver to use...
I0214 03:14:06.542521 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:14:06.556446 1509522 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:14:06.568842 1509522 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:14:06.568908 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:14:06.581633 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:14:06.595198 1509522 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:14:06.758187 1509522 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:14:06.926961 1509522 docker.go:233] disabling docker service ...
I0214 03:14:06.927062 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:14:06.942615 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:14:06.978199 1509522 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:14:07.162063 1509522 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:14:07.316674 1509522 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:14:07.331977 1509522 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:14:07.349526 1509522 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:14:07.349606 1509522 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:14:07.360315 1509522 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:14:07.360411 1509522 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:14:07.370552 1509522 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:14:07.380849 1509522 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:14:07.391254 1509522 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:14:07.402298 1509522 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:14:07.411584 1509522 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:14:07.420975 1509522 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:14:07.572927 1509522 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:14:15.469765 1509522 ssh_runner.go:235] Completed: sudo systemctl restart crio: (7.896787688s)
I0214 03:14:15.469813 1509522 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:14:15.469909 1509522 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:14:15.476175 1509522 start.go:562] Will wait 60s for crictl version
I0214 03:14:15.476250 1509522 ssh_runner.go:195] Run: which crictl
I0214 03:14:15.480622 1509522 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:14:15.521069 1509522 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:14:15.521163 1509522 ssh_runner.go:195] Run: crio --version
I0214 03:14:15.573452 1509522 ssh_runner.go:195] Run: crio --version
I0214 03:14:15.625672 1509522 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:14:15.627392 1509522 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:14:15.630425 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:15.630806 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:15.630836 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:15.631140 1509522 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:14:15.636172 1509522 kubeadm.go:877] updating cluster {Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cl
usterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.98 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false fres
hpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mo
untIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 03:14:15.636343 1509522 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:14:15.636398 1509522 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:14:15.683815 1509522 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:14:15.683844 1509522 crio.go:415] Images already preloaded, skipping extraction
I0214 03:14:15.683920 1509522 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:14:15.721722 1509522 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:14:15.721751 1509522 cache_images.go:84] Images are preloaded, skipping loading
I0214 03:14:15.721761 1509522 kubeadm.go:928] updating node { 192.168.39.41 8443 v1.28.4 crio true true} ...
I0214 03:14:15.721925 1509522 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-447944 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.41
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:14:15.722010 1509522 ssh_runner.go:195] Run: crio config
I0214 03:14:15.797880 1509522 cni.go:84] Creating CNI manager for ""
I0214 03:14:15.797913 1509522 cni.go:136] multinode detected (4 nodes found), recommending kindnet
I0214 03:14:15.797924 1509522 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 03:14:15.797947 1509522 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.41 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-447944 NodeName:ha-447944 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.41 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/m
anifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 03:14:15.798128 1509522 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.41
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "ha-447944"
kubeletExtraArgs:
node-ip: 192.168.39.41
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.41"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 03:14:15.798159 1509522 kube-vip.go:101] generating kube-vip config ...
I0214 03:14:15.798258 1509522 kube-vip.go:121] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_ddns
value: "false"
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v0.7.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0214 03:14:15.798318 1509522 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:14:15.808211 1509522 binaries.go:44] Found k8s binaries, skipping transfer
I0214 03:14:15.808304 1509522 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
I0214 03:14:15.817959 1509522 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (308 bytes)
I0214 03:14:15.835487 1509522 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:14:15.852144 1509522 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2150 bytes)
I0214 03:14:15.869586 1509522 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1265 bytes)
I0214 03:14:15.887549 1509522 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0214 03:14:15.891621 1509522 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:14:16.053128 1509522 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:14:16.066181 1509522 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944 for IP: 192.168.39.41
I0214 03:14:16.066214 1509522 certs.go:194] generating shared ca certs ...
I0214 03:14:16.066236 1509522 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:14:16.066516 1509522 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:14:16.066576 1509522 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:14:16.066591 1509522 certs.go:256] generating profile certs ...
I0214 03:14:16.066700 1509522 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key
I0214 03:14:16.066726 1509522 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.11217c11
I0214 03:14:16.066742 1509522 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.11217c11 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41 192.168.39.218 192.168.39.133 192.168.39.254]
I0214 03:14:16.241321 1509522 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.11217c11 ...
I0214 03:14:16.241361 1509522 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.11217c11: {Name:mkf7d7c56b89f83726544d8c2c4fed81e9cc7a24 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:14:16.241542 1509522 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.11217c11 ...
I0214 03:14:16.241553 1509522 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.11217c11: {Name:mkec118e62be385b487daecb1f8cb4754bed405f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:14:16.241622 1509522 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.11217c11 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt
I0214 03:14:16.241757 1509522 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.11217c11 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key
I0214 03:14:16.241935 1509522 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key
I0214 03:14:16.241955 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:14:16.241967 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:14:16.241984 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:14:16.241996 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:14:16.242008 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:14:16.242019 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:14:16.242031 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:14:16.242042 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:14:16.242088 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:14:16.242120 1509522 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:14:16.242130 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:14:16.242155 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:14:16.242180 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:14:16.242204 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:14:16.242250 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:14:16.242283 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:14:16.242297 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:14:16.242312 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:14:16.242926 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:14:16.268996 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:14:16.292596 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:14:16.316172 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:14:16.339057 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0214 03:14:16.362839 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 03:14:16.386853 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:14:16.410721 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:14:16.434101 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:14:16.457790 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:14:16.481796 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:14:16.505839 1509522 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 03:14:16.522061 1509522 ssh_runner.go:195] Run: openssl version
I0214 03:14:16.528216 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:14:16.538243 1509522 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:14:16.543052 1509522 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:14:16.543129 1509522 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:14:16.549617 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:14:16.558126 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:14:16.567959 1509522 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:14:16.572825 1509522 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:14:16.572881 1509522 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:14:16.578749 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:14:16.587159 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:14:16.597160 1509522 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:14:16.602082 1509522 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:14:16.602156 1509522 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:14:16.607955 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:14:16.616440 1509522 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:14:16.621598 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 03:14:16.627363 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 03:14:16.633047 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 03:14:16.638975 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 03:14:16.644987 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 03:14:16.650781 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 03:14:16.656502 1509522 kubeadm.go:391] StartCluster: {Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Clust
erName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.98 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpo
d:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mount
IP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:14:16.656632 1509522 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 03:14:16.656679 1509522 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 03:14:16.703016 1509522 cri.go:89] found id: "1d958f621a195ca659dc9d3e8056d4e8ddf52662c2ddea5b22ba390145397ecf"
I0214 03:14:16.703072 1509522 cri.go:89] found id: "8e8843384931f0f1dd890924b8b5258840ef0cac2c83ed3a94b72125a5b9f419"
I0214 03:14:16.703079 1509522 cri.go:89] found id: "9c0d6e2c3970eb154d4519049f26feee92df3d0bfbe0c4d845f3bc23943470d5"
I0214 03:14:16.703086 1509522 cri.go:89] found id: "29a8efede416a511267720d5615d2844fad1fdfc000ffd014639e321215715f0"
I0214 03:14:16.703092 1509522 cri.go:89] found id: "002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1"
I0214 03:14:16.703099 1509522 cri.go:89] found id: "671171bd8cc89d2576e6f5d6e07feb4d4fe4fe637d7d07167f06fbea9e5d6b6b"
I0214 03:14:16.703104 1509522 cri.go:89] found id: "f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e"
I0214 03:14:16.703110 1509522 cri.go:89] found id: "7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb"
I0214 03:14:16.703115 1509522 cri.go:89] found id: "2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f"
I0214 03:14:16.703125 1509522 cri.go:89] found id: "9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62"
I0214 03:14:16.703132 1509522 cri.go:89] found id: "322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2"
I0214 03:14:16.703137 1509522 cri.go:89] found id: "a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721"
I0214 03:14:16.703155 1509522 cri.go:89] found id: "31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72"
I0214 03:14:16.703172 1509522 cri.go:89] found id: "7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:14:16.703180 1509522 cri.go:89] found id: ""
I0214 03:14:16.703235 1509522 ssh_runner.go:195] Run: sudo runc list -f json
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 03:02:18 UTC, ends at Wed 2024-02-14 03:16:48 UTC. --
Feb 14 03:16:47 ha-447944 crio[4018]: time="2024-02-14 03:16:47.932062106Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880607932036701,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=10443ac5-2cfd-4f2b-9de8-ccd81ca245e5 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:16:47 ha-447944 crio[4018]: time="2024-02-14 03:16:47.933136180Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=5e34cfa4-032a-4c65-8449-7b1768ca9967 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:47 ha-447944 crio[4018]: time="2024-02-14 03:16:47.933380205Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=5e34cfa4-032a-4c65-8449-7b1768ca9967 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:47 ha-447944 crio[4018]: time="2024-02-14 03:16:47.943287779Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d49010a435f805fdaa81a933b8602924eae916d4d13529e55be715e2fca134bf,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:5,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707880558375845195,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 5,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:3,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707880530374555537,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707880501369663611,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,
io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb877c1667c5983dfd4d752ab326efd428cbb60e52261a067ffc36c092d32a76,PodSandboxId:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707880499365235819,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationM
essagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707880495797575340,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3,PodSandboxId:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707880466752063240,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File
,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1f4281f55f26c33b938f410960218282f5a3f1952e36b297b89df9d270141e1,PodSandboxId:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:3,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707880466653293185,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod:
30,},},&Container{Id:98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:4,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707880466499359982,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 3
0,},},&Container{Id:bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:2,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_EXITED,CreatedAt:1707880464660242452,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2a1ab1ca2803be33d
52be000913a21ae8ebe73526caa9e55323458de9d01ff2d,PodSandboxId:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880464463440705,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c,PodSandboxId:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880463294898029,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"p
rotocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c,PodSandboxId:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707880462772250687,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496f
b97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06,PodSandboxId:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707880462577064284,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe8127
75,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_EXITED,CreatedAt:1707880462147440873,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7
ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_EXITED,CreatedAt:1707880461990603612,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,}
,Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:2,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,State:CONTAINER_EXITED,CreatedAt:1707880255375588099,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kub
ernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707879954989619467,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791127180684,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tc
p\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791198215175,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string
]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707879785334161721,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kuberne
tes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707879764453282079,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernete
s.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707879764473302548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:
map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=5e34cfa4-032a-4c65-8449-7b1768ca9967 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.007062249Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=d1e1114d-81b7-4bbf-a51a-d375e6d0bf50 name=/runtime.v1.RuntimeService/Version
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.007187593Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=d1e1114d-81b7-4bbf-a51a-d375e6d0bf50 name=/runtime.v1.RuntimeService/Version
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.008533266Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=48180e65-dda4-4521-b6e2-74a3511d5037 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.009098369Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880608009081003,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=48180e65-dda4-4521-b6e2-74a3511d5037 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.010116118Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=f4cefd1d-689d-4f9a-8049-46624edde12e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.010211302Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=f4cefd1d-689d-4f9a-8049-46624edde12e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.010652197Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d49010a435f805fdaa81a933b8602924eae916d4d13529e55be715e2fca134bf,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:5,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707880558375845195,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 5,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:3,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707880530374555537,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707880501369663611,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,
io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb877c1667c5983dfd4d752ab326efd428cbb60e52261a067ffc36c092d32a76,PodSandboxId:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707880499365235819,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationM
essagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707880495797575340,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3,PodSandboxId:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707880466752063240,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File
,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1f4281f55f26c33b938f410960218282f5a3f1952e36b297b89df9d270141e1,PodSandboxId:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:3,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707880466653293185,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod:
30,},},&Container{Id:98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:4,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707880466499359982,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 3
0,},},&Container{Id:bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:2,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_EXITED,CreatedAt:1707880464660242452,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2a1ab1ca2803be33d
52be000913a21ae8ebe73526caa9e55323458de9d01ff2d,PodSandboxId:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880464463440705,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c,PodSandboxId:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880463294898029,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"p
rotocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c,PodSandboxId:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707880462772250687,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496f
b97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06,PodSandboxId:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707880462577064284,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe8127
75,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_EXITED,CreatedAt:1707880462147440873,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7
ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_EXITED,CreatedAt:1707880461990603612,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,}
,Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:2,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,State:CONTAINER_EXITED,CreatedAt:1707880255375588099,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kub
ernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707879954989619467,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791127180684,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tc
p\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791198215175,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string
]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707879785334161721,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kuberne
tes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707879764453282079,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernete
s.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707879764473302548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:
map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=f4cefd1d-689d-4f9a-8049-46624edde12e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.069487991Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=505ea7da-660b-40d7-8fa7-926796c10414 name=/runtime.v1.RuntimeService/Version
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.069574798Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=505ea7da-660b-40d7-8fa7-926796c10414 name=/runtime.v1.RuntimeService/Version
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.070572328Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=f2afb8c5-843e-4243-b456-c198531bdb6e name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.071188816Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880608071169928,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=f2afb8c5-843e-4243-b456-c198531bdb6e name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.071885549Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=0fd35595-f386-42a1-bbe8-90f3ceb3e400 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.072007758Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=0fd35595-f386-42a1-bbe8-90f3ceb3e400 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.072467850Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d49010a435f805fdaa81a933b8602924eae916d4d13529e55be715e2fca134bf,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:5,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707880558375845195,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 5,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:3,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707880530374555537,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707880501369663611,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,
io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb877c1667c5983dfd4d752ab326efd428cbb60e52261a067ffc36c092d32a76,PodSandboxId:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707880499365235819,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationM
essagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707880495797575340,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3,PodSandboxId:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707880466752063240,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File
,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1f4281f55f26c33b938f410960218282f5a3f1952e36b297b89df9d270141e1,PodSandboxId:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:3,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707880466653293185,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod:
30,},},&Container{Id:98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:4,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707880466499359982,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 3
0,},},&Container{Id:bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:2,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_EXITED,CreatedAt:1707880464660242452,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2a1ab1ca2803be33d
52be000913a21ae8ebe73526caa9e55323458de9d01ff2d,PodSandboxId:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880464463440705,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c,PodSandboxId:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880463294898029,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"p
rotocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c,PodSandboxId:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707880462772250687,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496f
b97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06,PodSandboxId:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707880462577064284,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe8127
75,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_EXITED,CreatedAt:1707880462147440873,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7
ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_EXITED,CreatedAt:1707880461990603612,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,}
,Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:2,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,State:CONTAINER_EXITED,CreatedAt:1707880255375588099,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kub
ernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707879954989619467,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791127180684,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tc
p\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791198215175,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string
]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707879785334161721,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kuberne
tes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707879764453282079,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernete
s.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707879764473302548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:
map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=0fd35595-f386-42a1-bbe8-90f3ceb3e400 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.114596949Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=a181b930-62f1-4664-b918-e13eb429e1ac name=/runtime.v1.RuntimeService/Version
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.114666097Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=a181b930-62f1-4664-b918-e13eb429e1ac name=/runtime.v1.RuntimeService/Version
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.116375679Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=2e6a136c-83cc-4d03-a5b3-ef5ff610b451 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.116947583Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880608116930455,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=2e6a136c-83cc-4d03-a5b3-ef5ff610b451 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.117546458Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=5bb387de-35c5-4298-ad5a-ae1ef0dafd42 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.117623773Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=5bb387de-35c5-4298-ad5a-ae1ef0dafd42 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:16:48 ha-447944 crio[4018]: time="2024-02-14 03:16:48.118455417Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d49010a435f805fdaa81a933b8602924eae916d4d13529e55be715e2fca134bf,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:5,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707880558375845195,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 5,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:3,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707880530374555537,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707880501369663611,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,
io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb877c1667c5983dfd4d752ab326efd428cbb60e52261a067ffc36c092d32a76,PodSandboxId:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707880499365235819,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationM
essagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707880495797575340,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3,PodSandboxId:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707880466752063240,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File
,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1f4281f55f26c33b938f410960218282f5a3f1952e36b297b89df9d270141e1,PodSandboxId:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:3,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707880466653293185,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod:
30,},},&Container{Id:98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:4,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707880466499359982,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 3
0,},},&Container{Id:bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:2,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_EXITED,CreatedAt:1707880464660242452,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2a1ab1ca2803be33d
52be000913a21ae8ebe73526caa9e55323458de9d01ff2d,PodSandboxId:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880464463440705,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c,PodSandboxId:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880463294898029,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"p
rotocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c,PodSandboxId:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707880462772250687,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496f
b97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06,PodSandboxId:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707880462577064284,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe8127
75,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_EXITED,CreatedAt:1707880462147440873,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7
ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_EXITED,CreatedAt:1707880461990603612,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,}
,Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:2,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,State:CONTAINER_EXITED,CreatedAt:1707880255375588099,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kub
ernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707879954989619467,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791127180684,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tc
p\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791198215175,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string
]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707879785334161721,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kuberne
tes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707879764453282079,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernete
s.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707879764473302548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:
map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=5bb387de-35c5-4298-ad5a-ae1ef0dafd42 name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
d49010a435f80 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 49 seconds ago Running storage-provisioner 5 10949bd67a6bc storage-provisioner
4bfa5af0ec20f c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc About a minute ago Running kindnet-cni 3 b4690b55c83f8 kindnet-pjrmh
bc90f93033473 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 About a minute ago Running kube-apiserver 3 03d5368023625 kube-apiserver-ha-447944
cb877c1667c59 8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a About a minute ago Running busybox 1 02b2e8f3ce368 busybox-5b5d89c9d6-szrmk
c22fff8dbdc28 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 About a minute ago Running kube-controller-manager 2 8ed4381cd998c kube-controller-manager-ha-447944
776fb551af350 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 2 minutes ago Running kube-proxy 1 5c760303d8dde kube-proxy-dpm4f
d1f4281f55f26 77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e 2 minutes ago Running kube-vip 3 d81f26b4fcf93 kube-vip-ha-447944
98210e700c7fa 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 2 minutes ago Exited storage-provisioner 4 10949bd67a6bc storage-provisioner
bcb97d264d1f1 c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc 2 minutes ago Exited kindnet-cni 2 b4690b55c83f8 kindnet-pjrmh
2a1ab1ca2803b ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 2 minutes ago Running coredns 1 b2c8bba1aa322 coredns-5dd5756b68-rpnsx
72c1c5c3b503c ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 2 minutes ago Running coredns 1 e1bddd2aa1d92 coredns-5dd5756b68-chs9l
f8a4151cdb5ee 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 2 minutes ago Running etcd 1 cc6ee8e655599 etcd-ha-447944
35ec096957d69 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 2 minutes ago Running kube-scheduler 1 9c11700337b20 kube-scheduler-ha-447944
e84f8f9869e55 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 2 minutes ago Exited kube-controller-manager 1 8ed4381cd998c kube-controller-manager-ha-447944
5ec156699f6e7 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 2 minutes ago Exited kube-apiserver 2 03d5368023625 kube-apiserver-ha-447944
002a79d38b1f4 77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e 5 minutes ago Exited kube-vip 2 40d66b939fbde kube-vip-ha-447944
158ed81c1ad09 gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 10 minutes ago Exited busybox 0 ae707b68d26d7 busybox-5b5d89c9d6-szrmk
f046573e5c613 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 13 minutes ago Exited coredns 0 f5b7a259c6576 coredns-5dd5756b68-rpnsx
7e9bb46f5e644 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 13 minutes ago Exited coredns 0 9646d9ad7639e coredns-5dd5756b68-chs9l
9d1286d601bde 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 13 minutes ago Exited kube-proxy 0 c168dfe284262 kube-proxy-dpm4f
322a42a79321e e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 14 minutes ago Exited kube-scheduler 0 fc67797793fd2 kube-scheduler-ha-447944
a8ad5c38dc289 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 14 minutes ago Exited etcd 0 bb35989a47301 etcd-ha-447944
==> coredns [2a1ab1ca2803be33d52be000913a21ae8ebe73526caa9e55323458de9d01ff2d] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:40056 - 28650 "HINFO IN 2285009284393712744.3131797207477244586. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.030016963s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": net/http: TLS handshake timeout
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: read tcp 10.244.0.5:54458->10.96.0.1:443: read: connection reset by peer
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> coredns [72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:34101 - 42017 "HINFO IN 5146137997769423191.5072381909957528507. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.028935984s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": net/http: TLS handshake timeout
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: read tcp 10.244.0.6:59250->10.96.0.1:443: read: connection reset by peer
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: no route to host
==> coredns [7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb] <==
[INFO] 10.244.1.2:56830 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000207364s
[INFO] 10.244.1.2:53196 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000201609s
[INFO] 10.244.0.4:57282 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000255022s
[INFO] 10.244.0.4:42175 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000101666s
[INFO] 10.244.0.4:47990 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001543994s
[INFO] 10.244.2.2:36297 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000098014s
[INFO] 10.244.2.2:55624 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001606173s
[INFO] 10.244.1.2:42215 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000164975s
[INFO] 10.244.1.2:56863 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00013524s
[INFO] 10.244.0.4:54854 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000077245s
[INFO] 10.244.2.2:47287 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000112202s
[INFO] 10.244.2.2:57185 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000259211s
[INFO] 10.244.2.2:34362 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00020542s
[INFO] 10.244.2.2:35530 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000085011s
[INFO] 10.244.1.2:55025 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000219197s
[INFO] 10.244.1.2:41871 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000278055s
[INFO] 10.244.0.4:34459 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000106414s
[INFO] 10.244.0.4:49400 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000157055s
[INFO] 10.244.0.4:45347 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000226252s
[INFO] 10.244.2.2:56178 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000172264s
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?allowWatchBookmarks=true&resourceVersion=1825&timeout=9m40s&timeoutSeconds=580&watch=true": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.Service: Get "https://10.96.0.1:443/api/v1/services?allowWatchBookmarks=true&resourceVersion=1870&timeout=6m22s&timeoutSeconds=382&watch=true": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?allowWatchBookmarks=true&resourceVersion=1872&timeout=9m41s&timeoutSeconds=581&watch=true": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> coredns [f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e] <==
[INFO] 10.244.0.4:59564 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00011757s
[INFO] 10.244.0.4:57775 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000059017s
[INFO] 10.244.0.4:50120 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000078756s
[INFO] 10.244.2.2:49507 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000141378s
[INFO] 10.244.2.2:49171 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001957068s
[INFO] 10.244.2.2:33740 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000387227s
[INFO] 10.244.2.2:35506 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000108121s
[INFO] 10.244.2.2:58270 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000096656s
[INFO] 10.244.2.2:47275 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000113722s
[INFO] 10.244.1.2:39124 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000232628s
[INFO] 10.244.1.2:36677 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000104764s
[INFO] 10.244.0.4:52867 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000150283s
[INFO] 10.244.0.4:39534 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000098645s
[INFO] 10.244.0.4:52205 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000134847s
[INFO] 10.244.1.2:57709 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000561618s
[INFO] 10.244.1.2:44823 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000149413s
[INFO] 10.244.0.4:53053 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000090637s
[INFO] 10.244.2.2:59333 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000158454s
[INFO] 10.244.2.2:48734 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000320234s
[INFO] 10.244.2.2:57167 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000155417s
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.Namespace: the server has asked for the client to provide credentials (get namespaces) - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.Service: the server has asked for the client to provide credentials (get services) - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.EndpointSlice: the server has asked for the client to provide credentials (get endpointslices.discovery.k8s.io) - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> describe nodes <==
Name: ha-447944
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T03_02_54_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:02:50 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:16:43 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:15:04 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:15:04 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:15:04 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:15:04 +0000 Wed, 14 Feb 2024 03:03:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.41
Hostname: ha-447944
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: a6361e2fe77648efb80ef77ef65e19b9
System UUID: a6361e2f-e776-48ef-b80e-f77ef65e19b9
Boot ID: 028eaefa-0af8-4862-9bdb-3627e617e5df
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-szrmk 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system coredns-5dd5756b68-chs9l 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 13m
kube-system coredns-5dd5756b68-rpnsx 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 13m
kube-system etcd-ha-447944 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system kindnet-pjrmh 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 13m
kube-system kube-apiserver-ha-447944 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system kube-controller-manager-ha-447944 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system kube-proxy-dpm4f 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system kube-scheduler-ha-447944 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system kube-vip-ha-447944 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 290Mi (13%!)(MISSING) 390Mi (18%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 97s kube-proxy
Normal Starting 13m kube-proxy
Normal NodeHasSufficientMemory 14m (x8 over 14m) kubelet Node ha-447944 status is now: NodeHasSufficientMemory
Normal NodeAllocatableEnforced 14m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientPID 14m (x7 over 14m) kubelet Node ha-447944 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 14m (x8 over 14m) kubelet Node ha-447944 status is now: NodeHasNoDiskPressure
Normal Starting 14m kubelet Starting kubelet.
Normal NodeAllocatableEnforced 13m kubelet Updated Node Allocatable limit across pods
Normal Starting 13m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 13m kubelet Node ha-447944 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 13m kubelet Node ha-447944 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 13m kubelet Node ha-447944 status is now: NodeHasSufficientPID
Normal RegisteredNode 13m node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal NodeReady 13m kubelet Node ha-447944 status is now: NodeReady
Normal RegisteredNode 12m node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal RegisteredNode 11m node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Warning ContainerGCFailed 2m55s (x2 over 3m55s) kubelet rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
Normal RegisteredNode 92s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal RegisteredNode 90s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal RegisteredNode 24s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Name: ha-447944-m02
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_04_17_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:04:00 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m02
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:16:39 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:15:48 +0000 Wed, 14 Feb 2024 03:15:07 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:15:48 +0000 Wed, 14 Feb 2024 03:15:07 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:15:48 +0000 Wed, 14 Feb 2024 03:15:07 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:15:48 +0000 Wed, 14 Feb 2024 03:15:07 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.218
Hostname: ha-447944-m02
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 535bf6eb4ee34dd6b837047738e23b84
System UUID: 535bf6eb-4ee3-4dd6-b837-047738e23b84
Boot ID: c9f45ceb-0d25-46ab-8e95-81772c4d30d0
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-mjds9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system etcd-ha-447944-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 12m
kube-system kindnet-xkmkd 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 12m
kube-system kube-apiserver-ha-447944-m02 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
kube-system kube-controller-manager-ha-447944-m02 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
kube-system kube-proxy-9cjk2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
kube-system kube-scheduler-ha-447944-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
kube-system kube-vip-ha-447944-m02 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 100m (5%!)(MISSING)
memory 150Mi (7%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 12m kube-proxy
Normal Starting 96s kube-proxy
Normal RegisteredNode 12m node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal RegisteredNode 11m node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal NodeNotReady 9m6s node-controller Node ha-447944-m02 status is now: NodeNotReady
Normal NodeHasNoDiskPressure 2m9s (x8 over 2m9s) kubelet Node ha-447944-m02 status is now: NodeHasNoDiskPressure
Normal Starting 2m9s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 2m9s (x8 over 2m9s) kubelet Node ha-447944-m02 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 2m9s (x7 over 2m9s) kubelet Node ha-447944-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 2m9s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 92s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal RegisteredNode 90s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal RegisteredNode 24s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Name: ha-447944-m03
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m03
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_05_32_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:05:28 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m03
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:16:47 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:16:16 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:16:16 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:16:16 +0000 Wed, 14 Feb 2024 03:05:28 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:16:16 +0000 Wed, 14 Feb 2024 03:05:39 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.133
Hostname: ha-447944-m03
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: c5406b0ff7684df1879332816ce20376
System UUID: c5406b0f-f768-4df1-8793-32816ce20376
Boot ID: aea00732-a702-4bba-92b4-37280ce2d701
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.2.0/24
PodCIDRs: 10.244.2.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-v4857 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system etcd-ha-447944-m03 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system kindnet-xwqhp 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 11m
kube-system kube-apiserver-ha-447944-m03 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system kube-controller-manager-ha-447944-m03 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system kube-proxy-rz6vt 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system kube-scheduler-ha-447944-m03 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system kube-vip-ha-447944-m03 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 100m (5%!)(MISSING)
memory 150Mi (7%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 11m kube-proxy
Normal Starting 38s kube-proxy
Normal RegisteredNode 11m node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal RegisteredNode 11m node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal RegisteredNode 11m node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal RegisteredNode 92s node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal RegisteredNode 90s node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Normal Starting 62s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 62s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 62s kubelet Node ha-447944-m03 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 62s kubelet Node ha-447944-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 62s kubelet Node ha-447944-m03 status is now: NodeHasSufficientPID
Warning Rebooted 62s kubelet Node ha-447944-m03 has been rebooted, boot id: aea00732-a702-4bba-92b4-37280ce2d701
Normal RegisteredNode 24s node-controller Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller
Name: ha-447944-m04
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m04
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_06_31_0700
minikube.k8s.io/version=v1.32.0
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:06:30 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m04
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:16:40 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:16:40 +0000 Wed, 14 Feb 2024 03:16:40 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:16:40 +0000 Wed, 14 Feb 2024 03:16:40 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:16:40 +0000 Wed, 14 Feb 2024 03:16:40 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:16:40 +0000 Wed, 14 Feb 2024 03:16:40 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.98
Hostname: ha-447944-m04
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: d8594ac4943e4e6ca3585573b6de953f
System UUID: d8594ac4-943e-4e6c-a358-5573b6de953f
Boot ID: 9d74b5a0-00c2-4b8e-ab27-e09751cadbe4
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.3.0/24
PodCIDRs: 10.244.3.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system kindnet-ldndh 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 10m
kube-system kube-proxy-jrhq2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 10m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4s kube-proxy
Normal Starting 10m kube-proxy
Normal NodeHasSufficientMemory 10m (x5 over 10m) kubelet Node ha-447944-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 10m (x5 over 10m) kubelet Node ha-447944-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 10m (x5 over 10m) kubelet Node ha-447944-m04 status is now: NodeHasSufficientPID
Normal RegisteredNode 10m node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 10m node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 10m node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal NodeReady 10m kubelet Node ha-447944-m04 status is now: NodeReady
Normal RegisteredNode 92s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 90s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal NodeNotReady 52s node-controller Node ha-447944-m04 status is now: NodeNotReady
Normal RegisteredNode 24s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal Starting 8s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 8s kubelet Updated Node Allocatable limit across pods
Warning Rebooted 8s kubelet Node ha-447944-m04 has been rebooted, boot id: 9d74b5a0-00c2-4b8e-ab27-e09751cadbe4
Normal NodeHasSufficientMemory 8s (x2 over 8s) kubelet Node ha-447944-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8s (x2 over 8s) kubelet Node ha-447944-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8s (x2 over 8s) kubelet Node ha-447944-m04 status is now: NodeHasSufficientPID
Normal NodeReady 8s kubelet Node ha-447944-m04 status is now: NodeReady
==> dmesg <==
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.067171] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.354129] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.296154] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.134944] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.012559] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +9.434119] systemd-fstab-generator[642]: Ignoring "noauto" for root device
[ +0.104064] systemd-fstab-generator[653]: Ignoring "noauto" for root device
[ +0.157556] systemd-fstab-generator[666]: Ignoring "noauto" for root device
[ +0.109767] systemd-fstab-generator[677]: Ignoring "noauto" for root device
[ +0.213788] systemd-fstab-generator[702]: Ignoring "noauto" for root device
[ +5.352315] systemd-fstab-generator[804]: Ignoring "noauto" for root device
[ +3.604175] systemd-fstab-generator[984]: Ignoring "noauto" for root device
[ +10.810722] systemd-fstab-generator[1413]: Ignoring "noauto" for root device
[Feb14 03:03] kauditd_printk_skb: 18 callbacks suppressed
[Feb14 03:14] systemd-fstab-generator[3946]: Ignoring "noauto" for root device
[ +0.165805] systemd-fstab-generator[3957]: Ignoring "noauto" for root device
[ +0.237773] systemd-fstab-generator[3970]: Ignoring "noauto" for root device
[ +0.162041] systemd-fstab-generator[3981]: Ignoring "noauto" for root device
[ +0.259850] systemd-fstab-generator[4004]: Ignoring "noauto" for root device
[ +8.475204] systemd-fstab-generator[4110]: Ignoring "noauto" for root device
==> etcd [a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721] <==
WARNING: 2024/02/14 03:12:35 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
{"level":"warn","ts":"2024-02-14T03:12:35.094458Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T03:12:33.876243Z","time spent":"1.218212066s","remote":"127.0.0.1:59278","response type":"/etcdserverpb.KV/Range","request count":0,"request size":43,"response count":0,"response size":0,"request content":"key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" limit:10000 "}
WARNING: 2024/02/14 03:12:35 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
{"level":"warn","ts":"2024-02-14T03:12:35.094556Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T03:12:34.113919Z","time spent":"980.629855ms","remote":"127.0.0.1:59246","response type":"/etcdserverpb.KV/Range","request count":0,"request size":57,"response count":0,"response size":0,"request content":"key:\"/registry/services/specs/\" range_end:\"/registry/services/specs0\" limit:500 "}
WARNING: 2024/02/14 03:12:35 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
{"level":"warn","ts":"2024-02-14T03:12:35.125816Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.39.41:2379: use of closed network connection"}
{"level":"warn","ts":"2024-02-14T03:12:35.125886Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.39.41:2379: use of closed network connection"}
{"level":"info","ts":"2024-02-14T03:12:35.127568Z","caller":"etcdserver/server.go:1456","msg":"skipped leadership transfer; local server is not leader","local-member-id":"903e0dada8362847","current-leader-member-id":"0"}
{"level":"info","ts":"2024-02-14T03:12:35.127867Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.127924Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.127957Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128068Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128114Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128178Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128216Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128225Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128234Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128259Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128333Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128389Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128419Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128429Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.132021Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.39.41:2380"}
{"level":"info","ts":"2024-02-14T03:12:35.13211Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.39.41:2380"}
{"level":"info","ts":"2024-02-14T03:12:35.132147Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"ha-447944","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.41:2380"],"advertise-client-urls":["https://192.168.39.41:2379"]}
==> etcd [f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c] <==
{"level":"warn","ts":"2024-02-14T03:15:44.978058Z","caller":"etcdserver/cluster_util.go:155","msg":"failed to get version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:45.586784Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"277527925922cf1a","rtt":"0s","error":"dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:45.586863Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"277527925922cf1a","rtt":"0s","error":"dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:48.979827Z","caller":"etcdserver/cluster_util.go:288","msg":"failed to reach the peer URL","address":"https://192.168.39.133:2380/version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:48.979969Z","caller":"etcdserver/cluster_util.go:155","msg":"failed to get version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:50.586987Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"277527925922cf1a","rtt":"0s","error":"dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:50.587085Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"277527925922cf1a","rtt":"0s","error":"dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:52.981798Z","caller":"etcdserver/cluster_util.go:288","msg":"failed to reach the peer URL","address":"https://192.168.39.133:2380/version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:52.981879Z","caller":"etcdserver/cluster_util.go:155","msg":"failed to get version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:55.588139Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"277527925922cf1a","rtt":"0s","error":"dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:55.588339Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"277527925922cf1a","rtt":"0s","error":"dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:56.984587Z","caller":"etcdserver/cluster_util.go:288","msg":"failed to reach the peer URL","address":"https://192.168.39.133:2380/version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:15:56.984697Z","caller":"etcdserver/cluster_util.go:155","msg":"failed to get version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:16:00.58908Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"277527925922cf1a","rtt":"0s","error":"dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:16:00.589096Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"277527925922cf1a","rtt":"0s","error":"dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:16:00.987546Z","caller":"etcdserver/cluster_util.go:288","msg":"failed to reach the peer URL","address":"https://192.168.39.133:2380/version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"warn","ts":"2024-02-14T03:16:00.987686Z","caller":"etcdserver/cluster_util.go:155","msg":"failed to get version","remote-member-id":"277527925922cf1a","error":"Get \"https://192.168.39.133:2380/version\": dial tcp 192.168.39.133:2380: connect: connection refused"}
{"level":"info","ts":"2024-02-14T03:16:05.038595Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:05.038776Z","caller":"rafthttp/stream.go:412","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:05.041064Z","caller":"rafthttp/stream.go:412","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:05.05592Z","caller":"rafthttp/stream.go:249","msg":"set message encoder","from":"903e0dada8362847","to":"277527925922cf1a","stream-type":"stream MsgApp v2"}
{"level":"info","ts":"2024-02-14T03:16:05.056033Z","caller":"rafthttp/stream.go:274","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:05.062164Z","caller":"rafthttp/stream.go:249","msg":"set message encoder","from":"903e0dada8362847","to":"277527925922cf1a","stream-type":"stream Message"}
{"level":"info","ts":"2024-02-14T03:16:05.062516Z","caller":"rafthttp/stream.go:274","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:47.261553Z","caller":"traceutil/trace.go:171","msg":"trace[118098276] transaction","detail":"{read_only:false; response_revision:2488; number_of_response:1; }","duration":"123.64374ms","start":"2024-02-14T03:16:47.137867Z","end":"2024-02-14T03:16:47.261511Z","steps":["trace[118098276] 'process raft request' (duration: 123.341308ms)"],"step_count":1}
==> kernel <==
03:16:48 up 14 min, 0 users, load average: 0.34, 0.71, 0.51
Linux ha-447944 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kindnet [4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb] <==
I0214 03:16:11.839551 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:16:21.865121 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:16:21.865272 1 main.go:227] handling current node
I0214 03:16:21.865443 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:16:21.865588 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:16:21.866131 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:16:21.866219 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:16:21.866322 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:16:21.866353 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:16:31.883568 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:16:31.883629 1 main.go:227] handling current node
I0214 03:16:31.883646 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:16:31.883653 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:16:31.883809 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:16:31.883815 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:16:31.883872 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:16:31.883918 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:16:41.898591 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:16:41.898784 1 main.go:227] handling current node
I0214 03:16:41.898803 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:16:41.898813 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:16:41.898958 1 main.go:223] Handling node with IPs: map[192.168.39.133:{}]
I0214 03:16:41.898972 1 main.go:250] Node ha-447944-m03 has CIDR [10.244.2.0/24]
I0214 03:16:41.899029 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:16:41.899071 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
==> kindnet [bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b] <==
I0214 03:14:25.409351 1 main.go:102] connected to apiserver: https://10.96.0.1:443
I0214 03:14:25.409505 1 main.go:107] hostIP = 192.168.39.41
podIP = 192.168.39.41
I0214 03:14:25.409681 1 main.go:116] setting mtu 1500 for CNI
I0214 03:14:25.412849 1 main.go:146] kindnetd IP family: "ipv4"
I0214 03:14:25.412917 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0214 03:14:35.772951 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": net/http: TLS handshake timeout
I0214 03:14:45.563158 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: read tcp 192.168.122.107:55512->10.96.0.1:443: read: connection reset by peer
I0214 03:14:51.707653 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host
I0214 03:14:54.779781 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host
I0214 03:15:00.924977 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host
panic: Reached maximum retries obtaining node list: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host
goroutine 1 [running]:
main.main()
/go/src/cmd/kindnetd/main.go:195 +0xd3d
==> kube-apiserver [5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401] <==
I0214 03:14:23.852969 1 options.go:220] external host was not specified, using 192.168.39.41
I0214 03:14:23.854611 1 server.go:148] Version: v1.28.4
I0214 03:14:23.854685 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
W0214 03:14:24.505431 1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W0214 03:14:24.506329 1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
I0214 03:14:24.509353 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0214 03:14:24.526619 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0214 03:14:24.526954 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0214 03:14:24.527257 1 instance.go:298] Using reconciler: lease
W0214 03:14:24.528776 1 logging.go:59] [core] [Channel #5 SubChannel #6] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W0214 03:14:44.505156 1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"
W0214 03:14:44.506524 1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"
F0214 03:14:44.528569 1 instance.go:291] Error creating leases: error creating storage factory: context deadline exceeded
==> kube-apiserver [bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3] <==
I0214 03:15:04.152636 1 establishing_controller.go:76] Starting EstablishingController
I0214 03:15:04.152662 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0214 03:15:04.152675 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0214 03:15:04.152693 1 crd_finalizer.go:266] Starting CRDFinalizer
I0214 03:15:04.155576 1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0214 03:15:04.155621 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0214 03:15:04.221402 1 apf_controller.go:377] Running API Priority and Fairness config worker
I0214 03:15:04.221573 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I0214 03:15:04.221615 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0214 03:15:04.223488 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0214 03:15:04.242794 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0214 03:15:04.244469 1 shared_informer.go:318] Caches are synced for configmaps
I0214 03:15:04.246629 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0214 03:15:04.259423 1 shared_informer.go:318] Caches are synced for crd-autoregister
I0214 03:15:04.259534 1 aggregator.go:166] initial CRD sync complete...
I0214 03:15:04.259558 1 autoregister_controller.go:141] Starting autoregister controller
I0214 03:15:04.259573 1 cache.go:32] Waiting for caches to sync for autoregister controller
I0214 03:15:04.259582 1 cache.go:39] Caches are synced for autoregister controller
W0214 03:15:04.284862 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.39.133]
I0214 03:15:04.286508 1 controller.go:624] quota admission added evaluator for: endpoints
I0214 03:15:04.300867 1 shared_informer.go:318] Caches are synced for node_authorizer
I0214 03:15:04.312296 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
E0214 03:15:04.327131 1 controller.go:95] Found stale data, removed previous endpoints on kubernetes service, apiserver didn't exit successfully previously
I0214 03:15:05.242122 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
W0214 03:15:05.856671 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.39.133 192.168.39.41]
==> kube-controller-manager [c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed] <==
I0214 03:15:16.744391 1 event.go:307] "Event occurred" object="ha-447944-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller"
I0214 03:15:16.744490 1 taint_manager.go:205] "Starting NoExecuteTaintManager"
I0214 03:15:16.744617 1 taint_manager.go:210] "Sending events to api server"
I0214 03:15:16.771988 1 event.go:307] "Event occurred" object="default/busybox-5b5d89c9d6-mjds9" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-5b5d89c9d6-mjds9"
I0214 03:15:16.774462 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="ha-447944"
I0214 03:15:16.774654 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="ha-447944-m02"
I0214 03:15:16.774926 1 event.go:307] "Event occurred" object="ha-447944-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node ha-447944-m03 event: Registered Node ha-447944-m03 in Controller"
I0214 03:15:16.775025 1 event.go:307] "Event occurred" object="ha-447944-m04" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller"
I0214 03:15:16.775323 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="ha-447944-m03"
I0214 03:15:16.775566 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="ha-447944-m04"
I0214 03:15:16.777119 1 node_lifecycle_controller.go:1071] "Controller detected that zone is now in new state" zone="" newState="Normal"
I0214 03:15:16.782312 1 shared_informer.go:318] Caches are synced for daemon sets
I0214 03:15:17.145195 1 shared_informer.go:318] Caches are synced for garbage collector
I0214 03:15:17.150822 1 shared_informer.go:318] Caches are synced for garbage collector
I0214 03:15:17.150872 1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
I0214 03:15:20.353580 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="20.283284ms"
I0214 03:15:20.355893 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="185.694µs"
I0214 03:15:47.568964 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="15.85808ms"
I0214 03:15:47.569070 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="43.719µs"
I0214 03:15:56.864851 1 event.go:307] "Event occurred" object="ha-447944-m04" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node ha-447944-m04 status is now: NodeNotReady"
I0214 03:15:56.888477 1 event.go:307] "Event occurred" object="kube-system/kindnet-ldndh" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:15:56.915065 1 event.go:307] "Event occurred" object="kube-system/kube-proxy-jrhq2" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:16:10.963350 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="13.838088ms"
I0214 03:16:10.963879 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="329.267µs"
I0214 03:16:40.854439 1 topologycache.go:237] "Can't get CPU or zone information for node" node="ha-447944-m04"
==> kube-controller-manager [e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37] <==
I0214 03:14:24.824567 1 serving.go:348] Generated self-signed cert in-memory
I0214 03:14:25.723033 1 controllermanager.go:189] "Starting" version="v1.28.4"
I0214 03:14:25.723080 1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:14:25.725403 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I0214 03:14:25.725667 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I0214 03:14:25.726923 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0214 03:14:25.727027 1 secure_serving.go:213] Serving securely on 127.0.0.1:10257
E0214 03:14:45.740590 1 controllermanager.go:235] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.39.41:8443/healthz\": dial tcp 192.168.39.41:8443: connect: connection refused"
==> kube-proxy [776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3] <==
I0214 03:14:27.105697 1 server_others.go:69] "Using iptables proxy"
E0214 03:14:27.964610 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:14:31.036327 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:14:34.108296 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:14:40.252013 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:14:52.540111 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
I0214 03:15:10.617512 1 node.go:141] Successfully retrieved node IP: 192.168.39.41
I0214 03:15:10.669260 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 03:15:10.669339 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 03:15:10.672269 1 server_others.go:152] "Using iptables Proxier"
I0214 03:15:10.672396 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 03:15:10.673057 1 server.go:846] "Version info" version="v1.28.4"
I0214 03:15:10.673103 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:15:10.674392 1 config.go:188] "Starting service config controller"
I0214 03:15:10.674464 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 03:15:10.674518 1 config.go:97] "Starting endpoint slice config controller"
I0214 03:15:10.674535 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 03:15:10.675522 1 config.go:315] "Starting node config controller"
I0214 03:15:10.675561 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 03:15:10.775462 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 03:15:10.775487 1 shared_informer.go:318] Caches are synced for service config
I0214 03:15:10.775645 1 shared_informer.go:318] Caches are synced for node config
==> kube-proxy [9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62] <==
E0214 03:11:08.220293 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:15.387465 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:15.387612 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:15.387698 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:15.387635 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:15.387493 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:15.387877 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:26.715653 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:26.716014 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:26.715942 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:26.716050 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:29.789186 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:29.789473 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:48.220012 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:48.220190 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:51.292613 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:51.292764 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:51.293061 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:51.293132 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:12:22.014058 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:12:22.164902 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:12:28.156126 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:12:28.156214 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:12:34.300027 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:12:34.300137 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
==> kube-scheduler [322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2] <==
E0214 03:12:30.767585 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 03:12:30.776974 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:12:30.777063 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 03:12:30.808476 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0214 03:12:30.808599 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
W0214 03:12:30.916613 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:12:30.916763 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 03:12:30.930628 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:12:30.930785 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:12:31.045685 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 03:12:31.045803 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0214 03:12:31.183093 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 03:12:31.183193 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
W0214 03:12:31.241112 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 03:12:31.241223 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0214 03:12:31.441437 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:12:31.441669 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0214 03:12:31.649086 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 03:12:31.649180 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0214 03:12:32.578469 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 03:12:32.578586 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
I0214 03:12:35.030428 1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259
I0214 03:12:35.030522 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
I0214 03:12:35.030914 1 configmap_cafile_content.go:223] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
E0214 03:12:35.031016 1 run.go:74] "command failed" err="finished without leader elect"
==> kube-scheduler [35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06] <==
W0214 03:14:55.064656 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: Get "https://192.168.39.41:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:14:55.064804 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.39.41:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:14:59.018263 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://192.168.39.41:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:14:59.018348 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.41:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:14:59.984677 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.41:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:14:59.984877 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.41:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:15:01.020231 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: Get "https://192.168.39.41:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:15:01.020355 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.41:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:15:01.702634 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: Get "https://192.168.39.41:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:15:01.703008 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get "https://192.168.39.41:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:15:01.808478 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: Get "https://192.168.39.41:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:15:01.808609 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: Get "https://192.168.39.41:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:15:04.169118 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:15:04.172192 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0214 03:15:04.172354 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 03:15:04.172389 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 03:15:04.172449 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 03:15:04.172479 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 03:15:04.172564 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:15:04.172627 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:15:04.172845 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:15:04.176920 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 03:15:04.177213 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 03:15:04.177261 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
I0214 03:15:24.539819 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 03:02:18 UTC, ends at Wed 2024-02-14 03:16:49 UTC. --
Feb 14 03:15:01 ha-447944 kubelet[1420]: E0214 03:15:01.756198 1420 kubelet_node_status.go:540] "Error updating node status, will retry" err="error getting node \"ha-447944\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944?timeout=10s\": dial tcp 192.168.39.254:8443: connect: no route to host"
Feb 14 03:15:03 ha-447944 kubelet[1420]: I0214 03:15:03.344187 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
Feb 14 03:15:03 ha-447944 kubelet[1420]: E0214 03:15:03.344422 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7da2937f-2d9b-40d4-a521-5bf4a2585de7)\"" pod="kube-system/storage-provisioner" podUID="7da2937f-2d9b-40d4-a521-5bf4a2585de7"
Feb 14 03:15:04 ha-447944 kubelet[1420]: E0214 03:15:04.827222 1420 kubelet_node_status.go:540] "Error updating node status, will retry" err="error getting node \"ha-447944\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944?timeout=10s\": dial tcp 192.168.39.254:8443: connect: no route to host"
Feb 14 03:15:04 ha-447944 kubelet[1420]: W0214 03:15:04.827313 1420 reflector.go:535] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: Get "https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)kube-root-ca.crt&resourceVersion=1810": dial tcp 192.168.39.254:8443: connect: no route to host
Feb 14 03:15:04 ha-447944 kubelet[1420]: E0214 03:15:04.827384 1420 reflector.go:147] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)kube-root-ca.crt&resourceVersion=1810": dial tcp 192.168.39.254:8443: connect: no route to host
Feb 14 03:15:04 ha-447944 kubelet[1420]: E0214 03:15:04.827463 1420 controller.go:146] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-447944?timeout=10s\": dial tcp 192.168.39.254:8443: connect: no route to host" interval="7s"
Feb 14 03:15:04 ha-447944 kubelet[1420]: I0214 03:15:04.827585 1420 status_manager.go:853] "Failed to get status for pod" podUID="ffa86fcdea5fcdc73edd7aba90728e29" pod="kube-system/kube-apiserver-ha-447944" err="Get \"https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-447944\": dial tcp 192.168.39.254:8443: connect: no route to host"
Feb 14 03:15:05 ha-447944 kubelet[1420]: I0214 03:15:05.873245 1420 scope.go:117] "RemoveContainer" containerID="8e8843384931f0f1dd890924b8b5258840ef0cac2c83ed3a94b72125a5b9f419"
Feb 14 03:15:05 ha-447944 kubelet[1420]: I0214 03:15:05.873530 1420 scope.go:117] "RemoveContainer" containerID="bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b"
Feb 14 03:15:05 ha-447944 kubelet[1420]: E0214 03:15:05.873823 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kindnet-cni pod=kindnet-pjrmh_kube-system(5cc39f50-0de5-40b5-b670-b33acc977740)\"" pod="kube-system/kindnet-pjrmh" podUID="5cc39f50-0de5-40b5-b670-b33acc977740"
Feb 14 03:15:16 ha-447944 kubelet[1420]: I0214 03:15:16.343163 1420 scope.go:117] "RemoveContainer" containerID="bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b"
Feb 14 03:15:16 ha-447944 kubelet[1420]: E0214 03:15:16.343504 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kindnet-cni\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kindnet-cni pod=kindnet-pjrmh_kube-system(5cc39f50-0de5-40b5-b670-b33acc977740)\"" pod="kube-system/kindnet-pjrmh" podUID="5cc39f50-0de5-40b5-b670-b33acc977740"
Feb 14 03:15:18 ha-447944 kubelet[1420]: I0214 03:15:18.343001 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
Feb 14 03:15:18 ha-447944 kubelet[1420]: E0214 03:15:18.343463 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7da2937f-2d9b-40d4-a521-5bf4a2585de7)\"" pod="kube-system/storage-provisioner" podUID="7da2937f-2d9b-40d4-a521-5bf4a2585de7"
Feb 14 03:15:30 ha-447944 kubelet[1420]: I0214 03:15:30.343542 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
Feb 14 03:15:30 ha-447944 kubelet[1420]: E0214 03:15:30.344131 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7da2937f-2d9b-40d4-a521-5bf4a2585de7)\"" pod="kube-system/storage-provisioner" podUID="7da2937f-2d9b-40d4-a521-5bf4a2585de7"
Feb 14 03:15:30 ha-447944 kubelet[1420]: I0214 03:15:30.344189 1420 scope.go:117] "RemoveContainer" containerID="bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b"
Feb 14 03:15:45 ha-447944 kubelet[1420]: I0214 03:15:45.342920 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
Feb 14 03:15:45 ha-447944 kubelet[1420]: E0214 03:15:45.343179 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7da2937f-2d9b-40d4-a521-5bf4a2585de7)\"" pod="kube-system/storage-provisioner" podUID="7da2937f-2d9b-40d4-a521-5bf4a2585de7"
Feb 14 03:15:53 ha-447944 kubelet[1420]: E0214 03:15:53.431051 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:15:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:15:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:15:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:15:58 ha-447944 kubelet[1420]: I0214 03:15:58.343465 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
-- /stdout --
** stderr **
E0214 03:16:47.573935 1510580 logs.go:258] failed to output last start logs: failed to read file /home/jenkins/minikube-integration/17909-1487441/.minikube/logs/lastStart.txt: bufio.Scanner: token too long
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-447944 -n ha-447944
helpers_test.go:261: (dbg) Run: kubectl --context ha-447944 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestHA/serial/RestartClusterKeepsNodes FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestHA/serial/RestartClusterKeepsNodes (379.02s)
=== RUN TestHA/serial/StopCluster
ha_test.go:531: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 stop -v=7 --alsologtostderr
E0214 03:17:19.271064 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
ha_test.go:531: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 stop -v=7 --alsologtostderr: exit status 82 (2m0.414853853s)
-- stdout --
* Stopping node "ha-447944-m04" ...
-- /stdout --
** stderr **
I0214 03:17:00.027367 1510959 out.go:291] Setting OutFile to fd 1 ...
I0214 03:17:00.027535 1510959 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:17:00.027549 1510959 out.go:304] Setting ErrFile to fd 2...
I0214 03:17:00.027557 1510959 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:17:00.027754 1510959 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:17:00.028031 1510959 out.go:298] Setting JSON to false
I0214 03:17:00.028131 1510959 mustload.go:65] Loading cluster: ha-447944
I0214 03:17:00.028507 1510959 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:17:00.028612 1510959 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:17:00.028790 1510959 mustload.go:65] Loading cluster: ha-447944
I0214 03:17:00.028928 1510959 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:17:00.028959 1510959 stop.go:39] StopHost: ha-447944-m04
I0214 03:17:00.029411 1510959 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:17:00.029484 1510959 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:17:00.044145 1510959 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44415
I0214 03:17:00.044591 1510959 main.go:141] libmachine: () Calling .GetVersion
I0214 03:17:00.045224 1510959 main.go:141] libmachine: Using API Version 1
I0214 03:17:00.045271 1510959 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:17:00.045615 1510959 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:17:00.048503 1510959 out.go:177] * Stopping node "ha-447944-m04" ...
I0214 03:17:00.050126 1510959 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]
I0214 03:17:00.050169 1510959 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:17:00.050415 1510959 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup
I0214 03:17:00.050438 1510959 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:17:00.053498 1510959 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:17:00.053942 1510959 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:16:32 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:17:00.053960 1510959 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:17:00.054215 1510959 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:17:00.054406 1510959 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:17:00.054608 1510959 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:17:00.054750 1510959 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
I0214 03:17:00.145451 1510959 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/cni /var/lib/minikube/backup
I0214 03:17:00.156176 1510959 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/kubernetes /var/lib/minikube/backup
I0214 03:17:00.165909 1510959 main.go:141] libmachine: Stopping "ha-447944-m04"...
I0214 03:17:00.165945 1510959 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:17:00.167481 1510959 main.go:141] libmachine: (ha-447944-m04) Calling .Stop
I0214 03:17:00.171065 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 0/120
I0214 03:17:01.173334 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 1/120
I0214 03:17:02.174653 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 2/120
I0214 03:17:03.175924 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 3/120
I0214 03:17:04.177278 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 4/120
I0214 03:17:05.178851 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 5/120
I0214 03:17:06.180262 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 6/120
I0214 03:17:07.181819 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 7/120
I0214 03:17:08.183201 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 8/120
I0214 03:17:09.184756 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 9/120
I0214 03:17:10.186073 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 10/120
I0214 03:17:11.187477 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 11/120
I0214 03:17:12.189774 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 12/120
I0214 03:17:13.191940 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 13/120
I0214 03:17:14.193545 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 14/120
I0214 03:17:15.195485 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 15/120
I0214 03:17:16.196944 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 16/120
I0214 03:17:17.198344 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 17/120
I0214 03:17:18.200194 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 18/120
I0214 03:17:19.201733 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 19/120
I0214 03:17:20.203891 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 20/120
I0214 03:17:21.205198 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 21/120
I0214 03:17:22.206688 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 22/120
I0214 03:17:23.208252 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 23/120
I0214 03:17:24.209974 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 24/120
I0214 03:17:25.211851 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 25/120
I0214 03:17:26.213577 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 26/120
I0214 03:17:27.216008 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 27/120
I0214 03:17:28.217666 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 28/120
I0214 03:17:29.220114 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 29/120
I0214 03:17:30.222587 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 30/120
I0214 03:17:31.224216 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 31/120
I0214 03:17:32.225677 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 32/120
I0214 03:17:33.227436 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 33/120
I0214 03:17:34.228970 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 34/120
I0214 03:17:35.230647 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 35/120
I0214 03:17:36.232907 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 36/120
I0214 03:17:37.234389 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 37/120
I0214 03:17:38.235910 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 38/120
I0214 03:17:39.237246 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 39/120
I0214 03:17:40.239372 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 40/120
I0214 03:17:41.241154 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 41/120
I0214 03:17:42.242548 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 42/120
I0214 03:17:43.243988 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 43/120
I0214 03:17:44.246196 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 44/120
I0214 03:17:45.248504 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 45/120
I0214 03:17:46.249782 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 46/120
I0214 03:17:47.251735 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 47/120
I0214 03:17:48.253141 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 48/120
I0214 03:17:49.254388 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 49/120
I0214 03:17:50.256403 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 50/120
I0214 03:17:51.257678 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 51/120
I0214 03:17:52.259772 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 52/120
I0214 03:17:53.261872 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 53/120
I0214 03:17:54.263384 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 54/120
I0214 03:17:55.265495 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 55/120
I0214 03:17:56.267842 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 56/120
I0214 03:17:57.269224 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 57/120
I0214 03:17:58.270499 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 58/120
I0214 03:17:59.271878 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 59/120
I0214 03:18:00.273557 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 60/120
I0214 03:18:01.275217 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 61/120
I0214 03:18:02.276713 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 62/120
I0214 03:18:03.278003 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 63/120
I0214 03:18:04.279550 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 64/120
I0214 03:18:05.281808 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 65/120
I0214 03:18:06.283736 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 66/120
I0214 03:18:07.284915 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 67/120
I0214 03:18:08.286545 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 68/120
I0214 03:18:09.287829 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 69/120
I0214 03:18:10.290161 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 70/120
I0214 03:18:11.291621 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 71/120
I0214 03:18:12.293473 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 72/120
I0214 03:18:13.295881 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 73/120
I0214 03:18:14.297304 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 74/120
I0214 03:18:15.299105 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 75/120
I0214 03:18:16.300798 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 76/120
I0214 03:18:17.302102 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 77/120
I0214 03:18:18.303746 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 78/120
I0214 03:18:19.305066 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 79/120
I0214 03:18:20.307210 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 80/120
I0214 03:18:21.308697 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 81/120
I0214 03:18:22.309912 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 82/120
I0214 03:18:23.311203 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 83/120
I0214 03:18:24.312743 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 84/120
I0214 03:18:25.314513 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 85/120
I0214 03:18:26.316011 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 86/120
I0214 03:18:27.317542 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 87/120
I0214 03:18:28.319824 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 88/120
I0214 03:18:29.321400 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 89/120
I0214 03:18:30.323601 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 90/120
I0214 03:18:31.324916 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 91/120
I0214 03:18:32.326461 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 92/120
I0214 03:18:33.327865 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 93/120
I0214 03:18:34.329407 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 94/120
I0214 03:18:35.331348 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 95/120
I0214 03:18:36.332800 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 96/120
I0214 03:18:37.334195 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 97/120
I0214 03:18:38.335421 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 98/120
I0214 03:18:39.336661 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 99/120
I0214 03:18:40.338817 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 100/120
I0214 03:18:41.341206 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 101/120
I0214 03:18:42.342786 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 102/120
I0214 03:18:43.344284 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 103/120
I0214 03:18:44.345724 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 104/120
I0214 03:18:45.347942 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 105/120
I0214 03:18:46.349513 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 106/120
I0214 03:18:47.350948 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 107/120
I0214 03:18:48.352351 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 108/120
I0214 03:18:49.354936 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 109/120
I0214 03:18:50.357072 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 110/120
I0214 03:18:51.358536 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 111/120
I0214 03:18:52.359795 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 112/120
I0214 03:18:53.361956 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 113/120
I0214 03:18:54.363843 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 114/120
I0214 03:18:55.365943 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 115/120
I0214 03:18:56.367814 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 116/120
I0214 03:18:57.370088 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 117/120
I0214 03:18:58.371398 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 118/120
I0214 03:18:59.372847 1510959 main.go:141] libmachine: (ha-447944-m04) Waiting for machine to stop 119/120
I0214 03:19:00.373430 1510959 stop.go:66] stop err: unable to stop vm, current state "Running"
W0214 03:19:00.373520 1510959 stop.go:165] stop host returned error: Temporary Error: stop: unable to stop vm, current state "Running"
I0214 03:19:00.375681 1510959 out.go:177]
W0214 03:19:00.376844 1510959 out.go:239] X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
W0214 03:19:00.376875 1510959 out.go:239] *
*
W0214 03:19:00.381987 1510959 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0214 03:19:00.383550 1510959 out.go:177]
** /stderr **
ha_test.go:533: failed to stop cluster. args "out/minikube-linux-amd64 -p ha-447944 stop -v=7 --alsologtostderr": exit status 82
ha_test.go:537: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr: exit status 3 (19.00437308s)
-- stdout --
ha-447944
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m02
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-447944-m04
type: Worker
host: Error
kubelet: Nonexistent
-- /stdout --
** stderr **
I0214 03:19:00.448670 1511717 out.go:291] Setting OutFile to fd 1 ...
I0214 03:19:00.448839 1511717 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:19:00.448850 1511717 out.go:304] Setting ErrFile to fd 2...
I0214 03:19:00.448854 1511717 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:19:00.449069 1511717 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:19:00.449329 1511717 out.go:298] Setting JSON to false
I0214 03:19:00.449360 1511717 mustload.go:65] Loading cluster: ha-447944
I0214 03:19:00.449424 1511717 notify.go:220] Checking for updates...
I0214 03:19:00.449805 1511717 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:19:00.449829 1511717 status.go:255] checking status of ha-447944 ...
I0214 03:19:00.450274 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.450362 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.466508 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34539
I0214 03:19:00.466914 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.467557 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.467583 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.467967 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.480699 1511717 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:19:00.482288 1511717 status.go:330] ha-447944 host status = "Running" (err=<nil>)
I0214 03:19:00.482312 1511717 host.go:66] Checking if "ha-447944" exists ...
I0214 03:19:00.482701 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.482776 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.497800 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43805
I0214 03:19:00.498265 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.498812 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.498838 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.499124 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.499332 1511717 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:19:00.502300 1511717 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:19:00.502718 1511717 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:19:00.502768 1511717 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:19:00.502829 1511717 host.go:66] Checking if "ha-447944" exists ...
I0214 03:19:00.503115 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.503151 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.518006 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33745
I0214 03:19:00.518418 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.518827 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.518852 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.519154 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.519314 1511717 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:19:00.519499 1511717 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:19:00.519531 1511717 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:19:00.522211 1511717 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:19:00.522670 1511717 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:19:00.522692 1511717 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:19:00.522874 1511717 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:19:00.523095 1511717 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:19:00.523293 1511717 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:19:00.523434 1511717 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:19:00.621061 1511717 ssh_runner.go:195] Run: systemctl --version
I0214 03:19:00.628458 1511717 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:19:00.646970 1511717 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:19:00.647001 1511717 api_server.go:166] Checking apiserver status ...
I0214 03:19:00.647034 1511717 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:19:00.663423 1511717 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/5348/cgroup
I0214 03:19:00.675121 1511717 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3"
I0214 03:19:00.675188 1511717 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podffa86fcdea5fcdc73edd7aba90728e29/crio-bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3/freezer.state
I0214 03:19:00.686371 1511717 api_server.go:204] freezer state: "THAWED"
I0214 03:19:00.686403 1511717 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:19:00.691470 1511717 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:19:00.691493 1511717 status.go:422] ha-447944 apiserver status = Running (err=<nil>)
I0214 03:19:00.691502 1511717 status.go:257] ha-447944 status: &{Name:ha-447944 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:19:00.691518 1511717 status.go:255] checking status of ha-447944-m02 ...
I0214 03:19:00.691804 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.691839 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.706467 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44817
I0214 03:19:00.706857 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.707391 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.707414 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.707762 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.707936 1511717 main.go:141] libmachine: (ha-447944-m02) Calling .GetState
I0214 03:19:00.709527 1511717 status.go:330] ha-447944-m02 host status = "Running" (err=<nil>)
I0214 03:19:00.709547 1511717 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:19:00.709860 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.709913 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.723904 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35973
I0214 03:19:00.724291 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.724708 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.724729 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.725075 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.725306 1511717 main.go:141] libmachine: (ha-447944-m02) Calling .GetIP
I0214 03:19:00.728204 1511717 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:19:00.728603 1511717 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:14:29 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:19:00.728642 1511717 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:19:00.728758 1511717 host.go:66] Checking if "ha-447944-m02" exists ...
I0214 03:19:00.729154 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.729202 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.743880 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44397
I0214 03:19:00.744259 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.744657 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.744678 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.744982 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.745202 1511717 main.go:141] libmachine: (ha-447944-m02) Calling .DriverName
I0214 03:19:00.745446 1511717 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:19:00.745473 1511717 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHHostname
I0214 03:19:00.748277 1511717 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:19:00.748699 1511717 main.go:141] libmachine: (ha-447944-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:61:ed:46", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:14:29 +0000 UTC Type:0 Mac:52:54:00:61:ed:46 Iaid: IPaddr:192.168.39.218 Prefix:24 Hostname:ha-447944-m02 Clientid:01:52:54:00:61:ed:46}
I0214 03:19:00.748730 1511717 main.go:141] libmachine: (ha-447944-m02) DBG | domain ha-447944-m02 has defined IP address 192.168.39.218 and MAC address 52:54:00:61:ed:46 in network mk-ha-447944
I0214 03:19:00.748832 1511717 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHPort
I0214 03:19:00.749005 1511717 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHKeyPath
I0214 03:19:00.749180 1511717 main.go:141] libmachine: (ha-447944-m02) Calling .GetSSHUsername
I0214 03:19:00.749344 1511717 sshutil.go:53] new ssh client: &{IP:192.168.39.218 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m02/id_rsa Username:docker}
I0214 03:19:00.838232 1511717 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:19:00.856799 1511717 kubeconfig.go:125] found "ha-447944" server: "https://192.168.39.254:8443"
I0214 03:19:00.856853 1511717 api_server.go:166] Checking apiserver status ...
I0214 03:19:00.856912 1511717 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:19:00.872552 1511717 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1518/cgroup
I0214 03:19:00.881801 1511717 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/podfa0d3bf5e0b760dac708de225fe159b1/crio-f97140721de769d3c29ffabf57712e88f10dc28502785241008fa82e069f8d26"
I0214 03:19:00.881882 1511717 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podfa0d3bf5e0b760dac708de225fe159b1/crio-f97140721de769d3c29ffabf57712e88f10dc28502785241008fa82e069f8d26/freezer.state
I0214 03:19:00.899040 1511717 api_server.go:204] freezer state: "THAWED"
I0214 03:19:00.899072 1511717 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...
I0214 03:19:00.905974 1511717 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:
ok
I0214 03:19:00.906031 1511717 status.go:422] ha-447944-m02 apiserver status = Running (err=<nil>)
I0214 03:19:00.906046 1511717 status.go:257] ha-447944-m02 status: &{Name:ha-447944-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:19:00.906071 1511717 status.go:255] checking status of ha-447944-m04 ...
I0214 03:19:00.906369 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.906417 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.921175 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33663
I0214 03:19:00.921658 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.922154 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.922180 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.922504 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.922719 1511717 main.go:141] libmachine: (ha-447944-m04) Calling .GetState
I0214 03:19:00.924308 1511717 status.go:330] ha-447944-m04 host status = "Running" (err=<nil>)
I0214 03:19:00.924324 1511717 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:19:00.924603 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.924638 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.938665 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44635
I0214 03:19:00.939127 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.939575 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.939598 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.939921 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.940117 1511717 main.go:141] libmachine: (ha-447944-m04) Calling .GetIP
I0214 03:19:00.942879 1511717 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:19:00.943354 1511717 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:16:32 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:19:00.943398 1511717 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:19:00.943496 1511717 host.go:66] Checking if "ha-447944-m04" exists ...
I0214 03:19:00.943829 1511717 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:19:00.943876 1511717 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:19:00.960099 1511717 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38385
I0214 03:19:00.960476 1511717 main.go:141] libmachine: () Calling .GetVersion
I0214 03:19:00.960912 1511717 main.go:141] libmachine: Using API Version 1
I0214 03:19:00.960939 1511717 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:19:00.961244 1511717 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:19:00.961454 1511717 main.go:141] libmachine: (ha-447944-m04) Calling .DriverName
I0214 03:19:00.961625 1511717 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:19:00.961648 1511717 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHHostname
I0214 03:19:00.964190 1511717 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:19:00.964672 1511717 main.go:141] libmachine: (ha-447944-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:df:a7:3e", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:16:32 +0000 UTC Type:0 Mac:52:54:00:df:a7:3e Iaid: IPaddr:192.168.39.98 Prefix:24 Hostname:ha-447944-m04 Clientid:01:52:54:00:df:a7:3e}
I0214 03:19:00.964698 1511717 main.go:141] libmachine: (ha-447944-m04) DBG | domain ha-447944-m04 has defined IP address 192.168.39.98 and MAC address 52:54:00:df:a7:3e in network mk-ha-447944
I0214 03:19:00.964861 1511717 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHPort
I0214 03:19:00.965060 1511717 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHKeyPath
I0214 03:19:00.965230 1511717 main.go:141] libmachine: (ha-447944-m04) Calling .GetSSHUsername
I0214 03:19:00.965400 1511717 sshutil.go:53] new ssh client: &{IP:192.168.39.98 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944-m04/id_rsa Username:docker}
W0214 03:19:19.389567 1511717 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.98:22: connect: no route to host
W0214 03:19:19.389673 1511717 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.98:22: connect: no route to host
E0214 03:19:19.389693 1511717 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.98:22: connect: no route to host
I0214 03:19:19.389711 1511717 status.go:257] ha-447944-m04 status: &{Name:ha-447944-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
E0214 03:19:19.389746 1511717 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.98:22: connect: no route to host
** /stderr **
ha_test.go:540: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr" : exit status 3
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p ha-447944 -n ha-447944
helpers_test.go:244: <<< TestHA/serial/StopCluster FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestHA/serial/StopCluster]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-447944 logs -n 25: (1.821179994s)
helpers_test.go:252: TestHA/serial/StopCluster logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04:/home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m04 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt | | | | | |
| cp | ha-447944 cp testdata/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04:/home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:06 UTC |
| | /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944-m04.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:06 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944:/home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m02:/home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m03:/home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m03 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| node | ha-447944 node stop m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | |
| | --alsologtostderr | | | | | |
| node | ha-447944 node start m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:09 UTC | |
| | --alsologtostderr | | | | | |
| node | list -p ha-447944 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:10 UTC | |
| | --alsologtostderr | | | | | |
| stop | -p ha-447944 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:10 UTC | |
| | --alsologtostderr | | | | | |
| start | -p ha-447944 --wait=true -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:12 UTC | 14 Feb 24 03:16 UTC |
| | --alsologtostderr | | | | | |
| node | list -p ha-447944 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:16 UTC | |
| node | ha-447944 node delete m03 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:16 UTC | 14 Feb 24 03:16 UTC |
| | --alsologtostderr | | | | | |
| stop | ha-447944 stop -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:17 UTC | |
| | --alsologtostderr | | | | | |
|---------|--------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 03:12:33
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 03:12:33.645080 1509522 out.go:291] Setting OutFile to fd 1 ...
I0214 03:12:33.645231 1509522 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:12:33.645241 1509522 out.go:304] Setting ErrFile to fd 2...
I0214 03:12:33.645246 1509522 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:12:33.645498 1509522 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:12:33.646121 1509522 out.go:298] Setting JSON to false
I0214 03:12:33.647228 1509522 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":21301,"bootTime":1707859053,"procs":185,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:12:33.647293 1509522 start.go:138] virtualization: kvm guest
I0214 03:12:33.650211 1509522 out.go:177] * [ha-447944] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 03:12:33.651940 1509522 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:12:33.652059 1509522 notify.go:220] Checking for updates...
I0214 03:12:33.653736 1509522 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:12:33.655602 1509522 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:12:33.657306 1509522 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:12:33.658786 1509522 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:12:33.660213 1509522 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:12:33.661988 1509522 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:12:33.662082 1509522 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:12:33.662521 1509522 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:12:33.662575 1509522 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:12:33.678968 1509522 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36709
I0214 03:12:33.679489 1509522 main.go:141] libmachine: () Calling .GetVersion
I0214 03:12:33.680081 1509522 main.go:141] libmachine: Using API Version 1
I0214 03:12:33.680113 1509522 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:12:33.680493 1509522 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:12:33.680742 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:12:33.718362 1509522 out.go:177] * Using the kvm2 driver based on existing profile
I0214 03:12:33.719849 1509522 start.go:296] selected driver: kvm2
I0214 03:12:33.719873 1509522 start.go:900] validating driver "kvm2" against &{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer
sion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.98 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk
:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGI
D:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:12:33.720023 1509522 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:12:33.720440 1509522 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:12:33.720563 1509522 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 03:12:33.737659 1509522 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 03:12:33.738392 1509522 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:12:33.738469 1509522 cni.go:84] Creating CNI manager for ""
I0214 03:12:33.738488 1509522 cni.go:136] multinode detected (4 nodes found), recommending kindnet
I0214 03:12:33.738557 1509522 start.go:339] cluster config:
{Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39
.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.98 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-till
er:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:
9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:12:33.738696 1509522 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:12:33.741186 1509522 out.go:177] * Starting "ha-447944" primary control-plane node in "ha-447944" cluster
I0214 03:12:33.742982 1509522 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:12:33.743049 1509522 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 03:12:33.743059 1509522 cache.go:56] Caching tarball of preloaded images
I0214 03:12:33.743178 1509522 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:12:33.743195 1509522 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:12:33.743373 1509522 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/config.json ...
I0214 03:12:33.743594 1509522 start.go:360] acquireMachinesLock for ha-447944: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:12:33.743647 1509522 start.go:364] duration metric: took 29.371µs to acquireMachinesLock for "ha-447944"
I0214 03:12:33.743664 1509522 start.go:96] Skipping create...Using existing machine configuration
I0214 03:12:33.743672 1509522 fix.go:54] fixHost starting:
I0214 03:12:33.744003 1509522 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:12:33.744048 1509522 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:12:33.759244 1509522 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41133
I0214 03:12:33.759750 1509522 main.go:141] libmachine: () Calling .GetVersion
I0214 03:12:33.760308 1509522 main.go:141] libmachine: Using API Version 1
I0214 03:12:33.760340 1509522 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:12:33.760789 1509522 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:12:33.761027 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:12:33.761236 1509522 main.go:141] libmachine: (ha-447944) Calling .GetState
I0214 03:12:33.763223 1509522 fix.go:112] recreateIfNeeded on ha-447944: state=Running err=<nil>
W0214 03:12:33.763260 1509522 fix.go:138] unexpected machine state, will restart: <nil>
I0214 03:12:33.765890 1509522 out.go:177] * Updating the running kvm2 "ha-447944" VM ...
I0214 03:12:33.767360 1509522 machine.go:94] provisionDockerMachine start ...
I0214 03:12:33.767392 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:12:33.767746 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:33.770528 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:33.771080 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:33.771117 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:33.771276 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:33.771469 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:33.771635 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:33.771770 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:33.771975 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:12:33.772352 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:12:33.772366 1509522 main.go:141] libmachine: About to run SSH command:
hostname
I0214 03:12:33.902822 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944
I0214 03:12:33.902862 1509522 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:12:33.903140 1509522 buildroot.go:166] provisioning hostname "ha-447944"
I0214 03:12:33.903173 1509522 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:12:33.903454 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:33.906210 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:33.906608 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:33.906640 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:33.906734 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:33.906970 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:33.907115 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:33.907259 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:33.907451 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:12:33.907938 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:12:33.907957 1509522 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-447944 && echo "ha-447944" | sudo tee /etc/hostname
I0214 03:12:34.049457 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-447944
I0214 03:12:34.049498 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:34.052431 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.052855 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.052891 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.053022 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:34.053185 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.053392 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.053586 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:34.053758 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:12:34.054075 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:12:34.054092 1509522 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-447944' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-447944/g' /etc/hosts;
else
echo '127.0.1.1 ha-447944' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:12:34.190606 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:12:34.190643 1509522 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:12:34.190701 1509522 buildroot.go:174] setting up certificates
I0214 03:12:34.190715 1509522 provision.go:84] configureAuth start
I0214 03:12:34.190729 1509522 main.go:141] libmachine: (ha-447944) Calling .GetMachineName
I0214 03:12:34.191038 1509522 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:12:34.194271 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.194632 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.194662 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.194788 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:34.197424 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.197884 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.197913 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.198103 1509522 provision.go:143] copyHostCerts
I0214 03:12:34.198138 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:12:34.198198 1509522 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:12:34.198207 1509522 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:12:34.198268 1509522 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:12:34.198400 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:12:34.198423 1509522 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:12:34.198430 1509522 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:12:34.198460 1509522 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:12:34.198521 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:12:34.198542 1509522 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:12:34.198548 1509522 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:12:34.198569 1509522 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:12:34.198643 1509522 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ha-447944 san=[127.0.0.1 192.168.39.41 ha-447944 localhost minikube]
I0214 03:12:34.693567 1509522 provision.go:177] copyRemoteCerts
I0214 03:12:34.693645 1509522 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:12:34.693671 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:34.696813 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.697137 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.697173 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.697404 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:34.697616 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.697785 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:34.697959 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:12:34.792042 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:12:34.792126 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:12:34.818862 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:12:34.818950 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)
I0214 03:12:34.847632 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:12:34.847712 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 03:12:34.874153 1509522 provision.go:87] duration metric: took 683.423417ms to configureAuth
I0214 03:12:34.874183 1509522 buildroot.go:189] setting minikube options for container-runtime
I0214 03:12:34.874507 1509522 config.go:182] Loaded profile config "ha-447944": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:12:34.874613 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:12:34.877287 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.877794 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:12:34.877829 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:12:34.878014 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:12:34.878235 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.878503 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:12:34.878719 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:12:34.878929 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:12:34.879260 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:12:34.879277 1509522 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:14:05.884769 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:14:05.884836 1509522 machine.go:97] duration metric: took 1m32.117458789s to provisionDockerMachine
I0214 03:14:05.884860 1509522 start.go:293] postStartSetup for "ha-447944" (driver="kvm2")
I0214 03:14:05.884878 1509522 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:14:05.884900 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:05.885292 1509522 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:14:05.885333 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:05.888723 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:05.889271 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:05.889306 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:05.889518 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:05.889727 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:05.889924 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:05.890109 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:14:05.984607 1509522 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:14:05.988774 1509522 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:14:05.988801 1509522 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:14:05.988880 1509522 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:14:05.989041 1509522 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:14:05.989058 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:14:05.989148 1509522 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:14:05.998129 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:14:06.020440 1509522 start.go:296] duration metric: took 135.561868ms for postStartSetup
I0214 03:14:06.020497 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.020821 1509522 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup
I0214 03:14:06.020858 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:06.023825 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.024281 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.024306 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.024503 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:06.024716 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.024872 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:06.025011 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
W0214 03:14:06.115301 1509522 fix.go:99] cannot read backup folder, skipping restore: read dir: sudo ls --almost-all -1 /var/lib/minikube/backup: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/backup': No such file or directory
I0214 03:14:06.115337 1509522 fix.go:56] duration metric: took 1m32.371665422s for fixHost
I0214 03:14:06.115363 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:06.118400 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.118801 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.118850 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.118996 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:06.119207 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.119366 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.119461 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:06.119624 1509522 main.go:141] libmachine: Using SSH client type: native
I0214 03:14:06.119974 1509522 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.41 22 <nil> <nil>}
I0214 03:14:06.119991 1509522 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:14:06.242271 1509522 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707880446.229501600
I0214 03:14:06.242303 1509522 fix.go:216] guest clock: 1707880446.229501600
I0214 03:14:06.242314 1509522 fix.go:229] Guest: 2024-02-14 03:14:06.2295016 +0000 UTC Remote: 2024-02-14 03:14:06.115345339 +0000 UTC m=+92.527766207 (delta=114.156261ms)
I0214 03:14:06.242345 1509522 fix.go:200] guest clock delta is within tolerance: 114.156261ms
I0214 03:14:06.242365 1509522 start.go:83] releasing machines lock for "ha-447944", held for 1m32.498707188s
I0214 03:14:06.242399 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.242677 1509522 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:14:06.245380 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.245726 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.245762 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.245864 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.246414 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.246594 1509522 main.go:141] libmachine: (ha-447944) Calling .DriverName
I0214 03:14:06.246683 1509522 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:14:06.246748 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:06.246873 1509522 ssh_runner.go:195] Run: cat /version.json
I0214 03:14:06.246899 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHHostname
I0214 03:14:06.249622 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.249919 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.250059 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.250082 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.250216 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:06.250377 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.250500 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:06.250529 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:06.250548 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:06.250700 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHPort
I0214 03:14:06.250769 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:14:06.250838 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHKeyPath
I0214 03:14:06.250991 1509522 main.go:141] libmachine: (ha-447944) Calling .GetSSHUsername
I0214 03:14:06.251128 1509522 sshutil.go:53] new ssh client: &{IP:192.168.39.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ha-447944/id_rsa Username:docker}
I0214 03:14:06.363423 1509522 ssh_runner.go:195] Run: systemctl --version
I0214 03:14:06.369290 1509522 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:14:06.526223 1509522 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:14:06.532254 1509522 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:14:06.532327 1509522 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:14:06.542364 1509522 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0214 03:14:06.542394 1509522 start.go:494] detecting cgroup driver to use...
I0214 03:14:06.542521 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:14:06.556446 1509522 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:14:06.568842 1509522 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:14:06.568908 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:14:06.581633 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:14:06.595198 1509522 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:14:06.758187 1509522 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:14:06.926961 1509522 docker.go:233] disabling docker service ...
I0214 03:14:06.927062 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:14:06.942615 1509522 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:14:06.978199 1509522 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:14:07.162063 1509522 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:14:07.316674 1509522 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:14:07.331977 1509522 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:14:07.349526 1509522 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:14:07.349606 1509522 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:14:07.360315 1509522 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:14:07.360411 1509522 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:14:07.370552 1509522 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:14:07.380849 1509522 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:14:07.391254 1509522 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:14:07.402298 1509522 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:14:07.411584 1509522 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:14:07.420975 1509522 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:14:07.572927 1509522 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:14:15.469765 1509522 ssh_runner.go:235] Completed: sudo systemctl restart crio: (7.896787688s)
I0214 03:14:15.469813 1509522 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:14:15.469909 1509522 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:14:15.476175 1509522 start.go:562] Will wait 60s for crictl version
I0214 03:14:15.476250 1509522 ssh_runner.go:195] Run: which crictl
I0214 03:14:15.480622 1509522 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:14:15.521069 1509522 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:14:15.521163 1509522 ssh_runner.go:195] Run: crio --version
I0214 03:14:15.573452 1509522 ssh_runner.go:195] Run: crio --version
I0214 03:14:15.625672 1509522 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:14:15.627392 1509522 main.go:141] libmachine: (ha-447944) Calling .GetIP
I0214 03:14:15.630425 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:15.630806 1509522 main.go:141] libmachine: (ha-447944) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c5:66:e2", ip: ""} in network mk-ha-447944: {Iface:virbr1 ExpiryTime:2024-02-14 04:02:22 +0000 UTC Type:0 Mac:52:54:00:c5:66:e2 Iaid: IPaddr:192.168.39.41 Prefix:24 Hostname:ha-447944 Clientid:01:52:54:00:c5:66:e2}
I0214 03:14:15.630836 1509522 main.go:141] libmachine: (ha-447944) DBG | domain ha-447944 has defined IP address 192.168.39.41 and MAC address 52:54:00:c5:66:e2 in network mk-ha-447944
I0214 03:14:15.631140 1509522 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:14:15.636172 1509522 kubeadm.go:877] updating cluster {Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cl
usterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.98 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false fres
hpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mo
untIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 03:14:15.636343 1509522 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:14:15.636398 1509522 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:14:15.683815 1509522 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:14:15.683844 1509522 crio.go:415] Images already preloaded, skipping extraction
I0214 03:14:15.683920 1509522 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:14:15.721722 1509522 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:14:15.721751 1509522 cache_images.go:84] Images are preloaded, skipping loading
I0214 03:14:15.721761 1509522 kubeadm.go:928] updating node { 192.168.39.41 8443 v1.28.4 crio true true} ...
I0214 03:14:15.721925 1509522 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-447944 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.41
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:14:15.722010 1509522 ssh_runner.go:195] Run: crio config
I0214 03:14:15.797880 1509522 cni.go:84] Creating CNI manager for ""
I0214 03:14:15.797913 1509522 cni.go:136] multinode detected (4 nodes found), recommending kindnet
I0214 03:14:15.797924 1509522 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 03:14:15.797947 1509522 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.41 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-447944 NodeName:ha-447944 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.41 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/m
anifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 03:14:15.798128 1509522 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.41
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "ha-447944"
kubeletExtraArgs:
node-ip: 192.168.39.41
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.41"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 03:14:15.798159 1509522 kube-vip.go:101] generating kube-vip config ...
I0214 03:14:15.798258 1509522 kube-vip.go:121] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_ddns
value: "false"
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.39.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v0.7.0
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I0214 03:14:15.798318 1509522 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:14:15.808211 1509522 binaries.go:44] Found k8s binaries, skipping transfer
I0214 03:14:15.808304 1509522 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
I0214 03:14:15.817959 1509522 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (308 bytes)
I0214 03:14:15.835487 1509522 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:14:15.852144 1509522 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2150 bytes)
I0214 03:14:15.869586 1509522 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1265 bytes)
I0214 03:14:15.887549 1509522 ssh_runner.go:195] Run: grep 192.168.39.254 control-plane.minikube.internal$ /etc/hosts
I0214 03:14:15.891621 1509522 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:14:16.053128 1509522 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:14:16.066181 1509522 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944 for IP: 192.168.39.41
I0214 03:14:16.066214 1509522 certs.go:194] generating shared ca certs ...
I0214 03:14:16.066236 1509522 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:14:16.066516 1509522 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:14:16.066576 1509522 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:14:16.066591 1509522 certs.go:256] generating profile certs ...
I0214 03:14:16.066700 1509522 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/client.key
I0214 03:14:16.066726 1509522 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.11217c11
I0214 03:14:16.066742 1509522 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.11217c11 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.41 192.168.39.218 192.168.39.133 192.168.39.254]
I0214 03:14:16.241321 1509522 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.11217c11 ...
I0214 03:14:16.241361 1509522 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.11217c11: {Name:mkf7d7c56b89f83726544d8c2c4fed81e9cc7a24 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:14:16.241542 1509522 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.11217c11 ...
I0214 03:14:16.241553 1509522 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.11217c11: {Name:mkec118e62be385b487daecb1f8cb4754bed405f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:14:16.241622 1509522 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt.11217c11 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt
I0214 03:14:16.241757 1509522 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key.11217c11 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key
I0214 03:14:16.241935 1509522 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key
I0214 03:14:16.241955 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:14:16.241967 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:14:16.241984 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:14:16.241996 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:14:16.242008 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:14:16.242019 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:14:16.242031 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:14:16.242042 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:14:16.242088 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:14:16.242120 1509522 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:14:16.242130 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:14:16.242155 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:14:16.242180 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:14:16.242204 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:14:16.242250 1509522 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:14:16.242283 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:14:16.242297 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:14:16.242312 1509522 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:14:16.242926 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:14:16.268996 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:14:16.292596 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:14:16.316172 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:14:16.339057 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0214 03:14:16.362839 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 03:14:16.386853 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:14:16.410721 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ha-447944/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:14:16.434101 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:14:16.457790 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:14:16.481796 1509522 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:14:16.505839 1509522 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 03:14:16.522061 1509522 ssh_runner.go:195] Run: openssl version
I0214 03:14:16.528216 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:14:16.538243 1509522 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:14:16.543052 1509522 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:14:16.543129 1509522 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:14:16.549617 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:14:16.558126 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:14:16.567959 1509522 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:14:16.572825 1509522 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:14:16.572881 1509522 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:14:16.578749 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:14:16.587159 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:14:16.597160 1509522 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:14:16.602082 1509522 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:14:16.602156 1509522 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:14:16.607955 1509522 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:14:16.616440 1509522 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:14:16.621598 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 03:14:16.627363 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 03:14:16.633047 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 03:14:16.638975 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 03:14:16.644987 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 03:14:16.650781 1509522 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 03:14:16.656502 1509522 kubeadm.go:391] StartCluster: {Name:ha-447944 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Clust
erName:ha-447944 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.41 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.218 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.133 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.98 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpo
d:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mount
IP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:14:16.656632 1509522 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 03:14:16.656679 1509522 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 03:14:16.703016 1509522 cri.go:89] found id: "1d958f621a195ca659dc9d3e8056d4e8ddf52662c2ddea5b22ba390145397ecf"
I0214 03:14:16.703072 1509522 cri.go:89] found id: "8e8843384931f0f1dd890924b8b5258840ef0cac2c83ed3a94b72125a5b9f419"
I0214 03:14:16.703079 1509522 cri.go:89] found id: "9c0d6e2c3970eb154d4519049f26feee92df3d0bfbe0c4d845f3bc23943470d5"
I0214 03:14:16.703086 1509522 cri.go:89] found id: "29a8efede416a511267720d5615d2844fad1fdfc000ffd014639e321215715f0"
I0214 03:14:16.703092 1509522 cri.go:89] found id: "002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1"
I0214 03:14:16.703099 1509522 cri.go:89] found id: "671171bd8cc89d2576e6f5d6e07feb4d4fe4fe637d7d07167f06fbea9e5d6b6b"
I0214 03:14:16.703104 1509522 cri.go:89] found id: "f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e"
I0214 03:14:16.703110 1509522 cri.go:89] found id: "7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb"
I0214 03:14:16.703115 1509522 cri.go:89] found id: "2d1d563ca45e645a057d0ad676518fd4ba90e20fdc65495caadf502035ec7e9f"
I0214 03:14:16.703125 1509522 cri.go:89] found id: "9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62"
I0214 03:14:16.703132 1509522 cri.go:89] found id: "322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2"
I0214 03:14:16.703137 1509522 cri.go:89] found id: "a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721"
I0214 03:14:16.703155 1509522 cri.go:89] found id: "31292f46771fe2cb0c7fb1beae39ec3012103666633c4ec177dbbb212f5f5a72"
I0214 03:14:16.703172 1509522 cri.go:89] found id: "7fe5eed784edfa513320ecfa6448885dcd59ef5bf50ccbc860f31d679f8d4dfe"
I0214 03:14:16.703180 1509522 cri.go:89] found id: ""
I0214 03:14:16.703235 1509522 ssh_runner.go:195] Run: sudo runc list -f json
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 03:02:18 UTC, ends at Wed 2024-02-14 03:19:20 UTC. --
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.144855267Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=a7a778bb-6215-4176-9b80-358637165dee name=/runtime.v1.RuntimeService/Version
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.146018290Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=3bb65cdb-d9f0-4e3d-b425-e62f254ab2a9 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.146505163Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880760146490258,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=3bb65cdb-d9f0-4e3d-b425-e62f254ab2a9 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.147056039Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=82ea61c1-267f-45d3-ab46-7bce6b5f6bbc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.147104422Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=82ea61c1-267f-45d3-ab46-7bce6b5f6bbc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.147545907Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d49010a435f805fdaa81a933b8602924eae916d4d13529e55be715e2fca134bf,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:5,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707880558375845195,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 5,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:3,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707880530374555537,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707880501369663611,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,
io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb877c1667c5983dfd4d752ab326efd428cbb60e52261a067ffc36c092d32a76,PodSandboxId:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707880499365235819,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationM
essagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707880495797575340,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3,PodSandboxId:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707880466752063240,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File
,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1f4281f55f26c33b938f410960218282f5a3f1952e36b297b89df9d270141e1,PodSandboxId:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:3,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707880466653293185,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod:
30,},},&Container{Id:98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:4,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707880466499359982,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 3
0,},},&Container{Id:bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:2,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_EXITED,CreatedAt:1707880464660242452,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2a1ab1ca2803be33d
52be000913a21ae8ebe73526caa9e55323458de9d01ff2d,PodSandboxId:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880464463440705,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c,PodSandboxId:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880463294898029,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"p
rotocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c,PodSandboxId:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707880462772250687,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496f
b97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06,PodSandboxId:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707880462577064284,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe8127
75,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_EXITED,CreatedAt:1707880462147440873,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7
ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_EXITED,CreatedAt:1707880461990603612,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,}
,Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:2,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,State:CONTAINER_EXITED,CreatedAt:1707880255375588099,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kub
ernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707879954989619467,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791127180684,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tc
p\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791198215175,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string
]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707879785334161721,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kuberne
tes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707879764453282079,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernete
s.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707879764473302548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:
map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=82ea61c1-267f-45d3-ab46-7bce6b5f6bbc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.193009453Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=54bf59c1-e8ff-483c-92ab-8d3a46ce731a name=/runtime.v1.RuntimeService/Version
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.193066189Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=54bf59c1-e8ff-483c-92ab-8d3a46ce731a name=/runtime.v1.RuntimeService/Version
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.194146154Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=14fa45b4-4f4c-46bb-9c98-d4981666ae6b name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.194583074Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880760194570057,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=14fa45b4-4f4c-46bb-9c98-d4981666ae6b name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.195463427Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=92ef0c52-19c2-44a4-b2fc-c0df0641dbc1 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.195512463Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=92ef0c52-19c2-44a4-b2fc-c0df0641dbc1 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.196408080Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d49010a435f805fdaa81a933b8602924eae916d4d13529e55be715e2fca134bf,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:5,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707880558375845195,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 5,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:3,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707880530374555537,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707880501369663611,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,
io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb877c1667c5983dfd4d752ab326efd428cbb60e52261a067ffc36c092d32a76,PodSandboxId:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707880499365235819,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationM
essagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707880495797575340,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3,PodSandboxId:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707880466752063240,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File
,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1f4281f55f26c33b938f410960218282f5a3f1952e36b297b89df9d270141e1,PodSandboxId:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:3,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707880466653293185,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod:
30,},},&Container{Id:98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:4,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707880466499359982,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 3
0,},},&Container{Id:bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:2,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_EXITED,CreatedAt:1707880464660242452,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2a1ab1ca2803be33d
52be000913a21ae8ebe73526caa9e55323458de9d01ff2d,PodSandboxId:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880464463440705,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c,PodSandboxId:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880463294898029,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"p
rotocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c,PodSandboxId:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707880462772250687,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496f
b97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06,PodSandboxId:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707880462577064284,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe8127
75,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_EXITED,CreatedAt:1707880462147440873,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7
ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_EXITED,CreatedAt:1707880461990603612,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,}
,Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:2,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,State:CONTAINER_EXITED,CreatedAt:1707880255375588099,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kub
ernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707879954989619467,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791127180684,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tc
p\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791198215175,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string
]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707879785334161721,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kuberne
tes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707879764453282079,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernete
s.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707879764473302548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:
map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=92ef0c52-19c2-44a4-b2fc-c0df0641dbc1 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.240000210Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=02bd2714-91ec-4eb7-a214-e5b68d500da7 name=/runtime.v1.RuntimeService/Version
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.240058808Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=02bd2714-91ec-4eb7-a214-e5b68d500da7 name=/runtime.v1.RuntimeService/Version
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.241501624Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=1b357fb6-bbd9-4804-8b0f-f743930a8eb8 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.242005108Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707880760241990121,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:137664,},InodesUsed:&UInt64Value{Value:69,},},},}" file="go-grpc-middleware/chain.go:25" id=1b357fb6-bbd9-4804-8b0f-f743930a8eb8 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.242930892Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=fa79a430-dc7f-4d63-9392-1f2a6dd8a8c1 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.242980592Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=fa79a430-dc7f-4d63-9392-1f2a6dd8a8c1 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.243480018Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d49010a435f805fdaa81a933b8602924eae916d4d13529e55be715e2fca134bf,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:5,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707880558375845195,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 5,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:3,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707880530374555537,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707880501369663611,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,
io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb877c1667c5983dfd4d752ab326efd428cbb60e52261a067ffc36c092d32a76,PodSandboxId:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707880499365235819,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationM
essagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707880495797575340,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3,PodSandboxId:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707880466752063240,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File
,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1f4281f55f26c33b938f410960218282f5a3f1952e36b297b89df9d270141e1,PodSandboxId:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:3,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707880466653293185,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod:
30,},},&Container{Id:98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:4,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707880466499359982,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 3
0,},},&Container{Id:bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:2,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_EXITED,CreatedAt:1707880464660242452,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2a1ab1ca2803be33d
52be000913a21ae8ebe73526caa9e55323458de9d01ff2d,PodSandboxId:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880464463440705,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c,PodSandboxId:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880463294898029,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"p
rotocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c,PodSandboxId:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707880462772250687,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496f
b97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06,PodSandboxId:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707880462577064284,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe8127
75,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_EXITED,CreatedAt:1707880462147440873,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7
ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_EXITED,CreatedAt:1707880461990603612,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,}
,Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:2,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,State:CONTAINER_EXITED,CreatedAt:1707880255375588099,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kub
ernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707879954989619467,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791127180684,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tc
p\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791198215175,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string
]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707879785334161721,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kuberne
tes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707879764453282079,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernete
s.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707879764473302548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:
map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=fa79a430-dc7f-4d63-9392-1f2a6dd8a8c1 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.253344842Z" level=debug msg="Request: &ListPodSandboxRequest{Filter:nil,}" file="go-grpc-middleware/chain.go:25" id=f85922c7-6904-4ff0-9e19-96c513a85c3a name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.253851503Z" level=debug msg="Response: &ListPodSandboxResponse{Items:[]*PodSandbox{&PodSandbox{Id:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&PodSandboxMetadata{Name:busybox-5b5d89c9d6-szrmk,Uid:56ad0ee8-8c4a-4894-b742-a0b3f225feac,Namespace:default,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880498289838187,Labels:map[string]string{app: busybox,io.kubernetes.container.name: POD,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,pod-template-hash: 5b5d89c9d6,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:05:48.794588673Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-chs9l,Uid:224031c4-3d57-4119-921f-0e3fcdceec9c,Namespace:kube-system,Attempt:1,},Sta
te:SANDBOX_READY,CreatedAt:1707880461118950089,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:03:10.003667874Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-rpnsx,Uid:cef2a300-e8ff-4099-a5c4-4906889e902c,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880461090871221,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.see
n: 2024-02-14T03:03:10.012691557Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&PodSandboxMetadata{Name:etcd-ha-447944,Uid:64faa5e496fb97c5a90d3a47323b357f,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880461048376665,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/etcd.advertise-client-urls: https://192.168.39.41:2379,kubernetes.io/config.hash: 64faa5e496fb97c5a90d3a47323b357f,kubernetes.io/config.seen: 2024-02-14T03:02:53.262365899Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&PodSandboxMetadata{Name:kindnet-pjrmh,Uid:5cc39f50-0de5-40b5-b670-b33acc977740,Namesp
ace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880461043101017,Labels:map[string]string{app: kindnet,controller-revision-hash: 5666b6c4d,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,k8s-app: kindnet,pod-template-generation: 1,tier: node,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:03:04.458609221Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&PodSandboxMetadata{Name:kube-controller-manager-ha-447944,Uid:fb623973b15ba7ea287415468ab19e1d,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880461011418634,Labels:map[string]string{component: kube-controller-manager,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea
287415468ab19e1d,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: fb623973b15ba7ea287415468ab19e1d,kubernetes.io/config.seen: 2024-02-14T03:02:53.262370421Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&PodSandboxMetadata{Name:kube-proxy-dpm4f,Uid:2e0eb813-44c4-4623-8789-d37194b83ecd,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880461005111971,Labels:map[string]string{controller-revision-hash: 8486c7d9cd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,k8s-app: kube-proxy,pod-template-generation: 1,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:03:04.422994234Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&PodSandbo
xMetadata{Name:kube-vip-ha-447944,Uid:32ca1c2935305085422a6f76f25ef46f,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880460996455002,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{kubernetes.io/config.hash: 32ca1c2935305085422a6f76f25ef46f,kubernetes.io/config.seen: 2024-02-14T03:02:53.262372033Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&PodSandboxMetadata{Name:kube-apiserver-ha-447944,Uid:ffa86fcdea5fcdc73edd7aba90728e29,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880460895871249,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcd
ea5fcdc73edd7aba90728e29,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.39.41:8443,kubernetes.io/config.hash: ffa86fcdea5fcdc73edd7aba90728e29,kubernetes.io/config.seen: 2024-02-14T03:02:53.262369337Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&PodSandboxMetadata{Name:kube-scheduler-ha-447944,Uid:3795d216737fb7541ab5f49ebe812775,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880460889476698,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 3795d216737fb7541ab5f49ebe812775,kubernetes.io/config.seen: 2024-02-14T03:02:53.262371358Z,kubernetes.io/config.source: f
ile,},RuntimeHandler:,},&PodSandbox{Id:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&PodSandboxMetadata{Name:storage-provisioner,Uid:7da2937f-2d9b-40d4-a521-5bf4a2585de7,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707880460876449668,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,integration-test: storage-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imag
ePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n,kubernetes.io/config.seen: 2024-02-14T03:03:10.017826790Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&PodSandboxMetadata{Name:busybox-5b5d89c9d6-szrmk,Uid:56ad0ee8-8c4a-4894-b742-a0b3f225feac,Namespace:default,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707879949445426093,Labels:map[string]string{app: busybox,io.kubernetes.container.name: POD,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,pod-template-hash: 5b5d89c9d6,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:05:48.794588673Z,kubernetes.io/config.sou
rce: api,},RuntimeHandler:,},&PodSandbox{Id:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-rpnsx,Uid:cef2a300-e8ff-4099-a5c4-4906889e902c,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707879790368571204,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:03:10.012691557Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-chs9l,Uid:224031c4-3d57-4119-921f-0e3fcdceec9c,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707879790333679643,Labels:map[string]string{io.kubernetes.container.name: POD,io
.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:03:10.003667874Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&PodSandboxMetadata{Name:kube-proxy-dpm4f,Uid:2e0eb813-44c4-4623-8789-d37194b83ecd,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707879784763419323,Labels:map[string]string{controller-revision-hash: 8486c7d9cd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,k8s-app: kube-proxy,pod-template-generation: 1,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:03:04.422994234Z,kubernetes.io/config.source: api,},RuntimeHandler:,
},&PodSandbox{Id:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&PodSandboxMetadata{Name:kube-vip-ha-447944,Uid:32ca1c2935305085422a6f76f25ef46f,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707879763309053071,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{kubernetes.io/config.hash: 32ca1c2935305085422a6f76f25ef46f,kubernetes.io/config.seen: 2024-02-14T03:02:42.748806039Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&PodSandboxMetadata{Name:kube-scheduler-ha-447944,Uid:3795d216737fb7541ab5f49ebe812775,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707879763277450164,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.
pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 3795d216737fb7541ab5f49ebe812775,kubernetes.io/config.seen: 2024-02-14T03:02:42.748805417Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&PodSandboxMetadata{Name:etcd-ha-447944,Uid:64faa5e496fb97c5a90d3a47323b357f,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707879763225368015,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/etcd.advertise-client-urls: https://192.168.39.41:2379,kubernetes.io/config.hash: 64faa5e496fb97c5a90d3a47323b357f,kubernetes.io/c
onfig.seen: 2024-02-14T03:02:42.748799408Z,kubernetes.io/config.source: file,},RuntimeHandler:,},},}" file="go-grpc-middleware/chain.go:25" id=f85922c7-6904-4ff0-9e19-96c513a85c3a name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.255533933Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=f3cdeb02-7e0e-4c0a-b842-6964238e189e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.255621581Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=f3cdeb02-7e0e-4c0a-b842-6964238e189e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:19:20 ha-447944 crio[4018]: time="2024-02-14 03:19:20.257075780Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d49010a435f805fdaa81a933b8602924eae916d4d13529e55be715e2fca134bf,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:5,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707880558375845195,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 5,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:3,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707880530374555537,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707880501369663611,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,},Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,
io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb877c1667c5983dfd4d752ab326efd428cbb60e52261a067ffc36c092d32a76,PodSandboxId:02b2e8f3ce368b95330c8bfa23149e2f66995c50db2a4ca05ac7ba08106a3cde,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707880499365235819,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationM
essagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707880495797575340,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3,PodSandboxId:5c760303d8ddec35a20e330e2baa560f6f39d347c35d88d176d92fd142e08c64,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707880466752063240,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File
,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1f4281f55f26c33b938f410960218282f5a3f1952e36b297b89df9d270141e1,PodSandboxId:d81f26b4fcf939c7c19452a3a3ae1bd54549e0930c94679575ed319856e6107a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:3,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:ghcr.io/kube-vip/kube-vip@sha256:1bad094ddeff80bb0be64702f3a6ac4f2f78d8dbb226065a138b2526ce18d244,State:CONTAINER_RUNNING,CreatedAt:1707880466653293185,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod:
30,},},&Container{Id:98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8,PodSandboxId:10949bd67a6bc0b38c09064b2b9a980c079c983d2f8cf095f9f261e9b0c01b62,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:4,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707880466499359982,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7da2937f-2d9b-40d4-a521-5bf4a2585de7,},Annotations:map[string]string{io.kubernetes.container.hash: 903bcdc5,io.kubernetes.container.restartCount: 4,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 3
0,},},&Container{Id:bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b,PodSandboxId:b4690b55c83f81c0e0413419289573aad3e5e4cc5587a6f6c884b45db49bde7e,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:2,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_EXITED,CreatedAt:1707880464660242452,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-pjrmh,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5cc39f50-0de5-40b5-b670-b33acc977740,},Annotations:map[string]string{io.kubernetes.container.hash: a5481de9,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2a1ab1ca2803be33d
52be000913a21ae8ebe73526caa9e55323458de9d01ff2d,PodSandboxId:b2c8bba1aa32290102707731d387aac85053f8fdb56590b4afdc8a5eff45ba3d,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880464463440705,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c,PodSandboxId:e1bddd2aa1d92c111fe9b5739f4eb9a48043f7b835bae3d005ba800fdc61de70,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707880463294898029,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"p
rotocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c,PodSandboxId:cc6ee8e655599ac4822db8aa7bcb91d08eafe4fd687f5354e3bc628c82815bc4,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707880462772250687,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 64faa5e496f
b97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06,PodSandboxId:9c11700337b20f6a918137a159874bdebaa6bc83cda1ddd2594277d414ba25a1,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707880462577064284,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe8127
75,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37,PodSandboxId:8ed4381cd998cd23fb56a3b639fd8b08d98d58c03090eb775d69fed006c44aa1,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_EXITED,CreatedAt:1707880462147440873,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fb623973b15ba7
ea287415468ab19e1d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401,PodSandboxId:03d5368023625b2dcf928978e5b153eccec693a5e20b7bf20c4103435a83ba49,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_EXITED,CreatedAt:1707880461990603612,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ffa86fcdea5fcdc73edd7aba90728e29,}
,Annotations:map[string]string{io.kubernetes.container.hash: cefaf10a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:002a79d38b1f4af5d070f7e958dfe211784accdb8c9633c53e516dfa1dd5fce1,PodSandboxId:40d66b939fbde42b3fca6a2d4916b3c5c1e6a80ac95984424f71dd829b8ae2a5,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:2,},Image:&ImageSpec{Image:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,Annotations:map[string]string{},},ImageRef:77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e,State:CONTAINER_EXITED,CreatedAt:1707880255375588099,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 32ca1c2935305085422a6f76f25ef46f,},Annotations:map[string]string{io.kubernetes.container.hash: 163d5c68,io.kub
ernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:158ed81c1ad094c332e9b1f51bf4f4676625190651272f9ed11aac5d0be87bc1,PodSandboxId:ae707b68d26d7d8ba17b12f00a3623fadcdb387f01dd8d66204376079272c410,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707879954989619467,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-szrmk,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 56ad0ee8-8c4a-4894-b742-a0b3f225feac,},Annotations:map[string]string{io.kubernetes.container.hash: 6b5f0223,io.kubernetes.container.restartCount: 0,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb,PodSandboxId:9646d9ad7639e08ee228366dbde19df426b7cc91f589b2a63ea70d319d5453f5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791127180684,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-chs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224031c4-3d57-4119-921f-0e3fcdceec9c,},Annotations:map[string]string{io.kubernetes.container.hash: e21c0f2b,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tc
p\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e,PodSandboxId:f5b7a259c65769702d145f2406ad67cdb478bc557ea7b1674c86aa48ea69fce5,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707879791198215175,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rpnsx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cef2a300-e8ff-4099-a5c4-4906889e902c,},Annotations:map[string
]string{io.kubernetes.container.hash: e7b4ddbe,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62,PodSandboxId:c168dfe284262f507ae29ed4ffdeab7b1af5f8ad82fc2d4302299a047fe4618c,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707879785334161721,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kuberne
tes.pod.name: kube-proxy-dpm4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2e0eb813-44c4-4623-8789-d37194b83ecd,},Annotations:map[string]string{io.kubernetes.container.hash: da0fe5d9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721,PodSandboxId:bb35989a473015caf5559cd828d17d4e347e63827a3d98048cfe2db71bd2f48a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707879764453282079,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernete
s.pod.uid: 64faa5e496fb97c5a90d3a47323b357f,},Annotations:map[string]string{io.kubernetes.container.hash: 42a66b49,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2,PodSandboxId:fc67797793fd236da81e560714b4bb2a96f4aaab6cd07e855bba0fc0f72be698,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707879764473302548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-447944,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3795d216737fb7541ab5f49ebe812775,},Annotations:
map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=f3cdeb02-7e0e-4c0a-b842-6964238e189e name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
d49010a435f80 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 3 minutes ago Running storage-provisioner 5 10949bd67a6bc storage-provisioner
4bfa5af0ec20f c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc 3 minutes ago Running kindnet-cni 3 b4690b55c83f8 kindnet-pjrmh
bc90f93033473 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 4 minutes ago Running kube-apiserver 3 03d5368023625 kube-apiserver-ha-447944
cb877c1667c59 8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a 4 minutes ago Running busybox 1 02b2e8f3ce368 busybox-5b5d89c9d6-szrmk
c22fff8dbdc28 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 4 minutes ago Running kube-controller-manager 2 8ed4381cd998c kube-controller-manager-ha-447944
776fb551af350 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 4 minutes ago Running kube-proxy 1 5c760303d8dde kube-proxy-dpm4f
d1f4281f55f26 77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e 4 minutes ago Running kube-vip 3 d81f26b4fcf93 kube-vip-ha-447944
98210e700c7fa 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 4 minutes ago Exited storage-provisioner 4 10949bd67a6bc storage-provisioner
bcb97d264d1f1 c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc 4 minutes ago Exited kindnet-cni 2 b4690b55c83f8 kindnet-pjrmh
2a1ab1ca2803b ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 4 minutes ago Running coredns 1 b2c8bba1aa322 coredns-5dd5756b68-rpnsx
72c1c5c3b503c ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 4 minutes ago Running coredns 1 e1bddd2aa1d92 coredns-5dd5756b68-chs9l
f8a4151cdb5ee 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 4 minutes ago Running etcd 1 cc6ee8e655599 etcd-ha-447944
35ec096957d69 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 4 minutes ago Running kube-scheduler 1 9c11700337b20 kube-scheduler-ha-447944
e84f8f9869e55 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 4 minutes ago Exited kube-controller-manager 1 8ed4381cd998c kube-controller-manager-ha-447944
5ec156699f6e7 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 4 minutes ago Exited kube-apiserver 2 03d5368023625 kube-apiserver-ha-447944
002a79d38b1f4 77b3b20cc85fd48a8d543618799bcc3b791d1d557420a93e5a3cf5a01cd0dc1e 8 minutes ago Exited kube-vip 2 40d66b939fbde kube-vip-ha-447944
158ed81c1ad09 gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 13 minutes ago Exited busybox 0 ae707b68d26d7 busybox-5b5d89c9d6-szrmk
f046573e5c613 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 16 minutes ago Exited coredns 0 f5b7a259c6576 coredns-5dd5756b68-rpnsx
7e9bb46f5e644 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 16 minutes ago Exited coredns 0 9646d9ad7639e coredns-5dd5756b68-chs9l
9d1286d601bde 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 16 minutes ago Exited kube-proxy 0 c168dfe284262 kube-proxy-dpm4f
322a42a79321e e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 16 minutes ago Exited kube-scheduler 0 fc67797793fd2 kube-scheduler-ha-447944
a8ad5c38dc289 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 16 minutes ago Exited etcd 0 bb35989a47301 etcd-ha-447944
==> coredns [2a1ab1ca2803be33d52be000913a21ae8ebe73526caa9e55323458de9d01ff2d] <==
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:40056 - 28650 "HINFO IN 2285009284393712744.3131797207477244586. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.030016963s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": net/http: TLS handshake timeout
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: read tcp 10.244.0.5:54458->10.96.0.1:443: read: connection reset by peer
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> coredns [72c1c5c3b503c4fd88a51a78323918ab87e0c4c8d0add3521061c6e384da0a1c] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:34101 - 42017 "HINFO IN 5146137997769423191.5072381909957528507. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.028935984s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": net/http: TLS handshake timeout
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: read tcp 10.244.0.6:59250->10.96.0.1:443: read: connection reset by peer
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: no route to host
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: connect: no route to host
==> coredns [7e9bb46f5e64415492840f80e59aa7c305d8f554b4bac4bdfad662a8525ec4fb] <==
[INFO] 10.244.1.2:56830 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000207364s
[INFO] 10.244.1.2:53196 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000201609s
[INFO] 10.244.0.4:57282 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000255022s
[INFO] 10.244.0.4:42175 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000101666s
[INFO] 10.244.0.4:47990 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001543994s
[INFO] 10.244.2.2:36297 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000098014s
[INFO] 10.244.2.2:55624 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001606173s
[INFO] 10.244.1.2:42215 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000164975s
[INFO] 10.244.1.2:56863 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00013524s
[INFO] 10.244.0.4:54854 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000077245s
[INFO] 10.244.2.2:47287 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000112202s
[INFO] 10.244.2.2:57185 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000259211s
[INFO] 10.244.2.2:34362 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00020542s
[INFO] 10.244.2.2:35530 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000085011s
[INFO] 10.244.1.2:55025 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000219197s
[INFO] 10.244.1.2:41871 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000278055s
[INFO] 10.244.0.4:34459 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000106414s
[INFO] 10.244.0.4:49400 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000157055s
[INFO] 10.244.0.4:45347 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000226252s
[INFO] 10.244.2.2:56178 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000172264s
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?allowWatchBookmarks=true&resourceVersion=1825&timeout=9m40s&timeoutSeconds=580&watch=true": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.Service: Get "https://10.96.0.1:443/api/v1/services?allowWatchBookmarks=true&resourceVersion=1870&timeout=6m22s&timeoutSeconds=382&watch=true": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?allowWatchBookmarks=true&resourceVersion=1872&timeout=9m41s&timeoutSeconds=581&watch=true": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> coredns [f046573e5c6136ad04bb7ccbb79b3f78a9ca6dcda069b9b015e4ec8fa2dba01e] <==
[INFO] 10.244.0.4:59564 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00011757s
[INFO] 10.244.0.4:57775 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000059017s
[INFO] 10.244.0.4:50120 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000078756s
[INFO] 10.244.2.2:49507 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000141378s
[INFO] 10.244.2.2:49171 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001957068s
[INFO] 10.244.2.2:33740 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000387227s
[INFO] 10.244.2.2:35506 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000108121s
[INFO] 10.244.2.2:58270 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000096656s
[INFO] 10.244.2.2:47275 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000113722s
[INFO] 10.244.1.2:39124 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000232628s
[INFO] 10.244.1.2:36677 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000104764s
[INFO] 10.244.0.4:52867 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000150283s
[INFO] 10.244.0.4:39534 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000098645s
[INFO] 10.244.0.4:52205 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000134847s
[INFO] 10.244.1.2:57709 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000561618s
[INFO] 10.244.1.2:44823 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000149413s
[INFO] 10.244.0.4:53053 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000090637s
[INFO] 10.244.2.2:59333 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000158454s
[INFO] 10.244.2.2:48734 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000320234s
[INFO] 10.244.2.2:57167 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000155417s
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.Namespace: the server has asked for the client to provide credentials (get namespaces) - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.Service: the server has asked for the client to provide credentials (get services) - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.26.1/tools/cache/reflector.go:169: Failed to watch *v1.EndpointSlice: the server has asked for the client to provide credentials (get endpointslices.discovery.k8s.io) - error from a previous attempt: http2: server sent GOAWAY and closed the connection; LastStreamID=25, ErrCode=NO_ERROR, debug=""
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> describe nodes <==
Name: ha-447944
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T03_02_54_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:02:50 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:19:16 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:15:04 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:15:04 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:15:04 +0000 Wed, 14 Feb 2024 03:02:48 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:15:04 +0000 Wed, 14 Feb 2024 03:03:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.41
Hostname: ha-447944
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: a6361e2fe77648efb80ef77ef65e19b9
System UUID: a6361e2f-e776-48ef-b80e-f77ef65e19b9
Boot ID: 028eaefa-0af8-4862-9bdb-3627e617e5df
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-szrmk 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system coredns-5dd5756b68-chs9l 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 16m
kube-system coredns-5dd5756b68-rpnsx 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 16m
kube-system etcd-ha-447944 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 16m
kube-system kindnet-pjrmh 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 16m
kube-system kube-apiserver-ha-447944 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 16m
kube-system kube-controller-manager-ha-447944 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 16m
kube-system kube-proxy-dpm4f 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 16m
kube-system kube-scheduler-ha-447944 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 16m
kube-system kube-vip-ha-447944 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 16m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 16m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 290Mi (13%!)(MISSING) 390Mi (18%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4m10s kube-proxy
Normal Starting 16m kube-proxy
Normal NodeHasSufficientMemory 16m (x8 over 16m) kubelet Node ha-447944 status is now: NodeHasSufficientMemory
Normal NodeAllocatableEnforced 16m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientPID 16m (x7 over 16m) kubelet Node ha-447944 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 16m (x8 over 16m) kubelet Node ha-447944 status is now: NodeHasNoDiskPressure
Normal Starting 16m kubelet Starting kubelet.
Normal NodeAllocatableEnforced 16m kubelet Updated Node Allocatable limit across pods
Normal Starting 16m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 16m kubelet Node ha-447944 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 16m kubelet Node ha-447944 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 16m kubelet Node ha-447944 status is now: NodeHasSufficientPID
Normal RegisteredNode 16m node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal NodeReady 16m kubelet Node ha-447944 status is now: NodeReady
Normal RegisteredNode 14m node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal RegisteredNode 13m node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Warning ContainerGCFailed 5m27s (x2 over 6m27s) kubelet rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
Normal RegisteredNode 4m4s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal RegisteredNode 4m2s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Normal RegisteredNode 2m56s node-controller Node ha-447944 event: Registered Node ha-447944 in Controller
Name: ha-447944-m02
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_04_17_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:04:00 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m02
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:19:12 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:15:48 +0000 Wed, 14 Feb 2024 03:15:07 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:15:48 +0000 Wed, 14 Feb 2024 03:15:07 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:15:48 +0000 Wed, 14 Feb 2024 03:15:07 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:15:48 +0000 Wed, 14 Feb 2024 03:15:07 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.218
Hostname: ha-447944-m02
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 535bf6eb4ee34dd6b837047738e23b84
System UUID: 535bf6eb-4ee3-4dd6-b837-047738e23b84
Boot ID: c9f45ceb-0d25-46ab-8e95-81772c4d30d0
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-mjds9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 13m
kube-system etcd-ha-447944-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kindnet-xkmkd 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 15m
kube-system kube-apiserver-ha-447944-m02 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kube-controller-manager-ha-447944-m02 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kube-proxy-9cjk2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kube-scheduler-ha-447944-m02 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kube-vip-ha-447944-m02 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 100m (5%!)(MISSING)
memory 150Mi (7%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 15m kube-proxy
Normal Starting 4m8s kube-proxy
Normal RegisteredNode 14m node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal RegisteredNode 13m node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal NodeNotReady 11m node-controller Node ha-447944-m02 status is now: NodeNotReady
Normal NodeHasNoDiskPressure 4m41s (x8 over 4m41s) kubelet Node ha-447944-m02 status is now: NodeHasNoDiskPressure
Normal Starting 4m41s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 4m41s (x8 over 4m41s) kubelet Node ha-447944-m02 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 4m41s (x7 over 4m41s) kubelet Node ha-447944-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 4m41s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 4m4s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal RegisteredNode 4m2s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Normal RegisteredNode 2m56s node-controller Node ha-447944-m02 event: Registered Node ha-447944-m02 in Controller
Name: ha-447944-m04
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-447944-m04
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ha-447944
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_06_31_0700
minikube.k8s.io/version=v1.32.0
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:06:30 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: ha-447944-m04
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:16:50 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Wed, 14 Feb 2024 03:16:40 +0000 Wed, 14 Feb 2024 03:17:31 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Wed, 14 Feb 2024 03:16:40 +0000 Wed, 14 Feb 2024 03:17:31 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Wed, 14 Feb 2024 03:16:40 +0000 Wed, 14 Feb 2024 03:17:31 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Wed, 14 Feb 2024 03:16:40 +0000 Wed, 14 Feb 2024 03:17:31 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.168.39.98
Hostname: ha-447944-m04
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: d8594ac4943e4e6ca3585573b6de953f
System UUID: d8594ac4-943e-4e6c-a358-5573b6de953f
Boot ID: 9d74b5a0-00c2-4b8e-ab27-e09751cadbe4
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.3.0/24
PodCIDRs: 10.244.3.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-zr77k 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 2m30s
kube-system kindnet-ldndh 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 12m
kube-system kube-proxy-jrhq2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 2m36s kube-proxy
Normal Starting 12m kube-proxy
Normal NodeHasSufficientMemory 12m (x5 over 12m) kubelet Node ha-447944-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m (x5 over 12m) kubelet Node ha-447944-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m (x5 over 12m) kubelet Node ha-447944-m04 status is now: NodeHasSufficientPID
Normal RegisteredNode 12m node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 12m node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 12m node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal NodeReady 12m kubelet Node ha-447944-m04 status is now: NodeReady
Normal RegisteredNode 4m4s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 4m2s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal RegisteredNode 2m56s node-controller Node ha-447944-m04 event: Registered Node ha-447944-m04 in Controller
Normal NodeHasSufficientMemory 2m40s (x2 over 2m40s) kubelet Node ha-447944-m04 status is now: NodeHasSufficientMemory
Normal NodeAllocatableEnforced 2m40s kubelet Updated Node Allocatable limit across pods
Warning Rebooted 2m40s kubelet Node ha-447944-m04 has been rebooted, boot id: 9d74b5a0-00c2-4b8e-ab27-e09751cadbe4
Normal Starting 2m40s kubelet Starting kubelet.
Normal NodeHasNoDiskPressure 2m40s (x2 over 2m40s) kubelet Node ha-447944-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 2m40s (x2 over 2m40s) kubelet Node ha-447944-m04 status is now: NodeHasSufficientPID
Normal NodeReady 2m40s kubelet Node ha-447944-m04 status is now: NodeReady
Normal NodeNotReady 109s (x2 over 3m24s) node-controller Node ha-447944-m04 status is now: NodeNotReady
==> dmesg <==
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.067171] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.354129] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.296154] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.134944] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.012559] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +9.434119] systemd-fstab-generator[642]: Ignoring "noauto" for root device
[ +0.104064] systemd-fstab-generator[653]: Ignoring "noauto" for root device
[ +0.157556] systemd-fstab-generator[666]: Ignoring "noauto" for root device
[ +0.109767] systemd-fstab-generator[677]: Ignoring "noauto" for root device
[ +0.213788] systemd-fstab-generator[702]: Ignoring "noauto" for root device
[ +5.352315] systemd-fstab-generator[804]: Ignoring "noauto" for root device
[ +3.604175] systemd-fstab-generator[984]: Ignoring "noauto" for root device
[ +10.810722] systemd-fstab-generator[1413]: Ignoring "noauto" for root device
[Feb14 03:03] kauditd_printk_skb: 18 callbacks suppressed
[Feb14 03:14] systemd-fstab-generator[3946]: Ignoring "noauto" for root device
[ +0.165805] systemd-fstab-generator[3957]: Ignoring "noauto" for root device
[ +0.237773] systemd-fstab-generator[3970]: Ignoring "noauto" for root device
[ +0.162041] systemd-fstab-generator[3981]: Ignoring "noauto" for root device
[ +0.259850] systemd-fstab-generator[4004]: Ignoring "noauto" for root device
[ +8.475204] systemd-fstab-generator[4110]: Ignoring "noauto" for root device
==> etcd [a8ad5c38dc289e1b527fdf2bde42a3d298880b633e756f96a507494aaa09d721] <==
WARNING: 2024/02/14 03:12:35 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
{"level":"warn","ts":"2024-02-14T03:12:35.094458Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T03:12:33.876243Z","time spent":"1.218212066s","remote":"127.0.0.1:59278","response type":"/etcdserverpb.KV/Range","request count":0,"request size":43,"response count":0,"response size":0,"request content":"key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" limit:10000 "}
WARNING: 2024/02/14 03:12:35 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
{"level":"warn","ts":"2024-02-14T03:12:35.094556Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T03:12:34.113919Z","time spent":"980.629855ms","remote":"127.0.0.1:59246","response type":"/etcdserverpb.KV/Range","request count":0,"request size":57,"response count":0,"response size":0,"request content":"key:\"/registry/services/specs/\" range_end:\"/registry/services/specs0\" limit:500 "}
WARNING: 2024/02/14 03:12:35 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
{"level":"warn","ts":"2024-02-14T03:12:35.125816Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.39.41:2379: use of closed network connection"}
{"level":"warn","ts":"2024-02-14T03:12:35.125886Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.39.41:2379: use of closed network connection"}
{"level":"info","ts":"2024-02-14T03:12:35.127568Z","caller":"etcdserver/server.go:1456","msg":"skipped leadership transfer; local server is not leader","local-member-id":"903e0dada8362847","current-leader-member-id":"0"}
{"level":"info","ts":"2024-02-14T03:12:35.127867Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.127924Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.127957Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128068Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128114Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128178Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128216Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"3c62304b6daead5d"}
{"level":"info","ts":"2024-02-14T03:12:35.128225Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128234Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128259Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128333Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128389Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128419Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.128429Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:12:35.132021Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.39.41:2380"}
{"level":"info","ts":"2024-02-14T03:12:35.13211Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.39.41:2380"}
{"level":"info","ts":"2024-02-14T03:12:35.132147Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"ha-447944","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.41:2380"],"advertise-client-urls":["https://192.168.39.41:2379"]}
==> etcd [f8a4151cdb5ee33ef274536c342c0b88e58fb0adb75a067a9c1a85c054be277c] <==
{"level":"info","ts":"2024-02-14T03:16:05.038776Z","caller":"rafthttp/stream.go:412","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:05.041064Z","caller":"rafthttp/stream.go:412","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:05.05592Z","caller":"rafthttp/stream.go:249","msg":"set message encoder","from":"903e0dada8362847","to":"277527925922cf1a","stream-type":"stream MsgApp v2"}
{"level":"info","ts":"2024-02-14T03:16:05.056033Z","caller":"rafthttp/stream.go:274","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:05.062164Z","caller":"rafthttp/stream.go:249","msg":"set message encoder","from":"903e0dada8362847","to":"277527925922cf1a","stream-type":"stream Message"}
{"level":"info","ts":"2024-02-14T03:16:05.062516Z","caller":"rafthttp/stream.go:274","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:47.261553Z","caller":"traceutil/trace.go:171","msg":"trace[118098276] transaction","detail":"{read_only:false; response_revision:2488; number_of_response:1; }","duration":"123.64374ms","start":"2024-02-14T03:16:47.137867Z","end":"2024-02-14T03:16:47.261511Z","steps":["trace[118098276] 'process raft request' (duration: 123.341308ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T03:16:54.062138Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"903e0dada8362847 switched to configuration voters=(4351093290514165085 10393760029520308295)"}
{"level":"info","ts":"2024-02-14T03:16:54.062522Z","caller":"membership/cluster.go:472","msg":"removed member","cluster-id":"b5cacf25c2f2940e","local-member-id":"903e0dada8362847","removed-remote-peer-id":"277527925922cf1a","removed-remote-peer-urls":["https://192.168.39.133:2380"]}
{"level":"info","ts":"2024-02-14T03:16:54.062635Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"277527925922cf1a"}
{"level":"warn","ts":"2024-02-14T03:16:54.062938Z","caller":"rafthttp/stream.go:286","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:54.063013Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"277527925922cf1a"}
{"level":"warn","ts":"2024-02-14T03:16:54.063219Z","caller":"rafthttp/stream.go:286","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:54.063286Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:54.063525Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"warn","ts":"2024-02-14T03:16:54.064217Z","caller":"rafthttp/stream.go:421","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a","error":"context canceled"}
{"level":"warn","ts":"2024-02-14T03:16:54.064301Z","caller":"rafthttp/peer_status.go:66","msg":"peer became inactive (message send to peer failed)","peer-id":"277527925922cf1a","error":"failed to read 277527925922cf1a on stream MsgApp v2 (context canceled)"}
{"level":"info","ts":"2024-02-14T03:16:54.064341Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"warn","ts":"2024-02-14T03:16:54.064547Z","caller":"rafthttp/stream.go:421","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a","error":"context canceled"}
{"level":"info","ts":"2024-02-14T03:16:54.064573Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"903e0dada8362847","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:54.064588Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:54.064603Z","caller":"rafthttp/transport.go:355","msg":"removed remote peer","local-member-id":"903e0dada8362847","removed-remote-peer-id":"277527925922cf1a"}
{"level":"info","ts":"2024-02-14T03:16:54.064916Z","caller":"etcdserver/server.go:1940","msg":"applied a configuration change through raft","local-member-id":"903e0dada8362847","raft-conf-change":"ConfChangeRemoveNode","raft-conf-change-node-id":"277527925922cf1a"}
{"level":"warn","ts":"2024-02-14T03:16:54.07315Z","caller":"rafthttp/http.go:394","msg":"rejected stream from remote peer because it was removed","local-member-id":"903e0dada8362847","remote-peer-id-stream-handler":"903e0dada8362847","remote-peer-id-from":"277527925922cf1a"}
{"level":"warn","ts":"2024-02-14T03:16:54.078664Z","caller":"rafthttp/http.go:394","msg":"rejected stream from remote peer because it was removed","local-member-id":"903e0dada8362847","remote-peer-id-stream-handler":"903e0dada8362847","remote-peer-id-from":"277527925922cf1a"}
==> kernel <==
03:19:20 up 17 min, 0 users, load average: 0.30, 0.53, 0.47
Linux ha-447944 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kindnet [4bfa5af0ec20f0603a92eb6209b84dfa96fd82607d1562426f91e7b419ce44fb] <==
I0214 03:18:32.149617 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:18:42.156884 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:18:42.156940 1 main.go:227] handling current node
I0214 03:18:42.156962 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:18:42.156968 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:18:42.157068 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:18:42.157073 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:18:52.174352 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:18:52.174399 1 main.go:227] handling current node
I0214 03:18:52.174420 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:18:52.174431 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:18:52.174598 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:18:52.174634 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:19:02.181672 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:19:02.181780 1 main.go:227] handling current node
I0214 03:19:02.181806 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:19:02.181813 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:19:02.182022 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:19:02.182056 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
I0214 03:19:12.199433 1 main.go:223] Handling node with IPs: map[192.168.39.41:{}]
I0214 03:19:12.199458 1 main.go:227] handling current node
I0214 03:19:12.199477 1 main.go:223] Handling node with IPs: map[192.168.39.218:{}]
I0214 03:19:12.199481 1 main.go:250] Node ha-447944-m02 has CIDR [10.244.1.0/24]
I0214 03:19:12.199616 1 main.go:223] Handling node with IPs: map[192.168.39.98:{}]
I0214 03:19:12.199663 1 main.go:250] Node ha-447944-m04 has CIDR [10.244.3.0/24]
==> kindnet [bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b] <==
I0214 03:14:25.409351 1 main.go:102] connected to apiserver: https://10.96.0.1:443
I0214 03:14:25.409505 1 main.go:107] hostIP = 192.168.39.41
podIP = 192.168.39.41
I0214 03:14:25.409681 1 main.go:116] setting mtu 1500 for CNI
I0214 03:14:25.412849 1 main.go:146] kindnetd IP family: "ipv4"
I0214 03:14:25.412917 1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
I0214 03:14:35.772951 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": net/http: TLS handshake timeout
I0214 03:14:45.563158 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host - error from a previous attempt: read tcp 192.168.122.107:55512->10.96.0.1:443: read: connection reset by peer
I0214 03:14:51.707653 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host
I0214 03:14:54.779781 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host
I0214 03:15:00.924977 1 main.go:191] Failed to get nodes, retrying after error: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host
panic: Reached maximum retries obtaining node list: Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: no route to host
goroutine 1 [running]:
main.main()
/go/src/cmd/kindnetd/main.go:195 +0xd3d
==> kube-apiserver [5ec156699f6e7a48a1b3de81b560ff795f2df58c8559e02f3d3367f161eb3401] <==
I0214 03:14:23.852969 1 options.go:220] external host was not specified, using 192.168.39.41
I0214 03:14:23.854611 1 server.go:148] Version: v1.28.4
I0214 03:14:23.854685 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
W0214 03:14:24.505431 1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W0214 03:14:24.506329 1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
I0214 03:14:24.509353 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0214 03:14:24.526619 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0214 03:14:24.526954 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0214 03:14:24.527257 1 instance.go:298] Using reconciler: lease
W0214 03:14:24.528776 1 logging.go:59] [core] [Channel #5 SubChannel #6] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"
W0214 03:14:44.505156 1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"
W0214 03:14:44.506524 1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"
F0214 03:14:44.528569 1 instance.go:291] Error creating leases: error creating storage factory: context deadline exceeded
==> kube-apiserver [bc90f93033473c3564add6ee23d22dfbd10879892ff97aa6a0cd8515f1ecc3f3] <==
I0214 03:15:04.152662 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0214 03:15:04.152675 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0214 03:15:04.152693 1 crd_finalizer.go:266] Starting CRDFinalizer
I0214 03:15:04.155576 1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0214 03:15:04.155621 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0214 03:15:04.221402 1 apf_controller.go:377] Running API Priority and Fairness config worker
I0214 03:15:04.221573 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I0214 03:15:04.221615 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0214 03:15:04.223488 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0214 03:15:04.242794 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0214 03:15:04.244469 1 shared_informer.go:318] Caches are synced for configmaps
I0214 03:15:04.246629 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0214 03:15:04.259423 1 shared_informer.go:318] Caches are synced for crd-autoregister
I0214 03:15:04.259534 1 aggregator.go:166] initial CRD sync complete...
I0214 03:15:04.259558 1 autoregister_controller.go:141] Starting autoregister controller
I0214 03:15:04.259573 1 cache.go:32] Waiting for caches to sync for autoregister controller
I0214 03:15:04.259582 1 cache.go:39] Caches are synced for autoregister controller
W0214 03:15:04.284862 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.39.133]
I0214 03:15:04.286508 1 controller.go:624] quota admission added evaluator for: endpoints
I0214 03:15:04.300867 1 shared_informer.go:318] Caches are synced for node_authorizer
I0214 03:15:04.312296 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
E0214 03:15:04.327131 1 controller.go:95] Found stale data, removed previous endpoints on kubernetes service, apiserver didn't exit successfully previously
I0214 03:15:05.242122 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
W0214 03:15:05.856671 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.39.133 192.168.39.41]
W0214 03:17:15.862007 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.39.218 192.168.39.41]
==> kube-controller-manager [c22fff8dbdc286b9851ad5cce09cdaabc2cfda7810143c89f8b6f32aea0c93ed] <==
I0214 03:16:52.796539 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="210.062µs"
I0214 03:16:52.924599 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="13.716723ms"
I0214 03:16:52.925572 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="867.251µs"
I0214 03:16:53.065164 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="72.218µs"
I0214 03:16:53.091809 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="258.511µs"
I0214 03:16:53.097301 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="92.702µs"
I0214 03:16:58.067076 1 topologycache.go:237] "Can't get CPU or zone information for node" node="ha-447944-m04"
E0214 03:16:58.140686 1 garbagecollector.go:392] error syncing item &garbagecollector.node{identity:garbagecollector.objectReference{OwnerReference:v1.OwnerReference{APIVersion:"storage.k8s.io/v1", Kind:"CSINode", Name:"ha-447944-m03", UID:"83e1e22d-2e47-4ab1-80e9-4af843e9315a", Controller:(*bool)(nil), BlockOwnerDeletion:(*bool)(nil)}, Namespace:""}, dependentsLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:atomic.Int32{_:atomic.noCopy{}, v:1}, readerWait:atomic.Int32{_:atomic.noCopy{}, v:0}}, dependents:map[*garbagecollector.node]struct {}{}, deletingDependents:false, deletingDependentsLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:atomic.Int32{_:atomic.noCopy{}, v:0}, readerWait:atomic.Int32{_:atomic.noCopy{}, v:0}}, beingDeleted:false, beingDeletedLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:atomic.Int32{_:atomic.noCopy{}, v:0}, readerWait:atomic.Int32{_
:atomic.noCopy{}, v:0}}, virtual:false, virtualLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:atomic.Int32{_:atomic.noCopy{}, v:0}, readerWait:atomic.Int32{_:atomic.noCopy{}, v:0}}, owners:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"v1", Kind:"Node", Name:"ha-447944-m03", UID:"f655b029-cd64-4889-b0a0-58198a6a99c6", Controller:(*bool)(nil), BlockOwnerDeletion:(*bool)(nil)}}}: csinodes.storage.k8s.io "ha-447944-m03" not found
I0214 03:17:01.939944 1 event.go:307] "Event occurred" object="ha-447944-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RemovingNode" message="Node ha-447944-m03 event: Removing Node ha-447944-m03 from Controller"
E0214 03:17:16.562170 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
E0214 03:17:16.562308 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
E0214 03:17:16.562342 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
E0214 03:17:16.562425 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
E0214 03:17:16.562458 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
I0214 03:17:31.965233 1 event.go:307] "Event occurred" object="ha-447944-m04" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node ha-447944-m04 status is now: NodeNotReady"
I0214 03:17:31.994482 1 event.go:307] "Event occurred" object="kube-system/kindnet-ldndh" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:17:32.020068 1 event.go:307] "Event occurred" object="kube-system/kube-proxy-jrhq2" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:17:32.053246 1 event.go:307] "Event occurred" object="default/busybox-5b5d89c9d6-zr77k" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:17:32.068390 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="19.494478ms"
I0214 03:17:32.068576 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="59.817µs"
E0214 03:17:36.563695 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
E0214 03:17:36.563819 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
E0214 03:17:36.563828 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
E0214 03:17:36.563847 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
E0214 03:17:36.563856 1 gc_controller.go:153] "Failed to get node" err="node \"ha-447944-m03\" not found" node="ha-447944-m03"
==> kube-controller-manager [e84f8f9869e559f927bf9b47fb5e1f6ddc0ced4802acfea5f4345fce48235e37] <==
I0214 03:14:24.824567 1 serving.go:348] Generated self-signed cert in-memory
I0214 03:14:25.723033 1 controllermanager.go:189] "Starting" version="v1.28.4"
I0214 03:14:25.723080 1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:14:25.725403 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I0214 03:14:25.725667 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I0214 03:14:25.726923 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0214 03:14:25.727027 1 secure_serving.go:213] Serving securely on 127.0.0.1:10257
E0214 03:14:45.740590 1 controllermanager.go:235] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.39.41:8443/healthz\": dial tcp 192.168.39.41:8443: connect: connection refused"
==> kube-proxy [776fb551af35073ebd7b153053f33dc602169fd4a6841d3d3858c7306cd9d9f3] <==
I0214 03:14:27.105697 1 server_others.go:69] "Using iptables proxy"
E0214 03:14:27.964610 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:14:31.036327 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:14:34.108296 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:14:40.252013 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:14:52.540111 1 node.go:130] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8443/api/v1/nodes/ha-447944": dial tcp 192.168.39.254:8443: connect: no route to host
I0214 03:15:10.617512 1 node.go:141] Successfully retrieved node IP: 192.168.39.41
I0214 03:15:10.669260 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 03:15:10.669339 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 03:15:10.672269 1 server_others.go:152] "Using iptables Proxier"
I0214 03:15:10.672396 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 03:15:10.673057 1 server.go:846] "Version info" version="v1.28.4"
I0214 03:15:10.673103 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:15:10.674392 1 config.go:188] "Starting service config controller"
I0214 03:15:10.674464 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 03:15:10.674518 1 config.go:97] "Starting endpoint slice config controller"
I0214 03:15:10.674535 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 03:15:10.675522 1 config.go:315] "Starting node config controller"
I0214 03:15:10.675561 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 03:15:10.775462 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 03:15:10.775487 1 shared_informer.go:318] Caches are synced for service config
I0214 03:15:10.775645 1 shared_informer.go:318] Caches are synced for node config
==> kube-proxy [9d1286d601bdee58a819f43d8b4b1a34fd6c155e2b1e361182d6fd255845ed62] <==
E0214 03:11:08.220293 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:15.387465 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:15.387612 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:15.387698 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:15.387635 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:15.387493 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:15.387877 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:26.715653 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:26.716014 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:26.715942 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:26.716050 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:29.789186 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:29.789473 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:48.220012 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:48.220190 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:51.292613 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:51.292764 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:11:51.293061 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:11:51.293132 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:12:22.014058 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:12:22.164902 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-447944&resourceVersion=1825": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:12:28.156126 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:12:28.156214 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1806": dial tcp 192.168.39.254:8443: connect: no route to host
W0214 03:12:34.300027 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
E0214 03:12:34.300137 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=1803": dial tcp 192.168.39.254:8443: connect: no route to host
==> kube-scheduler [322a42a79321ef2916cc21b2add102883bf1be7609bef1feaf8828d9bffc61b2] <==
E0214 03:12:30.767585 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 03:12:30.776974 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:12:30.777063 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 03:12:30.808476 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0214 03:12:30.808599 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
W0214 03:12:30.916613 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:12:30.916763 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 03:12:30.930628 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:12:30.930785 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:12:31.045685 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 03:12:31.045803 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0214 03:12:31.183093 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 03:12:31.183193 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
W0214 03:12:31.241112 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 03:12:31.241223 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0214 03:12:31.441437 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:12:31.441669 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0214 03:12:31.649086 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 03:12:31.649180 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0214 03:12:32.578469 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 03:12:32.578586 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
I0214 03:12:35.030428 1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259
I0214 03:12:35.030522 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
I0214 03:12:35.030914 1 configmap_cafile_content.go:223] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
E0214 03:12:35.031016 1 run.go:74] "command failed" err="finished without leader elect"
==> kube-scheduler [35ec096957d690caff0a43de1bbd2661266150d567673654139d2edee0806a06] <==
W0214 03:14:55.064656 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: Get "https://192.168.39.41:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:14:55.064804 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.39.41:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:14:59.018263 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://192.168.39.41:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:14:59.018348 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.41:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:14:59.984677 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.41:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:14:59.984877 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.41:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:15:01.020231 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: Get "https://192.168.39.41:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:15:01.020355 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.41:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:15:01.702634 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: Get "https://192.168.39.41:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:15:01.703008 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get "https://192.168.39.41:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:15:01.808478 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: Get "https://192.168.39.41:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
E0214 03:15:01.808609 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: Get "https://192.168.39.41:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.41:8443: connect: connection refused
W0214 03:15:04.169118 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:15:04.172192 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0214 03:15:04.172354 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 03:15:04.172389 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 03:15:04.172449 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 03:15:04.172479 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 03:15:04.172564 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:15:04.172627 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:15:04.172845 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:15:04.176920 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 03:15:04.177213 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 03:15:04.177261 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
I0214 03:15:24.539819 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 03:02:18 UTC, ends at Wed 2024-02-14 03:19:21 UTC. --
Feb 14 03:15:18 ha-447944 kubelet[1420]: I0214 03:15:18.343001 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
Feb 14 03:15:18 ha-447944 kubelet[1420]: E0214 03:15:18.343463 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7da2937f-2d9b-40d4-a521-5bf4a2585de7)\"" pod="kube-system/storage-provisioner" podUID="7da2937f-2d9b-40d4-a521-5bf4a2585de7"
Feb 14 03:15:30 ha-447944 kubelet[1420]: I0214 03:15:30.343542 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
Feb 14 03:15:30 ha-447944 kubelet[1420]: E0214 03:15:30.344131 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7da2937f-2d9b-40d4-a521-5bf4a2585de7)\"" pod="kube-system/storage-provisioner" podUID="7da2937f-2d9b-40d4-a521-5bf4a2585de7"
Feb 14 03:15:30 ha-447944 kubelet[1420]: I0214 03:15:30.344189 1420 scope.go:117] "RemoveContainer" containerID="bcb97d264d1f1504d56e17b1c202ceae5113741ad49887d23fc0057b7cc4099b"
Feb 14 03:15:45 ha-447944 kubelet[1420]: I0214 03:15:45.342920 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
Feb 14 03:15:45 ha-447944 kubelet[1420]: E0214 03:15:45.343179 1420 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(7da2937f-2d9b-40d4-a521-5bf4a2585de7)\"" pod="kube-system/storage-provisioner" podUID="7da2937f-2d9b-40d4-a521-5bf4a2585de7"
Feb 14 03:15:53 ha-447944 kubelet[1420]: E0214 03:15:53.431051 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:15:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:15:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:15:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:15:58 ha-447944 kubelet[1420]: I0214 03:15:58.343465 1420 scope.go:117] "RemoveContainer" containerID="98210e700c7fa205df4e1996b5465edb95dab38a596ab6bd2cf8743c6457aca8"
Feb 14 03:16:53 ha-447944 kubelet[1420]: E0214 03:16:53.426449 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:16:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:16:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:16:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:17:53 ha-447944 kubelet[1420]: E0214 03:17:53.437612 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:17:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:17:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:17:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:17:53 ha-447944 kubelet[1420]: E0214 03:17:53.441675 1420 container_manager_linux.go:514] "Failed to find cgroups of kubelet" err="cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service"
Feb 14 03:18:53 ha-447944 kubelet[1420]: E0214 03:18:53.434156 1420 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:18:53 ha-447944 kubelet[1420]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:18:53 ha-447944 kubelet[1420]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:18:53 ha-447944 kubelet[1420]: > table="nat" chain="KUBE-KUBELET-CANARY"
-- /stdout --
** stderr **
E0214 03:19:19.776613 1511857 logs.go:258] failed to output last start logs: failed to read file /home/jenkins/minikube-integration/17909-1487441/.minikube/logs/lastStart.txt: bufio.Scanner: token too long
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-447944 -n ha-447944
helpers_test.go:261: (dbg) Run: kubectl --context ha-447944 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestHA/serial/StopCluster FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestHA/serial/StopCluster (141.99s)
=== RUN TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:207: (dbg) Run: kubectl --context ingress-addon-legacy-791930 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:207: (dbg) Done: kubectl --context ingress-addon-legacy-791930 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (8.499704648s)
addons_test.go:232: (dbg) Run: kubectl --context ingress-addon-legacy-791930 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:245: (dbg) Run: kubectl --context ingress-addon-legacy-791930 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [4168ab41-56cf-45ea-aabc-86a9e34d65e3] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [4168ab41-56cf-45ea-aabc-86a9e34d65e3] Running
addons_test.go:250: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 10.004320278s
addons_test.go:262: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
E0214 03:30:56.222636 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:31:13.611131 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
addons_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m9.591065361s)
** stderr **
ssh: Process exited with status 28
** /stderr **
addons_test.go:278: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:286: (dbg) Run: kubectl --context ingress-addon-legacy-791930 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:291: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 ip
addons_test.go:297: (dbg) Run: nslookup hello-john.test 192.168.39.215
addons_test.go:306: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:306: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 addons disable ingress-dns --alsologtostderr -v=1: (3.536895189s)
addons_test.go:311: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 addons disable ingress --alsologtostderr -v=1
addons_test.go:311: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 addons disable ingress --alsologtostderr -v=1: (7.534657638s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p ingress-addon-legacy-791930 -n ingress-addon-legacy-791930
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 logs -n 25: (1.117935424s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
| ssh | ha-447944 ssh -n ha-447944 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m02:/home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m02 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt | | | | | |
| cp | ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m03:/home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| ssh | ha-447944 ssh -n | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | ha-447944-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-447944 ssh -n ha-447944-m03 sudo cat | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | 14 Feb 24 03:07 UTC |
| | /home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt | | | | | |
| node | ha-447944 node stop m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:07 UTC | |
| | --alsologtostderr | | | | | |
| node | ha-447944 node start m02 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:09 UTC | |
| | --alsologtostderr | | | | | |
| node | list -p ha-447944 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:10 UTC | |
| | --alsologtostderr | | | | | |
| stop | -p ha-447944 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:10 UTC | |
| | --alsologtostderr | | | | | |
| start | -p ha-447944 --wait=true -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:12 UTC | 14 Feb 24 03:16 UTC |
| | --alsologtostderr | | | | | |
| node | list -p ha-447944 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:16 UTC | |
| node | ha-447944 node delete m03 -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:16 UTC | 14 Feb 24 03:16 UTC |
| | --alsologtostderr | | | | | |
| stop | ha-447944 stop -v=7 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:17 UTC | |
| | --alsologtostderr | | | | | |
| start | -p ha-447944 --wait=true | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:19 UTC | 14 Feb 24 03:27 UTC |
| | -v=7 --alsologtostderr | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| node | add -p ha-447944 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:27 UTC | 14 Feb 24 03:28 UTC |
| | --control-plane -v=7 | | | | | |
| | --alsologtostderr | | | | | |
| delete | -p ha-447944 | ha-447944 | jenkins | v1.32.0 | 14 Feb 24 03:28 UTC | 14 Feb 24 03:28 UTC |
| start | -p ingress-addon-legacy-791930 | ingress-addon-legacy-791930 | jenkins | v1.32.0 | 14 Feb 24 03:28 UTC | 14 Feb 24 03:29 UTC |
| | --kubernetes-version=v1.18.20 | | | | | |
| | --memory=4096 --wait=true | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| addons | ingress-addon-legacy-791930 | ingress-addon-legacy-791930 | jenkins | v1.32.0 | 14 Feb 24 03:29 UTC | 14 Feb 24 03:29 UTC |
| | addons enable ingress | | | | | |
| | --alsologtostderr -v=5 | | | | | |
| addons | ingress-addon-legacy-791930 | ingress-addon-legacy-791930 | jenkins | v1.32.0 | 14 Feb 24 03:29 UTC | 14 Feb 24 03:29 UTC |
| | addons enable ingress-dns | | | | | |
| | --alsologtostderr -v=5 | | | | | |
| ssh | ingress-addon-legacy-791930 | ingress-addon-legacy-791930 | jenkins | v1.32.0 | 14 Feb 24 03:30 UTC | |
| | ssh curl -s http://127.0.0.1/ | | | | | |
| | -H 'Host: nginx.example.com' | | | | | |
| ip | ingress-addon-legacy-791930 ip | ingress-addon-legacy-791930 | jenkins | v1.32.0 | 14 Feb 24 03:32 UTC | 14 Feb 24 03:32 UTC |
| addons | ingress-addon-legacy-791930 | ingress-addon-legacy-791930 | jenkins | v1.32.0 | 14 Feb 24 03:32 UTC | 14 Feb 24 03:32 UTC |
| | addons disable ingress-dns | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | ingress-addon-legacy-791930 | ingress-addon-legacy-791930 | jenkins | v1.32.0 | 14 Feb 24 03:32 UTC | 14 Feb 24 03:32 UTC |
| | addons disable ingress | | | | | |
| | --alsologtostderr -v=1 | | | | | |
|---------|--------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 03:28:29
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 03:28:29.837694 1514375 out.go:291] Setting OutFile to fd 1 ...
I0214 03:28:29.837959 1514375 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:28:29.837968 1514375 out.go:304] Setting ErrFile to fd 2...
I0214 03:28:29.837973 1514375 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:28:29.838184 1514375 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:28:29.838812 1514375 out.go:298] Setting JSON to false
I0214 03:28:29.839761 1514375 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":22257,"bootTime":1707859053,"procs":195,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:28:29.839832 1514375 start.go:138] virtualization: kvm guest
I0214 03:28:29.842164 1514375 out.go:177] * [ingress-addon-legacy-791930] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 03:28:29.843575 1514375 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:28:29.844726 1514375 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:28:29.843605 1514375 notify.go:220] Checking for updates...
I0214 03:28:29.845878 1514375 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:28:29.847129 1514375 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:28:29.848396 1514375 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:28:29.849713 1514375 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:28:29.850971 1514375 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:28:29.885504 1514375 out.go:177] * Using the kvm2 driver based on user configuration
I0214 03:28:29.886810 1514375 start.go:296] selected driver: kvm2
I0214 03:28:29.886824 1514375 start.go:900] validating driver "kvm2" against <nil>
I0214 03:28:29.886834 1514375 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:28:29.887568 1514375 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:28:29.887653 1514375 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 03:28:29.901897 1514375 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 03:28:29.901959 1514375 start_flags.go:308] no existing cluster config was found, will generate one from the flags
I0214 03:28:29.902147 1514375 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:28:29.902208 1514375 cni.go:84] Creating CNI manager for ""
I0214 03:28:29.902223 1514375 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 03:28:29.902230 1514375 start_flags.go:317] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0214 03:28:29.902293 1514375 start.go:339] cluster config:
{Name:ingress-addon-legacy-791930 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4096 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-791930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clu
ster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath
: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:28:29.902382 1514375 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:28:29.904009 1514375 out.go:177] * Starting "ingress-addon-legacy-791930" primary control-plane node in "ingress-addon-legacy-791930" cluster
I0214 03:28:29.905316 1514375 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime crio
I0214 03:28:29.931550 1514375 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4
I0214 03:28:29.931575 1514375 cache.go:56] Caching tarball of preloaded images
I0214 03:28:29.931714 1514375 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime crio
I0214 03:28:29.933308 1514375 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
I0214 03:28:29.934463 1514375 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 ...
I0214 03:28:29.971447 1514375 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4?checksum=md5:0d02e096853189c5b37812b400898e14 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4
I0214 03:28:35.511183 1514375 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 ...
I0214 03:28:35.511319 1514375 preload.go:255] verifying checksum of /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 ...
I0214 03:28:36.521735 1514375 cache.go:59] Finished verifying existence of preloaded tar for v1.18.20 on crio
I0214 03:28:36.522118 1514375 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/config.json ...
I0214 03:28:36.522153 1514375 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/config.json: {Name:mk524d62232c8ad9b0de93a6803a099b90d3a0af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:28:36.522318 1514375 start.go:360] acquireMachinesLock for ingress-addon-legacy-791930: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:28:36.522357 1514375 start.go:364] duration metric: took 15.833µs to acquireMachinesLock for "ingress-addon-legacy-791930"
I0214 03:28:36.522374 1514375 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-791930 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4096 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-791930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:28:36.522432 1514375 start.go:125] createHost starting for "" (driver="kvm2")
I0214 03:28:36.524612 1514375 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
I0214 03:28:36.524767 1514375 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:28:36.524803 1514375 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:28:36.539515 1514375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43243
I0214 03:28:36.539936 1514375 main.go:141] libmachine: () Calling .GetVersion
I0214 03:28:36.540598 1514375 main.go:141] libmachine: Using API Version 1
I0214 03:28:36.540629 1514375 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:28:36.540969 1514375 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:28:36.541153 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetMachineName
I0214 03:28:36.541298 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:28:36.541444 1514375 start.go:159] libmachine.API.Create for "ingress-addon-legacy-791930" (driver="kvm2")
I0214 03:28:36.541470 1514375 client.go:168] LocalClient.Create starting
I0214 03:28:36.541495 1514375 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 03:28:36.541523 1514375 main.go:141] libmachine: Decoding PEM data...
I0214 03:28:36.541539 1514375 main.go:141] libmachine: Parsing certificate...
I0214 03:28:36.541593 1514375 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 03:28:36.541611 1514375 main.go:141] libmachine: Decoding PEM data...
I0214 03:28:36.541623 1514375 main.go:141] libmachine: Parsing certificate...
I0214 03:28:36.541639 1514375 main.go:141] libmachine: Running pre-create checks...
I0214 03:28:36.541648 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .PreCreateCheck
I0214 03:28:36.541945 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetConfigRaw
I0214 03:28:36.542281 1514375 main.go:141] libmachine: Creating machine...
I0214 03:28:36.542295 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .Create
I0214 03:28:36.542442 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Creating KVM machine...
I0214 03:28:36.543793 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found existing default KVM network
I0214 03:28:36.544528 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:36.544387 1514411 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015a20}
I0214 03:28:36.544556 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | created network xml:
I0214 03:28:36.544567 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | <network>
I0214 03:28:36.544581 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | <name>mk-ingress-addon-legacy-791930</name>
I0214 03:28:36.544601 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | <dns enable='no'/>
I0214 03:28:36.544613 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG |
I0214 03:28:36.544634 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0214 03:28:36.544649 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | <dhcp>
I0214 03:28:36.544664 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0214 03:28:36.544678 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | </dhcp>
I0214 03:28:36.544695 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | </ip>
I0214 03:28:36.544722 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG |
I0214 03:28:36.544742 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | </network>
I0214 03:28:36.544803 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG |
I0214 03:28:36.549955 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | trying to create private KVM network mk-ingress-addon-legacy-791930 192.168.39.0/24...
I0214 03:28:36.619659 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | private KVM network mk-ingress-addon-legacy-791930 192.168.39.0/24 created
I0214 03:28:36.619701 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:36.619596 1514411 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:28:36.619719 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930 ...
I0214 03:28:36.619743 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 03:28:36.619761 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 03:28:36.849301 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:36.849150 1514411 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa...
I0214 03:28:37.150155 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:37.149975 1514411 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/ingress-addon-legacy-791930.rawdisk...
I0214 03:28:37.150191 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Writing magic tar header
I0214 03:28:37.150212 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Writing SSH key tar header
I0214 03:28:37.150222 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930 (perms=drwx------)
I0214 03:28:37.150232 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:37.150098 1514411 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930 ...
I0214 03:28:37.150245 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930
I0214 03:28:37.150256 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 03:28:37.150266 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 03:28:37.150277 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 03:28:37.150286 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 03:28:37.150300 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:28:37.150315 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 03:28:37.150324 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 03:28:37.150331 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 03:28:37.150340 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Checking permissions on dir: /home/jenkins
I0214 03:28:37.150348 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Checking permissions on dir: /home
I0214 03:28:37.150357 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Skipping /home - not owner
I0214 03:28:37.150377 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 03:28:37.150383 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Creating domain...
I0214 03:28:37.151617 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) define libvirt domain using xml:
I0214 03:28:37.151646 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <domain type='kvm'>
I0214 03:28:37.151697 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <name>ingress-addon-legacy-791930</name>
I0214 03:28:37.151727 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <memory unit='MiB'>4096</memory>
I0214 03:28:37.151738 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <vcpu>2</vcpu>
I0214 03:28:37.151751 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <features>
I0214 03:28:37.151762 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <acpi/>
I0214 03:28:37.151779 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <apic/>
I0214 03:28:37.151819 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <pae/>
I0214 03:28:37.151844 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930)
I0214 03:28:37.151869 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </features>
I0214 03:28:37.151884 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <cpu mode='host-passthrough'>
I0214 03:28:37.151895 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930)
I0214 03:28:37.151905 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </cpu>
I0214 03:28:37.151924 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <os>
I0214 03:28:37.151937 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <type>hvm</type>
I0214 03:28:37.151947 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <boot dev='cdrom'/>
I0214 03:28:37.151959 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <boot dev='hd'/>
I0214 03:28:37.151969 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <bootmenu enable='no'/>
I0214 03:28:37.151976 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </os>
I0214 03:28:37.151990 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <devices>
I0214 03:28:37.152006 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <disk type='file' device='cdrom'>
I0214 03:28:37.152035 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/boot2docker.iso'/>
I0214 03:28:37.152056 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <target dev='hdc' bus='scsi'/>
I0214 03:28:37.152073 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <readonly/>
I0214 03:28:37.152092 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </disk>
I0214 03:28:37.152108 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <disk type='file' device='disk'>
I0214 03:28:37.152124 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 03:28:37.152145 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/ingress-addon-legacy-791930.rawdisk'/>
I0214 03:28:37.152170 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <target dev='hda' bus='virtio'/>
I0214 03:28:37.152185 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </disk>
I0214 03:28:37.152199 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <interface type='network'>
I0214 03:28:37.152215 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <source network='mk-ingress-addon-legacy-791930'/>
I0214 03:28:37.152229 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <model type='virtio'/>
I0214 03:28:37.152251 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </interface>
I0214 03:28:37.152267 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <interface type='network'>
I0214 03:28:37.152282 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <source network='default'/>
I0214 03:28:37.152296 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <model type='virtio'/>
I0214 03:28:37.152309 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </interface>
I0214 03:28:37.152323 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <serial type='pty'>
I0214 03:28:37.152338 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <target port='0'/>
I0214 03:28:37.152351 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </serial>
I0214 03:28:37.152366 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <console type='pty'>
I0214 03:28:37.152380 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <target type='serial' port='0'/>
I0214 03:28:37.152401 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </console>
I0214 03:28:37.152420 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <rng model='virtio'>
I0214 03:28:37.152436 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) <backend model='random'>/dev/random</backend>
I0214 03:28:37.152451 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </rng>
I0214 03:28:37.152473 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930)
I0214 03:28:37.152484 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930)
I0214 03:28:37.152490 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </devices>
I0214 03:28:37.152501 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) </domain>
I0214 03:28:37.152514 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930)
I0214 03:28:37.156428 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:de:9b:69 in network default
I0214 03:28:37.157006 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Ensuring networks are active...
I0214 03:28:37.157030 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:37.157684 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Ensuring network default is active
I0214 03:28:37.157975 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Ensuring network mk-ingress-addon-legacy-791930 is active
I0214 03:28:37.158496 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Getting domain xml...
I0214 03:28:37.159347 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Creating domain...
I0214 03:28:38.330592 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Waiting to get IP...
I0214 03:28:38.331291 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:38.331848 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:38.331873 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:38.331821 1514411 retry.go:31] will retry after 282.908891ms: waiting for machine to come up
I0214 03:28:38.616427 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:38.616841 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:38.616886 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:38.616803 1514411 retry.go:31] will retry after 363.700892ms: waiting for machine to come up
I0214 03:28:38.982421 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:38.982912 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:38.982948 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:38.982869 1514411 retry.go:31] will retry after 362.408087ms: waiting for machine to come up
I0214 03:28:39.347455 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:39.347918 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:39.347945 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:39.347877 1514411 retry.go:31] will retry after 513.328692ms: waiting for machine to come up
I0214 03:28:39.862386 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:39.862844 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:39.862979 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:39.862787 1514411 retry.go:31] will retry after 463.351518ms: waiting for machine to come up
I0214 03:28:40.327708 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:40.328122 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:40.328146 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:40.328072 1514411 retry.go:31] will retry after 689.443269ms: waiting for machine to come up
I0214 03:28:41.018913 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:41.019288 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:41.019323 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:41.019235 1514411 retry.go:31] will retry after 727.76211ms: waiting for machine to come up
I0214 03:28:41.748492 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:41.748961 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:41.748995 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:41.748911 1514411 retry.go:31] will retry after 1.338618375s: waiting for machine to come up
I0214 03:28:43.089527 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:43.089991 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:43.090020 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:43.089937 1514411 retry.go:31] will retry after 1.615801489s: waiting for machine to come up
I0214 03:28:44.707701 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:44.708155 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:44.708188 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:44.708083 1514411 retry.go:31] will retry after 1.605525123s: waiting for machine to come up
I0214 03:28:46.314904 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:46.315341 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:46.315372 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:46.315278 1514411 retry.go:31] will retry after 2.898448455s: waiting for machine to come up
I0214 03:28:49.217396 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:49.217758 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:49.217790 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:49.217721 1514411 retry.go:31] will retry after 2.915757764s: waiting for machine to come up
I0214 03:28:52.134581 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:52.135001 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:52.135031 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:52.134937 1514411 retry.go:31] will retry after 3.71218858s: waiting for machine to come up
I0214 03:28:55.851839 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:28:55.852365 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find current IP address of domain ingress-addon-legacy-791930 in network mk-ingress-addon-legacy-791930
I0214 03:28:55.852398 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | I0214 03:28:55.852246 1514411 retry.go:31] will retry after 5.601668951s: waiting for machine to come up
I0214 03:29:01.459246 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.459681 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Found IP for machine: 192.168.39.215
I0214 03:29:01.459701 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has current primary IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.459708 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Reserving static IP address...
I0214 03:29:01.460069 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | unable to find host DHCP lease matching {name: "ingress-addon-legacy-791930", mac: "52:54:00:03:03:1f", ip: "192.168.39.215"} in network mk-ingress-addon-legacy-791930
I0214 03:29:01.532071 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Getting to WaitForSSH function...
I0214 03:29:01.532117 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Reserved static IP address: 192.168.39.215
I0214 03:29:01.532133 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Waiting for SSH to be available...
I0214 03:29:01.534631 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.535008 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:minikube Clientid:01:52:54:00:03:03:1f}
I0214 03:29:01.535037 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.535226 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Using SSH client type: external
I0214 03:29:01.535257 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa (-rw-------)
I0214 03:29:01.535314 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.215 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 03:29:01.535335 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | About to run SSH command:
I0214 03:29:01.535376 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | exit 0
I0214 03:29:01.625223 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | SSH cmd err, output: <nil>:
I0214 03:29:01.625527 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) KVM machine creation complete!
I0214 03:29:01.625829 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetConfigRaw
I0214 03:29:01.626482 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:01.626689 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:01.626875 1514375 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 03:29:01.626890 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetState
I0214 03:29:01.628238 1514375 main.go:141] libmachine: Detecting operating system of created instance...
I0214 03:29:01.628256 1514375 main.go:141] libmachine: Waiting for SSH to be available...
I0214 03:29:01.628263 1514375 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 03:29:01.628271 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:01.630646 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.631061 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:01.631134 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.631187 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:01.631374 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:01.631526 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:01.631706 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:01.631841 1514375 main.go:141] libmachine: Using SSH client type: native
I0214 03:29:01.632206 1514375 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I0214 03:29:01.632221 1514375 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 03:29:01.748276 1514375 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:29:01.748310 1514375 main.go:141] libmachine: Detecting the provisioner...
I0214 03:29:01.748325 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:01.751113 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.751612 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:01.751641 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.751755 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:01.751988 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:01.752214 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:01.752354 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:01.752537 1514375 main.go:141] libmachine: Using SSH client type: native
I0214 03:29:01.752929 1514375 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I0214 03:29:01.752946 1514375 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 03:29:01.870051 1514375 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:29:01.870138 1514375 main.go:141] libmachine: found compatible host: buildroot
I0214 03:29:01.870154 1514375 main.go:141] libmachine: Provisioning with buildroot...
I0214 03:29:01.870172 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetMachineName
I0214 03:29:01.870529 1514375 buildroot.go:166] provisioning hostname "ingress-addon-legacy-791930"
I0214 03:29:01.870559 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetMachineName
I0214 03:29:01.870772 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:01.873014 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.873392 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:01.873423 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:01.873629 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:01.873837 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:01.874006 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:01.874140 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:01.874289 1514375 main.go:141] libmachine: Using SSH client type: native
I0214 03:29:01.874608 1514375 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I0214 03:29:01.874623 1514375 main.go:141] libmachine: About to run SSH command:
sudo hostname ingress-addon-legacy-791930 && echo "ingress-addon-legacy-791930" | sudo tee /etc/hostname
I0214 03:29:02.002875 1514375 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-791930
I0214 03:29:02.002923 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:02.005727 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.006103 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.006140 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.006356 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:02.006582 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.006781 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.006918 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:02.007067 1514375 main.go:141] libmachine: Using SSH client type: native
I0214 03:29:02.007396 1514375 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I0214 03:29:02.007423 1514375 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\singress-addon-legacy-791930' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-791930/g' /etc/hosts;
else
echo '127.0.1.1 ingress-addon-legacy-791930' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:29:02.129454 1514375 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:29:02.129490 1514375 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:29:02.129547 1514375 buildroot.go:174] setting up certificates
I0214 03:29:02.129562 1514375 provision.go:84] configureAuth start
I0214 03:29:02.129582 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetMachineName
I0214 03:29:02.129880 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetIP
I0214 03:29:02.132678 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.133054 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.133078 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.133241 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:02.135357 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.135710 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.135749 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.135887 1514375 provision.go:143] copyHostCerts
I0214 03:29:02.135916 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:29:02.135959 1514375 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:29:02.135977 1514375 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:29:02.136044 1514375 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:29:02.136131 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:29:02.136148 1514375 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:29:02.136154 1514375 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:29:02.136178 1514375 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:29:02.136224 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:29:02.136240 1514375 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:29:02.136243 1514375 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:29:02.136264 1514375 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:29:02.136309 1514375 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-791930 san=[127.0.0.1 192.168.39.215 ingress-addon-legacy-791930 localhost minikube]
I0214 03:29:02.180795 1514375 provision.go:177] copyRemoteCerts
I0214 03:29:02.180856 1514375 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:29:02.180879 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:02.183044 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.183393 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.183432 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.183595 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:02.183764 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.183944 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:02.184087 1514375 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa Username:docker}
I0214 03:29:02.270068 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:29:02.270156 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:29:02.292344 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:29:02.292413 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0214 03:29:02.313540 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:29:02.313603 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 03:29:02.334538 1514375 provision.go:87] duration metric: took 204.96181ms to configureAuth
I0214 03:29:02.334559 1514375 buildroot.go:189] setting minikube options for container-runtime
I0214 03:29:02.334765 1514375 config.go:182] Loaded profile config "ingress-addon-legacy-791930": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.18.20
I0214 03:29:02.334870 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:02.337799 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.338175 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.338209 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.338380 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:02.338596 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.338747 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.338950 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:02.339135 1514375 main.go:141] libmachine: Using SSH client type: native
I0214 03:29:02.339576 1514375 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I0214 03:29:02.339599 1514375 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:29:02.634573 1514375 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:29:02.634600 1514375 main.go:141] libmachine: Checking connection to Docker...
I0214 03:29:02.634609 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetURL
I0214 03:29:02.635988 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Using libvirt version 6000000
I0214 03:29:02.638332 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.638747 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.638784 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.638917 1514375 main.go:141] libmachine: Docker is up and running!
I0214 03:29:02.638941 1514375 main.go:141] libmachine: Reticulating splines...
I0214 03:29:02.638951 1514375 client.go:171] duration metric: took 26.097472208s to LocalClient.Create
I0214 03:29:02.638977 1514375 start.go:167] duration metric: took 26.097537239s to libmachine.API.Create "ingress-addon-legacy-791930"
I0214 03:29:02.638989 1514375 start.go:293] postStartSetup for "ingress-addon-legacy-791930" (driver="kvm2")
I0214 03:29:02.639006 1514375 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:29:02.639025 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:02.639265 1514375 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:29:02.639291 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:02.641388 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.641763 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.641793 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.641884 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:02.642081 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.642235 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:02.642366 1514375 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa Username:docker}
I0214 03:29:02.729860 1514375 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:29:02.733829 1514375 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:29:02.733859 1514375 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:29:02.733957 1514375 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:29:02.734073 1514375 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:29:02.734088 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:29:02.734180 1514375 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:29:02.742128 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:29:02.764146 1514375 start.go:296] duration metric: took 125.138984ms for postStartSetup
I0214 03:29:02.764200 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetConfigRaw
I0214 03:29:02.764762 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetIP
I0214 03:29:02.767293 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.767678 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.767709 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.767951 1514375 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/config.json ...
I0214 03:29:02.768131 1514375 start.go:128] duration metric: took 26.245689292s to createHost
I0214 03:29:02.768154 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:02.770473 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.770773 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.770800 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.770915 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:02.771100 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.771236 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.771368 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:02.771582 1514375 main.go:141] libmachine: Using SSH client type: native
I0214 03:29:02.771884 1514375 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.215 22 <nil> <nil>}
I0214 03:29:02.771895 1514375 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:29:02.885507 1514375 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707881342.857735785
I0214 03:29:02.885533 1514375 fix.go:216] guest clock: 1707881342.857735785
I0214 03:29:02.885544 1514375 fix.go:229] Guest: 2024-02-14 03:29:02.857735785 +0000 UTC Remote: 2024-02-14 03:29:02.768142206 +0000 UTC m=+32.980093211 (delta=89.593579ms)
I0214 03:29:02.885595 1514375 fix.go:200] guest clock delta is within tolerance: 89.593579ms
I0214 03:29:02.885603 1514375 start.go:83] releasing machines lock for "ingress-addon-legacy-791930", held for 26.363235448s
I0214 03:29:02.885633 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:02.885939 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetIP
I0214 03:29:02.888421 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.888797 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.888827 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.888975 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:02.889459 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:02.889634 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:02.889741 1514375 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:29:02.889800 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:02.889898 1514375 ssh_runner.go:195] Run: cat /version.json
I0214 03:29:02.889927 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:02.892538 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.892573 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.892917 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.892956 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:02.892981 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.893044 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:02.893200 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:02.893304 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:02.893418 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.893481 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:02.893570 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:02.893667 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:02.893798 1514375 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa Username:docker}
I0214 03:29:02.893809 1514375 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa Username:docker}
I0214 03:29:02.977751 1514375 ssh_runner.go:195] Run: systemctl --version
I0214 03:29:03.000407 1514375 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:29:03.157660 1514375 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 03:29:03.165074 1514375 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:29:03.165143 1514375 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:29:03.181861 1514375 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 03:29:03.181885 1514375 start.go:494] detecting cgroup driver to use...
I0214 03:29:03.181954 1514375 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:29:03.195407 1514375 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:29:03.208226 1514375 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:29:03.208287 1514375 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:29:03.221812 1514375 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:29:03.235088 1514375 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:29:03.343949 1514375 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:29:03.458795 1514375 docker.go:233] disabling docker service ...
I0214 03:29:03.458869 1514375 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:29:03.472533 1514375 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:29:03.484438 1514375 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:29:03.598984 1514375 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:29:03.713119 1514375 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:29:03.726725 1514375 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:29:03.744719 1514375 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0214 03:29:03.744799 1514375 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:29:03.754006 1514375 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:29:03.754099 1514375 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:29:03.763069 1514375 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:29:03.772292 1514375 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:29:03.781604 1514375 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:29:03.791311 1514375 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:29:03.799403 1514375 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 03:29:03.799477 1514375 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 03:29:03.811714 1514375 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:29:03.819765 1514375 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:29:03.919624 1514375 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:29:04.304748 1514375 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:29:04.304831 1514375 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:29:04.311787 1514375 start.go:562] Will wait 60s for crictl version
I0214 03:29:04.311851 1514375 ssh_runner.go:195] Run: which crictl
I0214 03:29:04.315622 1514375 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:29:04.354991 1514375 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:29:04.355070 1514375 ssh_runner.go:195] Run: crio --version
I0214 03:29:04.396645 1514375 ssh_runner.go:195] Run: crio --version
I0214 03:29:04.444843 1514375 out.go:177] * Preparing Kubernetes v1.18.20 on CRI-O 1.24.1 ...
I0214 03:29:04.446193 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetIP
I0214 03:29:04.448772 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:04.449128 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:04.449157 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:04.449380 1514375 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:29:04.453343 1514375 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:29:04.465293 1514375 kubeadm.go:877] updating cluster {Name:ingress-addon-legacy-791930 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4096 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernetes
Version:v1.18.20 ClusterName:ingress-addon-legacy-791930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.215 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Moun
tOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 03:29:04.465398 1514375 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime crio
I0214 03:29:04.465445 1514375 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:29:04.501188 1514375 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.18.20". assuming images are not preloaded.
I0214 03:29:04.501290 1514375 ssh_runner.go:195] Run: which lz4
I0214 03:29:04.505313 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4
I0214 03:29:04.505446 1514375 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 03:29:04.509579 1514375 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 03:29:04.509616 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (495439307 bytes)
I0214 03:29:06.328108 1514375 crio.go:444] duration metric: took 1.822717369s to copy over tarball
I0214 03:29:06.328178 1514375 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 03:29:09.274309 1514375 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.946091377s)
I0214 03:29:09.274342 1514375 crio.go:451] duration metric: took 2.946205033s to extract the tarball
I0214 03:29:09.274353 1514375 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 03:29:09.317428 1514375 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:29:09.370236 1514375 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.18.20". assuming images are not preloaded.
I0214 03:29:09.370263 1514375 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 03:29:09.370344 1514375 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 03:29:09.370363 1514375 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
I0214 03:29:09.370384 1514375 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0214 03:29:09.370397 1514375 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
I0214 03:29:09.370435 1514375 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
I0214 03:29:09.370344 1514375 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
I0214 03:29:09.370366 1514375 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
I0214 03:29:09.370493 1514375 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
I0214 03:29:09.371989 1514375 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
I0214 03:29:09.372020 1514375 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
I0214 03:29:09.372057 1514375 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
I0214 03:29:09.371992 1514375 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
I0214 03:29:09.371990 1514375 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0214 03:29:09.372089 1514375 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
I0214 03:29:09.371990 1514375 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
I0214 03:29:09.371992 1514375 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 03:29:09.536380 1514375 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20
I0214 03:29:09.547369 1514375 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20
I0214 03:29:09.557080 1514375 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0
I0214 03:29:09.561277 1514375 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20
I0214 03:29:09.576699 1514375 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0214 03:29:09.597420 1514375 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 03:29:09.607559 1514375 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7
I0214 03:29:09.638675 1514375 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba" in container runtime
I0214 03:29:09.638733 1514375 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.18.20
I0214 03:29:09.638781 1514375 ssh_runner.go:195] Run: which crictl
I0214 03:29:09.654880 1514375 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20
I0214 03:29:09.722317 1514375 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290" in container runtime
I0214 03:29:09.722367 1514375 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f" in container runtime
I0214 03:29:09.722376 1514375 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
I0214 03:29:09.722388 1514375 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346" in container runtime
I0214 03:29:09.722402 1514375 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.3-0
I0214 03:29:09.722406 1514375 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
I0214 03:29:09.722434 1514375 ssh_runner.go:195] Run: which crictl
I0214 03:29:09.722446 1514375 ssh_runner.go:195] Run: which crictl
I0214 03:29:09.722446 1514375 ssh_runner.go:195] Run: which crictl
I0214 03:29:09.737143 1514375 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0214 03:29:09.737193 1514375 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0214 03:29:09.737244 1514375 ssh_runner.go:195] Run: which crictl
I0214 03:29:09.877598 1514375 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5" in container runtime
I0214 03:29:09.877675 1514375 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1" in container runtime
I0214 03:29:09.887980 1514375 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
I0214 03:29:09.888033 1514375 ssh_runner.go:195] Run: which crictl
I0214 03:29:09.888076 1514375 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.7
I0214 03:29:09.877676 1514375 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.18.20
I0214 03:29:09.877718 1514375 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.3-0
I0214 03:29:09.877729 1514375 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.18.20
I0214 03:29:09.877774 1514375 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0214 03:29:09.877797 1514375 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.18.20
I0214 03:29:09.888189 1514375 ssh_runner.go:195] Run: which crictl
I0214 03:29:09.994284 1514375 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.7
I0214 03:29:10.011030 1514375 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.3-0
I0214 03:29:10.011044 1514375 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.18.20
I0214 03:29:10.015001 1514375 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.18.20
I0214 03:29:10.015052 1514375 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.18.20
I0214 03:29:10.015093 1514375 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0214 03:29:10.015101 1514375 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.18.20
I0214 03:29:10.059069 1514375 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.7
I0214 03:29:10.061202 1514375 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.18.20
I0214 03:29:10.061246 1514375 cache_images.go:92] duration metric: took 690.967961ms to LoadCachedImages
W0214 03:29:10.061319 1514375 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.3-0: no such file or directory
I0214 03:29:10.061335 1514375 kubeadm.go:928] updating node { 192.168.39.215 8443 v1.18.20 crio true true} ...
I0214 03:29:10.061488 1514375 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=ingress-addon-legacy-791930 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.215
[Install]
config:
{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-791930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:29:10.061574 1514375 ssh_runner.go:195] Run: crio config
I0214 03:29:10.129649 1514375 cni.go:84] Creating CNI manager for ""
I0214 03:29:10.129674 1514375 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 03:29:10.129684 1514375 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 03:29:10.129725 1514375 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.215 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-791930 NodeName:ingress-addon-legacy-791930 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.215"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.215 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cert
s/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0214 03:29:10.129849 1514375 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.215
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "ingress-addon-legacy-791930"
kubeletExtraArgs:
node-ip: 192.168.39.215
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.215"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.18.20
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 03:29:10.129910 1514375 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
I0214 03:29:10.138604 1514375 binaries.go:44] Found k8s binaries, skipping transfer
I0214 03:29:10.138674 1514375 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 03:29:10.147192 1514375 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (436 bytes)
I0214 03:29:10.162484 1514375 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
I0214 03:29:10.177402 1514375 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2129 bytes)
I0214 03:29:10.194307 1514375 ssh_runner.go:195] Run: grep 192.168.39.215 control-plane.minikube.internal$ /etc/hosts
I0214 03:29:10.197792 1514375 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.215 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 03:29:10.209366 1514375 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:29:10.326761 1514375 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:29:10.341678 1514375 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930 for IP: 192.168.39.215
I0214 03:29:10.341702 1514375 certs.go:194] generating shared ca certs ...
I0214 03:29:10.341728 1514375 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:10.341906 1514375 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:29:10.341963 1514375 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:29:10.341984 1514375 certs.go:256] generating profile certs ...
I0214 03:29:10.342069 1514375 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.key
I0214 03:29:10.342088 1514375 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt with IP's: []
I0214 03:29:10.494438 1514375 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt ...
I0214 03:29:10.494472 1514375 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: {Name:mke11de39b0501463b48f24f2f9754b8cf8bdb4c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:10.494667 1514375 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.key ...
I0214 03:29:10.494688 1514375 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.key: {Name:mkafe07b99ad44cd8330128c97afe501cd6a51ac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:10.494798 1514375 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.key.38b125fb
I0214 03:29:10.494815 1514375 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.crt.38b125fb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.215]
I0214 03:29:10.703532 1514375 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.crt.38b125fb ...
I0214 03:29:10.703569 1514375 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.crt.38b125fb: {Name:mk8aa7188aaa1147a32df8db09310de7a744d206 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:10.703748 1514375 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.key.38b125fb ...
I0214 03:29:10.703763 1514375 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.key.38b125fb: {Name:mk4412fa97907222fb97265a44312db7e2530307 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:10.703844 1514375 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.crt.38b125fb -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.crt
I0214 03:29:10.703919 1514375 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.key.38b125fb -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.key
I0214 03:29:10.703974 1514375 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.key
I0214 03:29:10.703994 1514375 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.crt with IP's: []
I0214 03:29:10.793523 1514375 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.crt ...
I0214 03:29:10.793559 1514375 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.crt: {Name:mk45d2f51059ea02306e54a19b4b4ca3ad340f63 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:10.793731 1514375 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.key ...
I0214 03:29:10.793747 1514375 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.key: {Name:mk639015c63e264f529a856cd67e00385137ff5e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:10.793821 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:29:10.793842 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:29:10.793858 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:29:10.793873 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:29:10.793888 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:29:10.793903 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:29:10.793918 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:29:10.793932 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:29:10.793993 1514375 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:29:10.794032 1514375 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:29:10.794049 1514375 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:29:10.794072 1514375 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:29:10.794102 1514375 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:29:10.794136 1514375 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:29:10.794185 1514375 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:29:10.794217 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:29:10.794233 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:29:10.794247 1514375 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:29:10.794869 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:29:10.818312 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:29:10.840640 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:29:10.862269 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:29:10.883707 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0214 03:29:10.906059 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 03:29:10.927531 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:29:10.948945 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:29:10.970999 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:29:10.991976 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:29:11.013441 1514375 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:29:11.038105 1514375 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 03:29:11.060770 1514375 ssh_runner.go:195] Run: openssl version
I0214 03:29:11.067900 1514375 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:29:11.087175 1514375 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:29:11.092410 1514375 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:29:11.092480 1514375 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:29:11.098782 1514375 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:29:11.109609 1514375 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:29:11.119568 1514375 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:29:11.124034 1514375 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:29:11.124090 1514375 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:29:11.129430 1514375 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:29:11.139371 1514375 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:29:11.149489 1514375 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:29:11.153827 1514375 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:29:11.153887 1514375 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:29:11.159216 1514375 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:29:11.169976 1514375 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:29:11.174287 1514375 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 03:29:11.174357 1514375 kubeadm.go:391] StartCluster: {Name:ingress-addon-legacy-791930 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4096 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer
sion:v1.18.20 ClusterName:ingress-addon-legacy-791930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.215 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOp
tions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:29:11.174459 1514375 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 03:29:11.174499 1514375 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 03:29:11.211225 1514375 cri.go:89] found id: ""
I0214 03:29:11.211309 1514375 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0214 03:29:11.220765 1514375 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 03:29:11.230851 1514375 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 03:29:11.239603 1514375 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 03:29:11.239621 1514375 kubeadm.go:156] found existing configuration files:
I0214 03:29:11.239662 1514375 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 03:29:11.247901 1514375 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 03:29:11.247964 1514375 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 03:29:11.256783 1514375 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 03:29:11.265140 1514375 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 03:29:11.265196 1514375 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 03:29:11.274081 1514375 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 03:29:11.282365 1514375 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 03:29:11.282410 1514375 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 03:29:11.291658 1514375 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 03:29:11.301624 1514375 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 03:29:11.301678 1514375 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 03:29:11.310725 1514375 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0214 03:29:11.372227 1514375 kubeadm.go:309] [init] Using Kubernetes version: v1.18.20
I0214 03:29:11.372296 1514375 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 03:29:11.496849 1514375 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 03:29:11.497029 1514375 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 03:29:11.497176 1514375 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 03:29:11.718904 1514375 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 03:29:11.721900 1514375 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 03:29:11.721959 1514375 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 03:29:11.842767 1514375 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 03:29:11.929691 1514375 out.go:204] - Generating certificates and keys ...
I0214 03:29:11.929831 1514375 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 03:29:11.929961 1514375 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 03:29:12.027002 1514375 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 03:29:12.290693 1514375 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 03:29:12.358933 1514375 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 03:29:12.471714 1514375 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 03:29:12.758314 1514375 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 03:29:12.758527 1514375 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-791930 localhost] and IPs [192.168.39.215 127.0.0.1 ::1]
I0214 03:29:12.996861 1514375 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 03:29:12.997054 1514375 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-791930 localhost] and IPs [192.168.39.215 127.0.0.1 ::1]
I0214 03:29:13.332600 1514375 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 03:29:13.437741 1514375 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 03:29:13.605754 1514375 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 03:29:13.605955 1514375 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 03:29:13.766510 1514375 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 03:29:13.899917 1514375 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 03:29:13.991638 1514375 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 03:29:14.512863 1514375 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 03:29:14.513444 1514375 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 03:29:14.515424 1514375 out.go:204] - Booting up control plane ...
I0214 03:29:14.515527 1514375 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 03:29:14.521609 1514375 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 03:29:14.522642 1514375 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 03:29:14.523433 1514375 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 03:29:14.525622 1514375 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 03:29:23.024047 1514375 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.502724 seconds
I0214 03:29:23.024147 1514375 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 03:29:23.040667 1514375 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 03:29:23.581561 1514375 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 03:29:23.581810 1514375 kubeadm.go:309] [mark-control-plane] Marking the node ingress-addon-legacy-791930 as control-plane by adding the label "node-role.kubernetes.io/master=''"
I0214 03:29:24.090418 1514375 kubeadm.go:309] [bootstrap-token] Using token: 9o790w.wkwew1oyksgjikxd
I0214 03:29:24.092049 1514375 out.go:204] - Configuring RBAC rules ...
I0214 03:29:24.092208 1514375 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 03:29:24.098224 1514375 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 03:29:24.106062 1514375 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 03:29:24.109682 1514375 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 03:29:24.113871 1514375 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 03:29:24.116008 1514375 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 03:29:24.128064 1514375 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 03:29:24.450992 1514375 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 03:29:24.517466 1514375 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 03:29:24.519423 1514375 kubeadm.go:309]
I0214 03:29:24.519536 1514375 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 03:29:24.519557 1514375 kubeadm.go:309]
I0214 03:29:24.519634 1514375 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 03:29:24.519644 1514375 kubeadm.go:309]
I0214 03:29:24.519697 1514375 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 03:29:24.519755 1514375 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 03:29:24.519802 1514375 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 03:29:24.519806 1514375 kubeadm.go:309]
I0214 03:29:24.519855 1514375 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 03:29:24.519935 1514375 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 03:29:24.520036 1514375 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 03:29:24.520050 1514375 kubeadm.go:309]
I0214 03:29:24.520165 1514375 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 03:29:24.520271 1514375 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 03:29:24.520283 1514375 kubeadm.go:309]
I0214 03:29:24.520377 1514375 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 9o790w.wkwew1oyksgjikxd \
I0214 03:29:24.520546 1514375 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 03:29:24.520580 1514375 kubeadm.go:309] --control-plane
I0214 03:29:24.520594 1514375 kubeadm.go:309]
I0214 03:29:24.520694 1514375 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 03:29:24.520701 1514375 kubeadm.go:309]
I0214 03:29:24.520775 1514375 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 9o790w.wkwew1oyksgjikxd \
I0214 03:29:24.520892 1514375 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 03:29:24.521133 1514375 kubeadm.go:309] W0214 03:29:11.353897 1003 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
I0214 03:29:24.521294 1514375 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 03:29:24.521460 1514375 kubeadm.go:309] W0214 03:29:14.506802 1003 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
I0214 03:29:24.521722 1514375 kubeadm.go:309] W0214 03:29:14.507798 1003 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
I0214 03:29:24.521758 1514375 cni.go:84] Creating CNI manager for ""
I0214 03:29:24.521766 1514375 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 03:29:24.523930 1514375 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 03:29:24.525352 1514375 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 03:29:24.535009 1514375 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 03:29:24.552092 1514375 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 03:29:24.552232 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ingress-addon-legacy-791930 minikube.k8s.io/updated_at=2024_02_14T03_29_24_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=ingress-addon-legacy-791930 minikube.k8s.io/primary=true
I0214 03:29:24.552241 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:24.571442 1514375 ops.go:34] apiserver oom_adj: -16
I0214 03:29:24.755750 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:25.256129 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:25.756042 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:26.256749 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:26.756416 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:27.256697 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:27.756602 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:28.256454 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:28.755996 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:29.256159 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:29.755967 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:30.256462 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:30.756319 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:31.256092 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:31.756507 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:32.255966 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:32.756599 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:33.255988 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:33.756134 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:34.256703 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:34.756788 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:35.256417 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:35.756633 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:36.256253 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:36.756815 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:37.256532 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:37.756036 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:38.256419 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:38.755801 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:39.256758 1514375 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 03:29:39.393384 1514375 kubeadm.go:1106] duration metric: took 14.841201991s to wait for elevateKubeSystemPrivileges
W0214 03:29:39.393424 1514375 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 03:29:39.393436 1514375 kubeadm.go:393] duration metric: took 28.219095303s to StartCluster
I0214 03:29:39.393477 1514375 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:39.393572 1514375 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:29:39.394333 1514375 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:29:39.394612 1514375 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0214 03:29:39.394623 1514375 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.215 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 03:29:39.396515 1514375 out.go:177] * Verifying Kubernetes components...
I0214 03:29:39.394755 1514375 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 03:29:39.394859 1514375 config.go:182] Loaded profile config "ingress-addon-legacy-791930": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.18.20
I0214 03:29:39.398031 1514375 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:29:39.398063 1514375 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-791930"
I0214 03:29:39.398136 1514375 addons.go:234] Setting addon storage-provisioner=true in "ingress-addon-legacy-791930"
I0214 03:29:39.398065 1514375 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-791930"
I0214 03:29:39.398205 1514375 host.go:66] Checking if "ingress-addon-legacy-791930" exists ...
I0214 03:29:39.398207 1514375 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-791930"
I0214 03:29:39.398663 1514375 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:29:39.398685 1514375 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:29:39.398691 1514375 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:29:39.398709 1514375 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:29:39.413925 1514375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43195
I0214 03:29:39.413954 1514375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41715
I0214 03:29:39.414418 1514375 main.go:141] libmachine: () Calling .GetVersion
I0214 03:29:39.414499 1514375 main.go:141] libmachine: () Calling .GetVersion
I0214 03:29:39.414973 1514375 main.go:141] libmachine: Using API Version 1
I0214 03:29:39.415005 1514375 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:29:39.415126 1514375 main.go:141] libmachine: Using API Version 1
I0214 03:29:39.415156 1514375 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:29:39.415380 1514375 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:29:39.415476 1514375 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:29:39.415603 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetState
I0214 03:29:39.415973 1514375 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:29:39.416001 1514375 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:29:39.418363 1514375 kapi.go:59] client config for ingress-addon-legacy-791930: &rest.Config{Host:"https://192.168.39.215:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData
:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0214 03:29:39.418993 1514375 cert_rotation.go:137] Starting client certificate rotation controller
I0214 03:29:39.419162 1514375 addons.go:234] Setting addon default-storageclass=true in "ingress-addon-legacy-791930"
I0214 03:29:39.419196 1514375 host.go:66] Checking if "ingress-addon-legacy-791930" exists ...
I0214 03:29:39.419507 1514375 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:29:39.419530 1514375 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:29:39.431218 1514375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35389
I0214 03:29:39.431718 1514375 main.go:141] libmachine: () Calling .GetVersion
I0214 03:29:39.432384 1514375 main.go:141] libmachine: Using API Version 1
I0214 03:29:39.432421 1514375 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:29:39.432878 1514375 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:29:39.433110 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetState
I0214 03:29:39.434486 1514375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40359
I0214 03:29:39.434915 1514375 main.go:141] libmachine: () Calling .GetVersion
I0214 03:29:39.435097 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:39.435386 1514375 main.go:141] libmachine: Using API Version 1
I0214 03:29:39.435405 1514375 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:29:39.437551 1514375 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 03:29:39.435765 1514375 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:29:39.438162 1514375 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:29:39.439276 1514375 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 03:29:39.439287 1514375 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:29:39.439303 1514375 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 03:29:39.439327 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:39.443094 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:39.443584 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:39.443612 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:39.443881 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:39.444079 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:39.444317 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:39.444478 1514375 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa Username:docker}
I0214 03:29:39.454965 1514375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32801
I0214 03:29:39.455432 1514375 main.go:141] libmachine: () Calling .GetVersion
I0214 03:29:39.455856 1514375 main.go:141] libmachine: Using API Version 1
I0214 03:29:39.455871 1514375 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:29:39.456179 1514375 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:29:39.456357 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetState
I0214 03:29:39.458128 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .DriverName
I0214 03:29:39.458466 1514375 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 03:29:39.458485 1514375 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 03:29:39.458511 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHHostname
I0214 03:29:39.461117 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:39.461676 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:03:03:1f", ip: ""} in network mk-ingress-addon-legacy-791930: {Iface:virbr1 ExpiryTime:2024-02-14 04:28:52 +0000 UTC Type:0 Mac:52:54:00:03:03:1f Iaid: IPaddr:192.168.39.215 Prefix:24 Hostname:ingress-addon-legacy-791930 Clientid:01:52:54:00:03:03:1f}
I0214 03:29:39.461701 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | domain ingress-addon-legacy-791930 has defined IP address 192.168.39.215 and MAC address 52:54:00:03:03:1f in network mk-ingress-addon-legacy-791930
I0214 03:29:39.461778 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHPort
I0214 03:29:39.462002 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHKeyPath
I0214 03:29:39.462190 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .GetSSHUsername
I0214 03:29:39.462376 1514375 sshutil.go:53] new ssh client: &{IP:192.168.39.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/ingress-addon-legacy-791930/id_rsa Username:docker}
I0214 03:29:39.659601 1514375 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0214 03:29:39.712144 1514375 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:29:39.873757 1514375 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 03:29:39.905809 1514375 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 03:29:40.139703 1514375 start.go:948] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I0214 03:29:40.140377 1514375 kapi.go:59] client config for ingress-addon-legacy-791930: &rest.Config{Host:"https://192.168.39.215:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData
:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0214 03:29:40.140508 1514375 kapi.go:59] client config for ingress-addon-legacy-791930: &rest.Config{Host:"https://192.168.39.215:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt", KeyFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.key", CAFile:"/home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt", CertData:[]uint8(nil), KeyData
:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c29260), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0214 03:29:40.140731 1514375 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-791930" to be "Ready" ...
I0214 03:29:40.635345 1514375 node_ready.go:49] node "ingress-addon-legacy-791930" has status "Ready":"True"
I0214 03:29:40.635371 1514375 node_ready.go:38] duration metric: took 494.608521ms for node "ingress-addon-legacy-791930" to be "Ready" ...
I0214 03:29:40.635380 1514375 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:29:40.693868 1514375 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-rvhml" in "kube-system" namespace to be "Ready" ...
I0214 03:29:40.743228 1514375 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-791930" context rescaled to 1 replicas
I0214 03:29:40.863748 1514375 main.go:141] libmachine: Making call to close driver server
I0214 03:29:40.863795 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .Close
I0214 03:29:40.863818 1514375 main.go:141] libmachine: Making call to close driver server
I0214 03:29:40.863841 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .Close
I0214 03:29:40.864098 1514375 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:29:40.864120 1514375 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:29:40.864130 1514375 main.go:141] libmachine: Making call to close driver server
I0214 03:29:40.864138 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .Close
I0214 03:29:40.864284 1514375 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:29:40.864312 1514375 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:29:40.864325 1514375 main.go:141] libmachine: Making call to close driver server
I0214 03:29:40.864340 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .Close
I0214 03:29:40.864421 1514375 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:29:40.864435 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Closing plugin on server side
I0214 03:29:40.864447 1514375 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:29:40.864611 1514375 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:29:40.864669 1514375 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:29:40.864630 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Closing plugin on server side
I0214 03:29:40.871632 1514375 main.go:141] libmachine: Making call to close driver server
I0214 03:29:40.871652 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) Calling .Close
I0214 03:29:40.871874 1514375 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:29:40.871899 1514375 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:29:40.871900 1514375 main.go:141] libmachine: (ingress-addon-legacy-791930) DBG | Closing plugin on server side
I0214 03:29:40.873667 1514375 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0214 03:29:40.875566 1514375 addons.go:505] duration metric: took 1.480824966s for enable addons: enabled=[storage-provisioner default-storageclass]
I0214 03:29:42.701230 1514375 pod_ready.go:102] pod "coredns-66bff467f8-rvhml" in "kube-system" namespace has status "Ready":"False"
I0214 03:29:43.201543 1514375 pod_ready.go:92] pod "coredns-66bff467f8-rvhml" in "kube-system" namespace has status "Ready":"True"
I0214 03:29:43.201569 1514375 pod_ready.go:81] duration metric: took 2.5076617s for pod "coredns-66bff467f8-rvhml" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.201578 1514375 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-rz9n9" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.203532 1514375 pod_ready.go:97] error getting pod "coredns-66bff467f8-rz9n9" in "kube-system" namespace (skipping!): pods "coredns-66bff467f8-rz9n9" not found
I0214 03:29:43.203557 1514375 pod_ready.go:81] duration metric: took 1.972568ms for pod "coredns-66bff467f8-rz9n9" in "kube-system" namespace to be "Ready" ...
E0214 03:29:43.203568 1514375 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-66bff467f8-rz9n9" in "kube-system" namespace (skipping!): pods "coredns-66bff467f8-rz9n9" not found
I0214 03:29:43.203580 1514375 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-791930" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.207926 1514375 pod_ready.go:92] pod "etcd-ingress-addon-legacy-791930" in "kube-system" namespace has status "Ready":"True"
I0214 03:29:43.207956 1514375 pod_ready.go:81] duration metric: took 4.362931ms for pod "etcd-ingress-addon-legacy-791930" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.207967 1514375 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-791930" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.216956 1514375 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-791930" in "kube-system" namespace has status "Ready":"True"
I0214 03:29:43.216976 1514375 pod_ready.go:81] duration metric: took 9.001286ms for pod "kube-apiserver-ingress-addon-legacy-791930" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.216985 1514375 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-791930" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.222317 1514375 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-791930" in "kube-system" namespace has status "Ready":"True"
I0214 03:29:43.222336 1514375 pod_ready.go:81] duration metric: took 5.343823ms for pod "kube-controller-manager-ingress-addon-legacy-791930" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.222353 1514375 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-t4jcn" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.395365 1514375 request.go:629] Waited for 170.392926ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.215:8443/api/v1/nodes/ingress-addon-legacy-791930
I0214 03:29:43.398100 1514375 pod_ready.go:92] pod "kube-proxy-t4jcn" in "kube-system" namespace has status "Ready":"True"
I0214 03:29:43.398123 1514375 pod_ready.go:81] duration metric: took 175.762794ms for pod "kube-proxy-t4jcn" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.398136 1514375 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-791930" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.594574 1514375 request.go:629] Waited for 196.353912ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.215:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-791930
I0214 03:29:43.794868 1514375 request.go:629] Waited for 197.117111ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.215:8443/api/v1/nodes/ingress-addon-legacy-791930
I0214 03:29:43.798200 1514375 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-791930" in "kube-system" namespace has status "Ready":"True"
I0214 03:29:43.798223 1514375 pod_ready.go:81] duration metric: took 400.08093ms for pod "kube-scheduler-ingress-addon-legacy-791930" in "kube-system" namespace to be "Ready" ...
I0214 03:29:43.798231 1514375 pod_ready.go:38] duration metric: took 3.162841683s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 03:29:43.798247 1514375 api_server.go:52] waiting for apiserver process to appear ...
I0214 03:29:43.798315 1514375 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:29:43.810123 1514375 api_server.go:72] duration metric: took 4.415463158s to wait for apiserver process to appear ...
I0214 03:29:43.810152 1514375 api_server.go:88] waiting for apiserver healthz status ...
I0214 03:29:43.810174 1514375 api_server.go:253] Checking apiserver healthz at https://192.168.39.215:8443/healthz ...
I0214 03:29:43.815504 1514375 api_server.go:279] https://192.168.39.215:8443/healthz returned 200:
ok
I0214 03:29:43.816425 1514375 api_server.go:141] control plane version: v1.18.20
I0214 03:29:43.816458 1514375 api_server.go:131] duration metric: took 6.298738ms to wait for apiserver health ...
I0214 03:29:43.816467 1514375 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 03:29:43.994926 1514375 request.go:629] Waited for 178.384804ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.215:8443/api/v1/namespaces/kube-system/pods
I0214 03:29:44.000498 1514375 system_pods.go:59] 7 kube-system pods found
I0214 03:29:44.000526 1514375 system_pods.go:61] "coredns-66bff467f8-rvhml" [647267c2-3679-4538-8ace-19138055cf55] Running
I0214 03:29:44.000531 1514375 system_pods.go:61] "etcd-ingress-addon-legacy-791930" [bc3713f5-2305-47fe-aacd-74f4782a1abe] Running
I0214 03:29:44.000535 1514375 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-791930" [0440a6e2-11d1-4cc9-a7a0-9f8d32a6a665] Running
I0214 03:29:44.000540 1514375 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-791930" [39337a40-18b3-4191-bea8-efe5db305754] Running
I0214 03:29:44.000543 1514375 system_pods.go:61] "kube-proxy-t4jcn" [4043b661-f8a4-4214-a260-d44c3cf32ca9] Running
I0214 03:29:44.000547 1514375 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-791930" [581e8ee7-658c-46ac-9a1d-d3b029d0dca3] Running
I0214 03:29:44.000551 1514375 system_pods.go:61] "storage-provisioner" [53f9f275-31bb-4e4f-bf68-99d1b3f8c5ef] Running
I0214 03:29:44.000557 1514375 system_pods.go:74] duration metric: took 184.082976ms to wait for pod list to return data ...
I0214 03:29:44.000567 1514375 default_sa.go:34] waiting for default service account to be created ...
I0214 03:29:44.194979 1514375 request.go:629] Waited for 194.338933ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.215:8443/api/v1/namespaces/default/serviceaccounts
I0214 03:29:44.198093 1514375 default_sa.go:45] found service account: "default"
I0214 03:29:44.198121 1514375 default_sa.go:55] duration metric: took 197.54688ms for default service account to be created ...
I0214 03:29:44.198129 1514375 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 03:29:44.394502 1514375 request.go:629] Waited for 196.301557ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.215:8443/api/v1/namespaces/kube-system/pods
I0214 03:29:44.400329 1514375 system_pods.go:86] 7 kube-system pods found
I0214 03:29:44.400358 1514375 system_pods.go:89] "coredns-66bff467f8-rvhml" [647267c2-3679-4538-8ace-19138055cf55] Running
I0214 03:29:44.400366 1514375 system_pods.go:89] "etcd-ingress-addon-legacy-791930" [bc3713f5-2305-47fe-aacd-74f4782a1abe] Running
I0214 03:29:44.400370 1514375 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-791930" [0440a6e2-11d1-4cc9-a7a0-9f8d32a6a665] Running
I0214 03:29:44.400374 1514375 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-791930" [39337a40-18b3-4191-bea8-efe5db305754] Running
I0214 03:29:44.400378 1514375 system_pods.go:89] "kube-proxy-t4jcn" [4043b661-f8a4-4214-a260-d44c3cf32ca9] Running
I0214 03:29:44.400382 1514375 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-791930" [581e8ee7-658c-46ac-9a1d-d3b029d0dca3] Running
I0214 03:29:44.400386 1514375 system_pods.go:89] "storage-provisioner" [53f9f275-31bb-4e4f-bf68-99d1b3f8c5ef] Running
I0214 03:29:44.400392 1514375 system_pods.go:126] duration metric: took 202.258397ms to wait for k8s-apps to be running ...
I0214 03:29:44.400399 1514375 system_svc.go:44] waiting for kubelet service to be running ....
I0214 03:29:44.400453 1514375 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:29:44.413654 1514375 system_svc.go:56] duration metric: took 13.245803ms WaitForService to wait for kubelet
I0214 03:29:44.413678 1514375 kubeadm.go:576] duration metric: took 5.019026004s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:29:44.413696 1514375 node_conditions.go:102] verifying NodePressure condition ...
I0214 03:29:44.594613 1514375 request.go:629] Waited for 180.837417ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.215:8443/api/v1/nodes
I0214 03:29:44.597881 1514375 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 03:29:44.597912 1514375 node_conditions.go:123] node cpu capacity is 2
I0214 03:29:44.597924 1514375 node_conditions.go:105] duration metric: took 184.224481ms to run NodePressure ...
I0214 03:29:44.597997 1514375 start.go:240] waiting for startup goroutines ...
I0214 03:29:44.598038 1514375 start.go:245] waiting for cluster config update ...
I0214 03:29:44.598058 1514375 start.go:254] writing updated cluster config ...
I0214 03:29:44.598413 1514375 ssh_runner.go:195] Run: rm -f paused
I0214 03:29:44.646466 1514375 start.go:599] kubectl: 1.29.1, cluster: 1.18.20 (minor skew: 11)
I0214 03:29:44.648770 1514375 out.go:177]
W0214 03:29:44.650338 1514375 out.go:239] ! /usr/local/bin/kubectl is version 1.29.1, which may have incompatibilities with Kubernetes 1.18.20.
I0214 03:29:44.651891 1514375 out.go:177] - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
I0214 03:29:44.653392 1514375 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-791930" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 03:28:48 UTC, ends at Wed 2024-02-14 03:32:39 UTC. --
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.275915887Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707881559275902653,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:203943,},InodesUsed:&UInt64Value{Value:85,},},},}" file="go-grpc-middleware/chain.go:25" id=093f6e54-87bf-4422-a87d-42e19b711883 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.276610528Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=8cc75d0d-d71b-47fc-8d30-e216dcd7520e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.276739187Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=8cc75d0d-d71b-47fc-8d30-e216dcd7520e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.276994538Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:922dfd54bceb9d343884fbeceaa48d765942bf915a08f4d228ad701f84e7ac1a,PodSandboxId:732b005c9b44e88966ee24b73f0fa1896977c8263bff2028752b4e2bf2cd1641,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1707881550036176036,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5f5d8b66bb-l7pz7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ccacc522-2fab-45ca-b855-bcfbb643d903,},Annotations:map[string]string{io.kubernetes.container.hash: f45fc629,io.ku
bernetes.container.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c9caa38b9000369f1067c81d964a41ebd28df0514d98178aad92c2cdc248b1a,PodSandboxId:4c6ec029a2fe735eed26bdf5a5d1dcaf44083c4bafab3f01a6cccaaaa0cf0c48,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,State:CONTAINER_RUNNING,CreatedAt:1707881410746095968,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 4168ab41-56cf-45ea-aabc-86a9e34d65e3,},Annotations:map[string]stri
ng{io.kubernetes.container.hash: 41432f7d,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39a44b86be0cfa0efe218022b3ad4e730f6477851b9de9a38f9595806aa21254,PodSandboxId:196e805474e3832406a6dfc6463c6cd31b709d52a85ddbee73bcc36add8bd701,Metadata:&ContainerMetadata{Name:controller,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324,State:CONTAINER_EXITED,CreatedAt:1707881396838101193,Labels:map[string]string{io.kubernetes.container.name: controller,io.kubernetes.pod.name: ingress-nginx-controller-7fcf777cb7-b8zfn,io
.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: c9555e7e-1441-421b-84ff-bc0b640150a5,},Annotations:map[string]string{io.kubernetes.container.hash: 119b4a34,io.kubernetes.container.ports: [{\"name\":\"http\",\"hostPort\":80,\"containerPort\":80,\"protocol\":\"TCP\"},{\"name\":\"https\",\"hostPort\":443,\"containerPort\":443,\"protocol\":\"TCP\"},{\"name\":\"webhook\",\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.preStopHandler: {\"exec\":{\"command\":[\"/wait-shutdown\"]}},io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 0,},},&Container{Id:2a1911db8d78f94f94d2fa14b1a433761eb9b17ad1b29c909c500f282f29ccb3,PodSandboxId:6900d3ca7e713609f51060adeeacd691e396b347566ae84f7d209081975cd21b,Metadata:&ContainerMetadata{Name:patch,Attempt:0,},Image:&ImageSpec{Image:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34e
a58fe36766c2dbeb129b125d25f16b8468c903262b77f6,Annotations:map[string]string{},},ImageRef:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,State:CONTAINER_EXITED,CreatedAt:1707881389112393180,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-l8dq5,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 8e9dd1ba-48a3-4f98-addc-fc966d3bcc33,},Annotations:map[string]string{io.kubernetes.container.hash: 212872f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d05a3c28782fe630f18eca01796e5b80f171027f8e812353ae431f6a579c8604,PodSandboxId:13f7c44d6fffd29e1aeafef5a196b9cf72928cdcbe58b6090f0869197c4cf029,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:docker.io/jettech/kube-webhook
-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,Annotations:map[string]string{},},ImageRef:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,State:CONTAINER_EXITED,CreatedAt:1707881388666977977,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-vg7zm,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: d224afc1-0f6b-4eb0-a143-b3328d6ffc23,},Annotations:map[string]string{io.kubernetes.container.hash: e8770d0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6bddf8c3e45ce251f9ec83a65c3c167225d965366184f2d7872b13d843e11d1e,PodSandboxId:76f673132d9757b10e63fc41b564f08f595cd70899f5dddf8a53e8891cbc19a8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image
:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707881381594863042,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 53f9f275-31bb-4e4f-bf68-99d1b3f8c5ef,},Annotations:map[string]string{io.kubernetes.container.hash: f0bf4372,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:821acb5fa773e4a760b96afbcc0992c18f382624cb5e0d659d20f8fe7a6f84d1,PodSandboxId:6dc0cf86130e51e77523e0c148690967528522d000a5f88965f12681cc4b61da,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{I
mage:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800,State:CONTAINER_RUNNING,CreatedAt:1707881381195338763,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-66bff467f8-rvhml,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 647267c2-3679-4538-8ace-19138055cf55,},Annotations:map[string]string{io.kubernetes.container.hash: bbbaf7bd,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:df8348629b3b02adb6417596ce53f
4443980a3e4437271db1bb718df54454f1a,PodSandboxId:f07fabdc7263efa874637c477a9041378d152b5731054a2f2c1775e5ed119a83,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:12f2b93c34db1caf73610092df74688e676c3b5abce940c25563ac5e93175381,State:CONTAINER_RUNNING,CreatedAt:1707881380640525641,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-t4jcn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4043b661-f8a4-4214-a260-d44c3cf32ca9,},Annotations:map[string]string{io.kubernetes.container.hash: a1717ce1,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a3322c006f8f3c7909f27375d2e14a483881a8cd7edca2336cbed816dbf11827,PodS
andboxId:0f6e78e480c8704237903a9f4feac05210736663bc0a586422080cbd0690ea6e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:4198ba6f82f642dfd18ecf840ee37afb9df4b596f06eef20e44d0aec4ea27216,State:CONTAINER_RUNNING,CreatedAt:1707881357494809821,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a034a98d6f1bf0655993261b44087e11,},Annotations:map[string]string{io.kubernetes.container.hash: f55ac65a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72ff27fa71453be7ef9d1aa5193c8683e655ebb8552886d6a717e18185e6a050,PodSandboxId:949b8024635c967167b9d9dfb6e12d7cf2bc0
57485c45b9e0f63d385e2156694,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:b1ae8022783f0bc6169330aa1927fff648ff81da74482f89da764cbb6be6a402,State:CONTAINER_RUNNING,CreatedAt:1707881356564581725,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d12e497b0008e22acbcd5a9cf2dd48ac,},Annotations:map[string]string{io.kubernetes.container.hash: ef5ef709,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7cb86edd86412f0547c6758e135c3af51cd68ed2d329b6eea21e3cb270f3898,PodSandboxId:085fb55531d7392bc6fcb8e989321516e6ddbe3e6b4
38a22f9d5ad82c34e6ed5,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:391cf23f3094f59e1ce222cb1fd0593ee73e120d4fdeb29d563bd0432d2e7c32,State:CONTAINER_RUNNING,CreatedAt:1707881356399600804,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3b75f07c388c673918e002cee8709d9d,},Annotations:map[string]string{io.kubernetes.container.hash: ed071631,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:590b7cec98b0ab3bc3a00d43c3a052e628f1e1615df304263383747dd878ddc1,PodSandboxId:09e85c8584faa914bf3ed37f7e334300c93019b64b77fd073
8bbb671f8ec8f2a,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:1adc80c92cd714665cb8fe73a3157a44b050595a61d376bfd01ab2eb230230bd,State:CONTAINER_RUNNING,CreatedAt:1707881356324820387,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b395a1e17534e69e27827b1f8d737725,},Annotations:map[string]string{io.kubernetes.container.hash: 345eaecd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=8cc75d0d-d71b-47fc-8d30-e216dcd7520e name=/runtime.v1.RuntimeServ
ice/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.314651950Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=c30b1be2-21ae-4753-b436-2585742cffd0 name=/runtime.v1.RuntimeService/Version
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.314811255Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=c30b1be2-21ae-4753-b436-2585742cffd0 name=/runtime.v1.RuntimeService/Version
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.316000501Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=ff2624a7-ea9f-4fc6-ae4b-83e13f268921 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.316482387Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707881559316470591,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:203943,},InodesUsed:&UInt64Value{Value:85,},},},}" file="go-grpc-middleware/chain.go:25" id=ff2624a7-ea9f-4fc6-ae4b-83e13f268921 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.317066414Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=abf81afc-39a4-448e-93c3-7944bdec3edb name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.317109753Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=abf81afc-39a4-448e-93c3-7944bdec3edb name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.317350797Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:922dfd54bceb9d343884fbeceaa48d765942bf915a08f4d228ad701f84e7ac1a,PodSandboxId:732b005c9b44e88966ee24b73f0fa1896977c8263bff2028752b4e2bf2cd1641,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1707881550036176036,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5f5d8b66bb-l7pz7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ccacc522-2fab-45ca-b855-bcfbb643d903,},Annotations:map[string]string{io.kubernetes.container.hash: f45fc629,io.ku
bernetes.container.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c9caa38b9000369f1067c81d964a41ebd28df0514d98178aad92c2cdc248b1a,PodSandboxId:4c6ec029a2fe735eed26bdf5a5d1dcaf44083c4bafab3f01a6cccaaaa0cf0c48,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,State:CONTAINER_RUNNING,CreatedAt:1707881410746095968,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 4168ab41-56cf-45ea-aabc-86a9e34d65e3,},Annotations:map[string]stri
ng{io.kubernetes.container.hash: 41432f7d,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39a44b86be0cfa0efe218022b3ad4e730f6477851b9de9a38f9595806aa21254,PodSandboxId:196e805474e3832406a6dfc6463c6cd31b709d52a85ddbee73bcc36add8bd701,Metadata:&ContainerMetadata{Name:controller,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324,State:CONTAINER_EXITED,CreatedAt:1707881396838101193,Labels:map[string]string{io.kubernetes.container.name: controller,io.kubernetes.pod.name: ingress-nginx-controller-7fcf777cb7-b8zfn,io
.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: c9555e7e-1441-421b-84ff-bc0b640150a5,},Annotations:map[string]string{io.kubernetes.container.hash: 119b4a34,io.kubernetes.container.ports: [{\"name\":\"http\",\"hostPort\":80,\"containerPort\":80,\"protocol\":\"TCP\"},{\"name\":\"https\",\"hostPort\":443,\"containerPort\":443,\"protocol\":\"TCP\"},{\"name\":\"webhook\",\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.preStopHandler: {\"exec\":{\"command\":[\"/wait-shutdown\"]}},io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 0,},},&Container{Id:2a1911db8d78f94f94d2fa14b1a433761eb9b17ad1b29c909c500f282f29ccb3,PodSandboxId:6900d3ca7e713609f51060adeeacd691e396b347566ae84f7d209081975cd21b,Metadata:&ContainerMetadata{Name:patch,Attempt:0,},Image:&ImageSpec{Image:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34e
a58fe36766c2dbeb129b125d25f16b8468c903262b77f6,Annotations:map[string]string{},},ImageRef:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,State:CONTAINER_EXITED,CreatedAt:1707881389112393180,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-l8dq5,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 8e9dd1ba-48a3-4f98-addc-fc966d3bcc33,},Annotations:map[string]string{io.kubernetes.container.hash: 212872f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d05a3c28782fe630f18eca01796e5b80f171027f8e812353ae431f6a579c8604,PodSandboxId:13f7c44d6fffd29e1aeafef5a196b9cf72928cdcbe58b6090f0869197c4cf029,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:docker.io/jettech/kube-webhook
-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,Annotations:map[string]string{},},ImageRef:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,State:CONTAINER_EXITED,CreatedAt:1707881388666977977,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-vg7zm,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: d224afc1-0f6b-4eb0-a143-b3328d6ffc23,},Annotations:map[string]string{io.kubernetes.container.hash: e8770d0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6bddf8c3e45ce251f9ec83a65c3c167225d965366184f2d7872b13d843e11d1e,PodSandboxId:76f673132d9757b10e63fc41b564f08f595cd70899f5dddf8a53e8891cbc19a8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image
:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707881381594863042,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 53f9f275-31bb-4e4f-bf68-99d1b3f8c5ef,},Annotations:map[string]string{io.kubernetes.container.hash: f0bf4372,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:821acb5fa773e4a760b96afbcc0992c18f382624cb5e0d659d20f8fe7a6f84d1,PodSandboxId:6dc0cf86130e51e77523e0c148690967528522d000a5f88965f12681cc4b61da,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{I
mage:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800,State:CONTAINER_RUNNING,CreatedAt:1707881381195338763,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-66bff467f8-rvhml,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 647267c2-3679-4538-8ace-19138055cf55,},Annotations:map[string]string{io.kubernetes.container.hash: bbbaf7bd,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:df8348629b3b02adb6417596ce53f
4443980a3e4437271db1bb718df54454f1a,PodSandboxId:f07fabdc7263efa874637c477a9041378d152b5731054a2f2c1775e5ed119a83,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:12f2b93c34db1caf73610092df74688e676c3b5abce940c25563ac5e93175381,State:CONTAINER_RUNNING,CreatedAt:1707881380640525641,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-t4jcn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4043b661-f8a4-4214-a260-d44c3cf32ca9,},Annotations:map[string]string{io.kubernetes.container.hash: a1717ce1,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a3322c006f8f3c7909f27375d2e14a483881a8cd7edca2336cbed816dbf11827,PodS
andboxId:0f6e78e480c8704237903a9f4feac05210736663bc0a586422080cbd0690ea6e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:4198ba6f82f642dfd18ecf840ee37afb9df4b596f06eef20e44d0aec4ea27216,State:CONTAINER_RUNNING,CreatedAt:1707881357494809821,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a034a98d6f1bf0655993261b44087e11,},Annotations:map[string]string{io.kubernetes.container.hash: f55ac65a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72ff27fa71453be7ef9d1aa5193c8683e655ebb8552886d6a717e18185e6a050,PodSandboxId:949b8024635c967167b9d9dfb6e12d7cf2bc0
57485c45b9e0f63d385e2156694,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:b1ae8022783f0bc6169330aa1927fff648ff81da74482f89da764cbb6be6a402,State:CONTAINER_RUNNING,CreatedAt:1707881356564581725,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d12e497b0008e22acbcd5a9cf2dd48ac,},Annotations:map[string]string{io.kubernetes.container.hash: ef5ef709,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7cb86edd86412f0547c6758e135c3af51cd68ed2d329b6eea21e3cb270f3898,PodSandboxId:085fb55531d7392bc6fcb8e989321516e6ddbe3e6b4
38a22f9d5ad82c34e6ed5,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:391cf23f3094f59e1ce222cb1fd0593ee73e120d4fdeb29d563bd0432d2e7c32,State:CONTAINER_RUNNING,CreatedAt:1707881356399600804,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3b75f07c388c673918e002cee8709d9d,},Annotations:map[string]string{io.kubernetes.container.hash: ed071631,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:590b7cec98b0ab3bc3a00d43c3a052e628f1e1615df304263383747dd878ddc1,PodSandboxId:09e85c8584faa914bf3ed37f7e334300c93019b64b77fd073
8bbb671f8ec8f2a,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:1adc80c92cd714665cb8fe73a3157a44b050595a61d376bfd01ab2eb230230bd,State:CONTAINER_RUNNING,CreatedAt:1707881356324820387,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b395a1e17534e69e27827b1f8d737725,},Annotations:map[string]string{io.kubernetes.container.hash: 345eaecd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=abf81afc-39a4-448e-93c3-7944bdec3edb name=/runtime.v1.RuntimeServ
ice/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.358948921Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=40776f6c-f713-4df3-a221-47f965182246 name=/runtime.v1.RuntimeService/Version
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.359029963Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=40776f6c-f713-4df3-a221-47f965182246 name=/runtime.v1.RuntimeService/Version
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.360906982Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=05722031-6a47-4128-bba7-fa8455689535 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.361401611Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707881559361389492,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:203943,},InodesUsed:&UInt64Value{Value:85,},},},}" file="go-grpc-middleware/chain.go:25" id=05722031-6a47-4128-bba7-fa8455689535 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.362089853Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=b481f19d-60a8-4720-9acd-13fca892c378 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.362192458Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=b481f19d-60a8-4720-9acd-13fca892c378 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.362447702Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:922dfd54bceb9d343884fbeceaa48d765942bf915a08f4d228ad701f84e7ac1a,PodSandboxId:732b005c9b44e88966ee24b73f0fa1896977c8263bff2028752b4e2bf2cd1641,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1707881550036176036,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5f5d8b66bb-l7pz7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ccacc522-2fab-45ca-b855-bcfbb643d903,},Annotations:map[string]string{io.kubernetes.container.hash: f45fc629,io.ku
bernetes.container.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c9caa38b9000369f1067c81d964a41ebd28df0514d98178aad92c2cdc248b1a,PodSandboxId:4c6ec029a2fe735eed26bdf5a5d1dcaf44083c4bafab3f01a6cccaaaa0cf0c48,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,State:CONTAINER_RUNNING,CreatedAt:1707881410746095968,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 4168ab41-56cf-45ea-aabc-86a9e34d65e3,},Annotations:map[string]stri
ng{io.kubernetes.container.hash: 41432f7d,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39a44b86be0cfa0efe218022b3ad4e730f6477851b9de9a38f9595806aa21254,PodSandboxId:196e805474e3832406a6dfc6463c6cd31b709d52a85ddbee73bcc36add8bd701,Metadata:&ContainerMetadata{Name:controller,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324,State:CONTAINER_EXITED,CreatedAt:1707881396838101193,Labels:map[string]string{io.kubernetes.container.name: controller,io.kubernetes.pod.name: ingress-nginx-controller-7fcf777cb7-b8zfn,io
.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: c9555e7e-1441-421b-84ff-bc0b640150a5,},Annotations:map[string]string{io.kubernetes.container.hash: 119b4a34,io.kubernetes.container.ports: [{\"name\":\"http\",\"hostPort\":80,\"containerPort\":80,\"protocol\":\"TCP\"},{\"name\":\"https\",\"hostPort\":443,\"containerPort\":443,\"protocol\":\"TCP\"},{\"name\":\"webhook\",\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.preStopHandler: {\"exec\":{\"command\":[\"/wait-shutdown\"]}},io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 0,},},&Container{Id:2a1911db8d78f94f94d2fa14b1a433761eb9b17ad1b29c909c500f282f29ccb3,PodSandboxId:6900d3ca7e713609f51060adeeacd691e396b347566ae84f7d209081975cd21b,Metadata:&ContainerMetadata{Name:patch,Attempt:0,},Image:&ImageSpec{Image:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34e
a58fe36766c2dbeb129b125d25f16b8468c903262b77f6,Annotations:map[string]string{},},ImageRef:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,State:CONTAINER_EXITED,CreatedAt:1707881389112393180,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-l8dq5,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 8e9dd1ba-48a3-4f98-addc-fc966d3bcc33,},Annotations:map[string]string{io.kubernetes.container.hash: 212872f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d05a3c28782fe630f18eca01796e5b80f171027f8e812353ae431f6a579c8604,PodSandboxId:13f7c44d6fffd29e1aeafef5a196b9cf72928cdcbe58b6090f0869197c4cf029,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:docker.io/jettech/kube-webhook
-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,Annotations:map[string]string{},},ImageRef:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,State:CONTAINER_EXITED,CreatedAt:1707881388666977977,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-vg7zm,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: d224afc1-0f6b-4eb0-a143-b3328d6ffc23,},Annotations:map[string]string{io.kubernetes.container.hash: e8770d0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6bddf8c3e45ce251f9ec83a65c3c167225d965366184f2d7872b13d843e11d1e,PodSandboxId:76f673132d9757b10e63fc41b564f08f595cd70899f5dddf8a53e8891cbc19a8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image
:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707881381594863042,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 53f9f275-31bb-4e4f-bf68-99d1b3f8c5ef,},Annotations:map[string]string{io.kubernetes.container.hash: f0bf4372,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:821acb5fa773e4a760b96afbcc0992c18f382624cb5e0d659d20f8fe7a6f84d1,PodSandboxId:6dc0cf86130e51e77523e0c148690967528522d000a5f88965f12681cc4b61da,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{I
mage:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800,State:CONTAINER_RUNNING,CreatedAt:1707881381195338763,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-66bff467f8-rvhml,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 647267c2-3679-4538-8ace-19138055cf55,},Annotations:map[string]string{io.kubernetes.container.hash: bbbaf7bd,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:df8348629b3b02adb6417596ce53f
4443980a3e4437271db1bb718df54454f1a,PodSandboxId:f07fabdc7263efa874637c477a9041378d152b5731054a2f2c1775e5ed119a83,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:12f2b93c34db1caf73610092df74688e676c3b5abce940c25563ac5e93175381,State:CONTAINER_RUNNING,CreatedAt:1707881380640525641,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-t4jcn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4043b661-f8a4-4214-a260-d44c3cf32ca9,},Annotations:map[string]string{io.kubernetes.container.hash: a1717ce1,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a3322c006f8f3c7909f27375d2e14a483881a8cd7edca2336cbed816dbf11827,PodS
andboxId:0f6e78e480c8704237903a9f4feac05210736663bc0a586422080cbd0690ea6e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:4198ba6f82f642dfd18ecf840ee37afb9df4b596f06eef20e44d0aec4ea27216,State:CONTAINER_RUNNING,CreatedAt:1707881357494809821,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a034a98d6f1bf0655993261b44087e11,},Annotations:map[string]string{io.kubernetes.container.hash: f55ac65a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72ff27fa71453be7ef9d1aa5193c8683e655ebb8552886d6a717e18185e6a050,PodSandboxId:949b8024635c967167b9d9dfb6e12d7cf2bc0
57485c45b9e0f63d385e2156694,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:b1ae8022783f0bc6169330aa1927fff648ff81da74482f89da764cbb6be6a402,State:CONTAINER_RUNNING,CreatedAt:1707881356564581725,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d12e497b0008e22acbcd5a9cf2dd48ac,},Annotations:map[string]string{io.kubernetes.container.hash: ef5ef709,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7cb86edd86412f0547c6758e135c3af51cd68ed2d329b6eea21e3cb270f3898,PodSandboxId:085fb55531d7392bc6fcb8e989321516e6ddbe3e6b4
38a22f9d5ad82c34e6ed5,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:391cf23f3094f59e1ce222cb1fd0593ee73e120d4fdeb29d563bd0432d2e7c32,State:CONTAINER_RUNNING,CreatedAt:1707881356399600804,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3b75f07c388c673918e002cee8709d9d,},Annotations:map[string]string{io.kubernetes.container.hash: ed071631,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:590b7cec98b0ab3bc3a00d43c3a052e628f1e1615df304263383747dd878ddc1,PodSandboxId:09e85c8584faa914bf3ed37f7e334300c93019b64b77fd073
8bbb671f8ec8f2a,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:1adc80c92cd714665cb8fe73a3157a44b050595a61d376bfd01ab2eb230230bd,State:CONTAINER_RUNNING,CreatedAt:1707881356324820387,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b395a1e17534e69e27827b1f8d737725,},Annotations:map[string]string{io.kubernetes.container.hash: 345eaecd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=b481f19d-60a8-4720-9acd-13fca892c378 name=/runtime.v1.RuntimeServ
ice/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.400024528Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=1c06653b-1170-49f8-89ba-edc5bad2b546 name=/runtime.v1.RuntimeService/Version
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.400101480Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=1c06653b-1170-49f8-89ba-edc5bad2b546 name=/runtime.v1.RuntimeService/Version
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.401316115Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=53812865-5363-41f1-921e-4f15d72ee5ae name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.401925765Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707881559401907947,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:203943,},InodesUsed:&UInt64Value{Value:85,},},},}" file="go-grpc-middleware/chain.go:25" id=53812865-5363-41f1-921e-4f15d72ee5ae name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.402817889Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=6a952a43-f355-4494-9606-76427bccc351 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.402896062Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=6a952a43-f355-4494-9606-76427bccc351 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:32:39 ingress-addon-legacy-791930 crio[726]: time="2024-02-14 03:32:39.403140770Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:922dfd54bceb9d343884fbeceaa48d765942bf915a08f4d228ad701f84e7ac1a,PodSandboxId:732b005c9b44e88966ee24b73f0fa1896977c8263bff2028752b4e2bf2cd1641,Metadata:&ContainerMetadata{Name:hello-world-app,Attempt:0,},Image:&ImageSpec{Image:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,Annotations:map[string]string{},},ImageRef:gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7,State:CONTAINER_RUNNING,CreatedAt:1707881550036176036,Labels:map[string]string{io.kubernetes.container.name: hello-world-app,io.kubernetes.pod.name: hello-world-app-5f5d8b66bb-l7pz7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ccacc522-2fab-45ca-b855-bcfbb643d903,},Annotations:map[string]string{io.kubernetes.container.hash: f45fc629,io.ku
bernetes.container.ports: [{\"containerPort\":8080,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c9caa38b9000369f1067c81d964a41ebd28df0514d98178aad92c2cdc248b1a,PodSandboxId:4c6ec029a2fe735eed26bdf5a5d1dcaf44083c4bafab3f01a6cccaaaa0cf0c48,Metadata:&ContainerMetadata{Name:nginx,Attempt:0,},Image:&ImageSpec{Image:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,Annotations:map[string]string{},},ImageRef:docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027,State:CONTAINER_RUNNING,CreatedAt:1707881410746095968,Labels:map[string]string{io.kubernetes.container.name: nginx,io.kubernetes.pod.name: nginx,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 4168ab41-56cf-45ea-aabc-86a9e34d65e3,},Annotations:map[string]stri
ng{io.kubernetes.container.hash: 41432f7d,io.kubernetes.container.ports: [{\"containerPort\":80,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39a44b86be0cfa0efe218022b3ad4e730f6477851b9de9a38f9595806aa21254,PodSandboxId:196e805474e3832406a6dfc6463c6cd31b709d52a85ddbee73bcc36add8bd701,Metadata:&ContainerMetadata{Name:controller,Attempt:0,},Image:&ImageSpec{Image:registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324,Annotations:map[string]string{},},ImageRef:registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324,State:CONTAINER_EXITED,CreatedAt:1707881396838101193,Labels:map[string]string{io.kubernetes.container.name: controller,io.kubernetes.pod.name: ingress-nginx-controller-7fcf777cb7-b8zfn,io
.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: c9555e7e-1441-421b-84ff-bc0b640150a5,},Annotations:map[string]string{io.kubernetes.container.hash: 119b4a34,io.kubernetes.container.ports: [{\"name\":\"http\",\"hostPort\":80,\"containerPort\":80,\"protocol\":\"TCP\"},{\"name\":\"https\",\"hostPort\":443,\"containerPort\":443,\"protocol\":\"TCP\"},{\"name\":\"webhook\",\"containerPort\":8443,\"protocol\":\"TCP\"}],io.kubernetes.container.preStopHandler: {\"exec\":{\"command\":[\"/wait-shutdown\"]}},io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 0,},},&Container{Id:2a1911db8d78f94f94d2fa14b1a433761eb9b17ad1b29c909c500f282f29ccb3,PodSandboxId:6900d3ca7e713609f51060adeeacd691e396b347566ae84f7d209081975cd21b,Metadata:&ContainerMetadata{Name:patch,Attempt:0,},Image:&ImageSpec{Image:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34e
a58fe36766c2dbeb129b125d25f16b8468c903262b77f6,Annotations:map[string]string{},},ImageRef:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,State:CONTAINER_EXITED,CreatedAt:1707881389112393180,Labels:map[string]string{io.kubernetes.container.name: patch,io.kubernetes.pod.name: ingress-nginx-admission-patch-l8dq5,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: 8e9dd1ba-48a3-4f98-addc-fc966d3bcc33,},Annotations:map[string]string{io.kubernetes.container.hash: 212872f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d05a3c28782fe630f18eca01796e5b80f171027f8e812353ae431f6a579c8604,PodSandboxId:13f7c44d6fffd29e1aeafef5a196b9cf72928cdcbe58b6090f0869197c4cf029,Metadata:&ContainerMetadata{Name:create,Attempt:0,},Image:&ImageSpec{Image:docker.io/jettech/kube-webhook
-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,Annotations:map[string]string{},},ImageRef:docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6,State:CONTAINER_EXITED,CreatedAt:1707881388666977977,Labels:map[string]string{io.kubernetes.container.name: create,io.kubernetes.pod.name: ingress-nginx-admission-create-vg7zm,io.kubernetes.pod.namespace: ingress-nginx,io.kubernetes.pod.uid: d224afc1-0f6b-4eb0-a143-b3328d6ffc23,},Annotations:map[string]string{io.kubernetes.container.hash: e8770d0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6bddf8c3e45ce251f9ec83a65c3c167225d965366184f2d7872b13d843e11d1e,PodSandboxId:76f673132d9757b10e63fc41b564f08f595cd70899f5dddf8a53e8891cbc19a8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image
:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707881381594863042,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 53f9f275-31bb-4e4f-bf68-99d1b3f8c5ef,},Annotations:map[string]string{io.kubernetes.container.hash: f0bf4372,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:821acb5fa773e4a760b96afbcc0992c18f382624cb5e0d659d20f8fe7a6f84d1,PodSandboxId:6dc0cf86130e51e77523e0c148690967528522d000a5f88965f12681cc4b61da,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{I
mage:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800,State:CONTAINER_RUNNING,CreatedAt:1707881381195338763,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-66bff467f8-rvhml,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 647267c2-3679-4538-8ace-19138055cf55,},Annotations:map[string]string{io.kubernetes.container.hash: bbbaf7bd,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:df8348629b3b02adb6417596ce53f
4443980a3e4437271db1bb718df54454f1a,PodSandboxId:f07fabdc7263efa874637c477a9041378d152b5731054a2f2c1775e5ed119a83,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:12f2b93c34db1caf73610092df74688e676c3b5abce940c25563ac5e93175381,State:CONTAINER_RUNNING,CreatedAt:1707881380640525641,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-t4jcn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4043b661-f8a4-4214-a260-d44c3cf32ca9,},Annotations:map[string]string{io.kubernetes.container.hash: a1717ce1,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a3322c006f8f3c7909f27375d2e14a483881a8cd7edca2336cbed816dbf11827,PodS
andboxId:0f6e78e480c8704237903a9f4feac05210736663bc0a586422080cbd0690ea6e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:4198ba6f82f642dfd18ecf840ee37afb9df4b596f06eef20e44d0aec4ea27216,State:CONTAINER_RUNNING,CreatedAt:1707881357494809821,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a034a98d6f1bf0655993261b44087e11,},Annotations:map[string]string{io.kubernetes.container.hash: f55ac65a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72ff27fa71453be7ef9d1aa5193c8683e655ebb8552886d6a717e18185e6a050,PodSandboxId:949b8024635c967167b9d9dfb6e12d7cf2bc0
57485c45b9e0f63d385e2156694,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:b1ae8022783f0bc6169330aa1927fff648ff81da74482f89da764cbb6be6a402,State:CONTAINER_RUNNING,CreatedAt:1707881356564581725,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d12e497b0008e22acbcd5a9cf2dd48ac,},Annotations:map[string]string{io.kubernetes.container.hash: ef5ef709,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7cb86edd86412f0547c6758e135c3af51cd68ed2d329b6eea21e3cb270f3898,PodSandboxId:085fb55531d7392bc6fcb8e989321516e6ddbe3e6b4
38a22f9d5ad82c34e6ed5,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:391cf23f3094f59e1ce222cb1fd0593ee73e120d4fdeb29d563bd0432d2e7c32,State:CONTAINER_RUNNING,CreatedAt:1707881356399600804,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3b75f07c388c673918e002cee8709d9d,},Annotations:map[string]string{io.kubernetes.container.hash: ed071631,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:590b7cec98b0ab3bc3a00d43c3a052e628f1e1615df304263383747dd878ddc1,PodSandboxId:09e85c8584faa914bf3ed37f7e334300c93019b64b77fd073
8bbb671f8ec8f2a,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:1adc80c92cd714665cb8fe73a3157a44b050595a61d376bfd01ab2eb230230bd,State:CONTAINER_RUNNING,CreatedAt:1707881356324820387,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ingress-addon-legacy-791930,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b395a1e17534e69e27827b1f8d737725,},Annotations:map[string]string{io.kubernetes.container.hash: 345eaecd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=6a952a43-f355-4494-9606-76427bccc351 name=/runtime.v1.RuntimeServ
ice/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
922dfd54bceb9 gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7 9 seconds ago Running hello-world-app 0 732b005c9b44e hello-world-app-5f5d8b66bb-l7pz7
2c9caa38b9000 docker.io/library/nginx@sha256:b1cfc4e0e01b4dceca3265fd4ca97921569fca1a10919639bedfa8dad9127027 2 minutes ago Running nginx 0 4c6ec029a2fe7 nginx
39a44b86be0cf registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324 2 minutes ago Exited controller 0 196e805474e38 ingress-nginx-controller-7fcf777cb7-b8zfn
2a1911db8d78f docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6 2 minutes ago Exited patch 0 6900d3ca7e713 ingress-nginx-admission-patch-l8dq5
d05a3c28782fe docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6 2 minutes ago Exited create 0 13f7c44d6fffd ingress-nginx-admission-create-vg7zm
6bddf8c3e45ce 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 2 minutes ago Running storage-provisioner 0 76f673132d975 storage-provisioner
821acb5fa773e 67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5 2 minutes ago Running coredns 0 6dc0cf86130e5 coredns-66bff467f8-rvhml
df8348629b3b0 27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba 2 minutes ago Running kube-proxy 0 f07fabdc7263e kube-proxy-t4jcn
a3322c006f8f3 303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f 3 minutes ago Running etcd 0 0f6e78e480c87 etcd-ingress-addon-legacy-791930
72ff27fa71453 a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346 3 minutes ago Running kube-scheduler 0 949b8024635c9 kube-scheduler-ingress-addon-legacy-791930
a7cb86edd8641 7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1 3 minutes ago Running kube-apiserver 0 085fb55531d73 kube-apiserver-ingress-addon-legacy-791930
590b7cec98b0a e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290 3 minutes ago Running kube-controller-manager 0 09e85c8584faa kube-controller-manager-ingress-addon-legacy-791930
==> coredns [821acb5fa773e4a760b96afbcc0992c18f382624cb5e0d659d20f8fe7a6f84d1] <==
[INFO] 10.244.0.5:59248 - 35073 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000106264s
[INFO] 10.244.0.5:59248 - 50069 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000058396s
[INFO] 10.244.0.5:59248 - 45458 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000074722s
[INFO] 10.244.0.5:59248 - 92 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000111765s
[INFO] 10.244.0.5:34938 - 50038 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000075362s
[INFO] 10.244.0.5:34938 - 46799 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000074802s
[INFO] 10.244.0.5:34938 - 6929 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000146199s
[INFO] 10.244.0.5:34938 - 1260 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00007104s
[INFO] 10.244.0.5:34938 - 14737 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000062684s
[INFO] 10.244.0.5:34938 - 30611 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000093217s
[INFO] 10.244.0.5:34938 - 46642 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000122882s
[INFO] 10.244.0.5:54663 - 63435 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000087607s
[INFO] 10.244.0.5:42525 - 7957 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000219929s
[INFO] 10.244.0.5:54663 - 22185 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000050594s
[INFO] 10.244.0.5:54663 - 18649 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032152s
[INFO] 10.244.0.5:54663 - 11543 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000038589s
[INFO] 10.244.0.5:54663 - 36096 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000037115s
[INFO] 10.244.0.5:54663 - 2231 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000023362s
[INFO] 10.244.0.5:54663 - 1365 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000056542s
[INFO] 10.244.0.5:42525 - 30980 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000075911s
[INFO] 10.244.0.5:42525 - 45964 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000043517s
[INFO] 10.244.0.5:42525 - 13167 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000035947s
[INFO] 10.244.0.5:42525 - 15266 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000033183s
[INFO] 10.244.0.5:42525 - 10577 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000025513s
[INFO] 10.244.0.5:42525 - 187 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000036237s
==> describe nodes <==
Name: ingress-addon-legacy-791930
Roles: master
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ingress-addon-legacy-791930
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=ingress-addon-legacy-791930
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T03_29_24_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:29:21 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ingress-addon-legacy-791930
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:32:34 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:30:35 +0000 Wed, 14 Feb 2024 03:29:17 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:30:35 +0000 Wed, 14 Feb 2024 03:29:17 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:30:35 +0000 Wed, 14 Feb 2024 03:29:17 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:30:35 +0000 Wed, 14 Feb 2024 03:29:34 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.215
Hostname: ingress-addon-legacy-791930
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 4012800Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 4012800Ki
pods: 110
System Info:
Machine ID: 819e594084ae42ff811e131e045eecc1
System UUID: 819e5940-84ae-42ff-811e-131e045eecc1
Boot ID: 3f473e04-6509-49b2-bde7-efe2716adc34
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.18.20
Kube-Proxy Version: v1.18.20
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default hello-world-app-5f5d8b66bb-l7pz7 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12s
default nginx 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 2m32s
kube-system coredns-66bff467f8-rvhml 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (1%!)(MISSING) 170Mi (4%!)(MISSING) 3m1s
kube-system etcd-ingress-addon-legacy-791930 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m14s
kube-system kube-apiserver-ingress-addon-legacy-791930 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m14s
kube-system kube-controller-manager-ingress-addon-legacy-791930 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m14s
kube-system kube-proxy-t4jcn 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m1s
kube-system kube-scheduler-ingress-addon-legacy-791930 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m14s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 2m59s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 650m (32%!)(MISSING) 0 (0%!)(MISSING)
memory 70Mi (1%!)(MISSING) 170Mi (4%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 3m15s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 3m15s kubelet Node ingress-addon-legacy-791930 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 3m15s kubelet Node ingress-addon-legacy-791930 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 3m15s kubelet Node ingress-addon-legacy-791930 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 3m15s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 3m5s kubelet Node ingress-addon-legacy-791930 status is now: NodeReady
Normal Starting 2m59s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.098876] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.381919] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.399606] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.147397] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.008372] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[Feb14 03:29] systemd-fstab-generator[649]: Ignoring "noauto" for root device
[ +0.104828] systemd-fstab-generator[660]: Ignoring "noauto" for root device
[ +0.147211] systemd-fstab-generator[673]: Ignoring "noauto" for root device
[ +0.114385] systemd-fstab-generator[684]: Ignoring "noauto" for root device
[ +0.212244] systemd-fstab-generator[709]: Ignoring "noauto" for root device
[ +6.397243] systemd-fstab-generator[914]: Ignoring "noauto" for root device
[ +1.504548] systemd-fstab-generator[1077]: Ignoring "noauto" for root device
[ +3.178072] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[ +9.253650] systemd-fstab-generator[1486]: Ignoring "noauto" for root device
[ +15.317914] systemd-fstab-generator[1825]: Ignoring "noauto" for root device
[ +1.450354] kauditd_printk_skb: 6 callbacks suppressed
[ +5.052895] kauditd_printk_skb: 22 callbacks suppressed
[Feb14 03:30] kauditd_printk_skb: 12 callbacks suppressed
[Feb14 03:32] kauditd_printk_skb: 5 callbacks suppressed
[ +6.673284] kauditd_printk_skb: 5 callbacks suppressed
==> etcd [a3322c006f8f3c7909f27375d2e14a483881a8cd7edca2336cbed816dbf11827] <==
2024-02-14 03:29:17.640758 W | auth: simple token is not cryptographically signed
2024-02-14 03:29:17.644796 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
2024-02-14 03:29:17.648797 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file =
2024-02-14 03:29:17.648940 I | embed: listening for metrics on http://127.0.0.1:2381
2024-02-14 03:29:17.649189 I | embed: listening for peers on 192.168.39.215:2380
2024-02-14 03:29:17.649296 I | etcdserver: ce9e8f286885b37e as single-node; fast-forwarding 9 ticks (election ticks 10)
raft2024/02/14 03:29:17 INFO: ce9e8f286885b37e switched to configuration voters=(14888494821848494974)
2024-02-14 03:29:17.649626 I | etcdserver/membership: added member ce9e8f286885b37e [https://192.168.39.215:2380] to cluster 4cd5d1376c5e8c88
raft2024/02/14 03:29:17 INFO: ce9e8f286885b37e is starting a new election at term 1
raft2024/02/14 03:29:17 INFO: ce9e8f286885b37e became candidate at term 2
raft2024/02/14 03:29:17 INFO: ce9e8f286885b37e received MsgVoteResp from ce9e8f286885b37e at term 2
raft2024/02/14 03:29:17 INFO: ce9e8f286885b37e became leader at term 2
raft2024/02/14 03:29:17 INFO: raft.node: ce9e8f286885b37e elected leader ce9e8f286885b37e at term 2
2024-02-14 03:29:17.834435 I | etcdserver: setting up the initial cluster version to 3.4
2024-02-14 03:29:17.836061 N | etcdserver/membership: set the initial cluster version to 3.4
2024-02-14 03:29:17.836256 I | etcdserver/api: enabled capabilities for version 3.4
2024-02-14 03:29:17.836393 I | etcdserver: published {Name:ingress-addon-legacy-791930 ClientURLs:[https://192.168.39.215:2379]} to cluster 4cd5d1376c5e8c88
2024-02-14 03:29:17.836740 I | embed: ready to serve client requests
2024-02-14 03:29:17.838172 I | embed: serving client requests on 127.0.0.1:2379
2024-02-14 03:29:17.838356 I | embed: ready to serve client requests
2024-02-14 03:29:17.842734 I | embed: serving client requests on 192.168.39.215:2379
2024-02-14 03:29:40.619334 W | etcdserver: read-only range request "key:\"/registry/deployments/kube-system/coredns\" " with result "range_response_count:1 size:3907" took too long (458.731271ms) to execute
2024-02-14 03:29:40.619660 W | etcdserver: read-only range request "key:\"/registry/minions/ingress-addon-legacy-791930\" " with result "range_response_count:1 size:6296" took too long (458.828814ms) to execute
2024-02-14 03:29:40.620241 W | etcdserver: read-only range request "key:\"/registry/storageclasses/standard\" " with result "range_response_count:0 size:5" took too long (385.340377ms) to execute
2024-02-14 03:29:40.620351 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/storage-provisioner\" " with result "range_response_count:0 size:5" took too long (396.494286ms) to execute
==> kernel <==
03:32:39 up 3 min, 0 users, load average: 1.14, 0.75, 0.32
Linux ingress-addon-legacy-791930 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [a7cb86edd86412f0547c6758e135c3af51cd68ed2d329b6eea21e3cb270f3898] <==
I0214 03:29:21.081824 1 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/minikube/certs/ca.crt
I0214 03:29:21.081887 1 dynamic_cafile_content.go:167] Starting request-header::/var/lib/minikube/certs/front-proxy-ca.crt
I0214 03:29:21.128349 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0214 03:29:21.129462 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0214 03:29:21.129503 1 cache.go:39] Caches are synced for autoregister controller
I0214 03:29:21.137066 1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller
I0214 03:29:21.148228 1 shared_informer.go:230] Caches are synced for crd-autoregister
I0214 03:29:22.026485 1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0214 03:29:22.026796 1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0214 03:29:22.088055 1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
I0214 03:29:22.102050 1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
I0214 03:29:22.102086 1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
I0214 03:29:22.496017 1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0214 03:29:22.553270 1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0214 03:29:22.652122 1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.39.215]
I0214 03:29:22.652996 1 controller.go:609] quota admission added evaluator for: endpoints
I0214 03:29:22.656975 1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0214 03:29:23.370120 1 controller.go:609] quota admission added evaluator for: serviceaccounts
I0214 03:29:24.394569 1 controller.go:609] quota admission added evaluator for: deployments.apps
I0214 03:29:24.492053 1 controller.go:609] quota admission added evaluator for: daemonsets.apps
I0214 03:29:24.826157 1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
I0214 03:29:38.767590 1 controller.go:609] quota admission added evaluator for: replicasets.apps
I0214 03:29:38.846978 1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
I0214 03:29:45.499009 1 controller.go:609] quota admission added evaluator for: jobs.batch
I0214 03:30:07.073049 1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
==> kube-controller-manager [590b7cec98b0ab3bc3a00d43c3a052e628f1e1615df304263383747dd878ddc1] <==
W0214 03:29:39.088600 1 node_lifecycle_controller.go:1048] Missing timestamp for Node ingress-addon-legacy-791930. Assuming now as a timestamp.
I0214 03:29:39.088648 1 node_lifecycle_controller.go:1249] Controller detected that zone is now in state Normal.
I0214 03:29:39.088910 1 event.go:278] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"ingress-addon-legacy-791930", UID:"cf76468e-c371-4b2b-a94e-3de927b65bc8", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node ingress-addon-legacy-791930 event: Registered Node ingress-addon-legacy-791930 in Controller
I0214 03:29:39.088934 1 taint_manager.go:187] Starting NoExecuteTaintManager
I0214 03:29:39.282622 1 shared_informer.go:230] Caches are synced for PV protection
I0214 03:29:39.329304 1 shared_informer.go:230] Caches are synced for resource quota
I0214 03:29:39.342610 1 shared_informer.go:230] Caches are synced for PVC protection
I0214 03:29:39.344281 1 shared_informer.go:230] Caches are synced for attach detach
I0214 03:29:39.373756 1 shared_informer.go:230] Caches are synced for stateful set
I0214 03:29:39.373718 1 shared_informer.go:230] Caches are synced for expand
I0214 03:29:39.387223 1 shared_informer.go:230] Caches are synced for resource quota
I0214 03:29:39.408584 1 shared_informer.go:230] Caches are synced for persistent volume
I0214 03:29:39.422375 1 shared_informer.go:230] Caches are synced for garbage collector
I0214 03:29:39.422867 1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0214 03:29:39.423451 1 shared_informer.go:230] Caches are synced for garbage collector
I0214 03:29:40.715073 1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"27785a42-7882-48d8-a385-c85ef5c8eac6", APIVersion:"apps/v1", ResourceVersion:"357", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled down replica set coredns-66bff467f8 to 1
I0214 03:29:40.780547 1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"4a491a0e-adbd-4c5f-91cf-a490f158ea1d", APIVersion:"apps/v1", ResourceVersion:"359", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: coredns-66bff467f8-rz9n9
I0214 03:29:45.479086 1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"6bf1476f-8e5d-4ef4-9daa-f39552bea78f", APIVersion:"apps/v1", ResourceVersion:"439", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
I0214 03:29:45.506814 1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"0b8a3b91-488c-4eed-ac80-3adf5ab71fca", APIVersion:"apps/v1", ResourceVersion:"440", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-b8zfn
I0214 03:29:45.551520 1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"22c7770f-691c-4c7d-8c26-bb21ef56d8dd", APIVersion:"batch/v1", ResourceVersion:"444", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-vg7zm
I0214 03:29:45.644151 1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"988d74a8-6b0b-4d62-a49a-b3ee9964a042", APIVersion:"batch/v1", ResourceVersion:"456", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-l8dq5
I0214 03:29:49.076196 1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"22c7770f-691c-4c7d-8c26-bb21ef56d8dd", APIVersion:"batch/v1", ResourceVersion:"457", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
I0214 03:29:50.080390 1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"988d74a8-6b0b-4d62-a49a-b3ee9964a042", APIVersion:"batch/v1", ResourceVersion:"465", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
I0214 03:32:27.087341 1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"7ff5aac0-ba94-410f-be9d-4614748cfe1a", APIVersion:"apps/v1", ResourceVersion:"654", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
I0214 03:32:27.092327 1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"c28a696e-31c1-465c-bc42-fb319e31e274", APIVersion:"apps/v1", ResourceVersion:"655", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-l7pz7
==> kube-proxy [df8348629b3b02adb6417596ce53f4443980a3e4437271db1bb718df54454f1a] <==
W0214 03:29:40.921089 1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
I0214 03:29:40.945936 1 node.go:136] Successfully retrieved node IP: 192.168.39.215
I0214 03:29:40.946025 1 server_others.go:186] Using iptables Proxier.
I0214 03:29:40.952620 1 server.go:583] Version: v1.18.20
I0214 03:29:40.956794 1 config.go:133] Starting endpoints config controller
I0214 03:29:40.956905 1 shared_informer.go:223] Waiting for caches to sync for endpoints config
I0214 03:29:40.957064 1 config.go:315] Starting service config controller
I0214 03:29:40.957092 1 shared_informer.go:223] Waiting for caches to sync for service config
I0214 03:29:41.057210 1 shared_informer.go:230] Caches are synced for endpoints config
I0214 03:29:41.057374 1 shared_informer.go:230] Caches are synced for service config
==> kube-scheduler [72ff27fa71453be7ef9d1aa5193c8683e655ebb8552886d6a717e18185e6a050] <==
I0214 03:29:21.140212 1 registry.go:150] Registering EvenPodsSpread predicate and priority function
I0214 03:29:21.140476 1 registry.go:150] Registering EvenPodsSpread predicate and priority function
I0214 03:29:21.143040 1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
I0214 03:29:21.144322 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 03:29:21.144363 1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 03:29:21.144378 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0214 03:29:21.148533 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 03:29:21.148660 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 03:29:21.148856 1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 03:29:21.148941 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:29:21.149000 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 03:29:21.149043 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:29:21.149091 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 03:29:21.149203 1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 03:29:21.150827 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:29:21.150922 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 03:29:21.150975 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:29:21.151404 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 03:29:22.032757 1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 03:29:22.171181 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 03:29:22.208169 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:29:22.355067 1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 03:29:22.487649 1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0214 03:29:24.444912 1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0214 03:29:38.847929 1 factory.go:503] pod: kube-system/coredns-66bff467f8-rvhml is already present in the active queue
==> kubelet <==
-- Journal begins at Wed 2024-02-14 03:28:48 UTC, ends at Wed 2024-02-14 03:32:39 UTC. --
Feb 14 03:29:51 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:29:51.159241 1493 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-admission-token-68tj6" (UniqueName: "kubernetes.io/secret/8e9dd1ba-48a3-4f98-addc-fc966d3bcc33-ingress-nginx-admission-token-68tj6") pod "8e9dd1ba-48a3-4f98-addc-fc966d3bcc33" (UID: "8e9dd1ba-48a3-4f98-addc-fc966d3bcc33")
Feb 14 03:29:51 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:29:51.171855 1493 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9dd1ba-48a3-4f98-addc-fc966d3bcc33-ingress-nginx-admission-token-68tj6" (OuterVolumeSpecName: "ingress-nginx-admission-token-68tj6") pod "8e9dd1ba-48a3-4f98-addc-fc966d3bcc33" (UID: "8e9dd1ba-48a3-4f98-addc-fc966d3bcc33"). InnerVolumeSpecName "ingress-nginx-admission-token-68tj6". PluginName "kubernetes.io/secret", VolumeGidValue ""
Feb 14 03:29:51 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:29:51.259755 1493 reconciler.go:319] Volume detached for volume "ingress-nginx-admission-token-68tj6" (UniqueName: "kubernetes.io/secret/8e9dd1ba-48a3-4f98-addc-fc966d3bcc33-ingress-nginx-admission-token-68tj6") on node "ingress-addon-legacy-791930" DevicePath ""
Feb 14 03:29:58 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:29:58.281754 1493 topology_manager.go:235] [topologymanager] Topology Admit Handler
Feb 14 03:29:58 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:29:58.385314 1493 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "minikube-ingress-dns-token-9ggnc" (UniqueName: "kubernetes.io/secret/7bf42c47-698d-4ce8-9017-4f5a8b7d3162-minikube-ingress-dns-token-9ggnc") pod "kube-ingress-dns-minikube" (UID: "7bf42c47-698d-4ce8-9017-4f5a8b7d3162")
Feb 14 03:30:07 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:30:07.260430 1493 topology_manager.go:235] [topologymanager] Topology Admit Handler
Feb 14 03:30:07 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:30:07.324157 1493 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-xfdll" (UniqueName: "kubernetes.io/secret/4168ab41-56cf-45ea-aabc-86a9e34d65e3-default-token-xfdll") pod "nginx" (UID: "4168ab41-56cf-45ea-aabc-86a9e34d65e3")
Feb 14 03:32:27 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:27.097476 1493 topology_manager.go:235] [topologymanager] Topology Admit Handler
Feb 14 03:32:27 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:27.146591 1493 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-xfdll" (UniqueName: "kubernetes.io/secret/ccacc522-2fab-45ca-b855-bcfbb643d903-default-token-xfdll") pod "hello-world-app-5f5d8b66bb-l7pz7" (UID: "ccacc522-2fab-45ca-b855-bcfbb643d903")
Feb 14 03:32:28 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:28.966239 1493 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: b3e161373ee0ab5eead129660cebee99e929b9c0976dea887050f0380ba9eb5d
Feb 14 03:32:29 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:29.246179 1493 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: b3e161373ee0ab5eead129660cebee99e929b9c0976dea887050f0380ba9eb5d
Feb 14 03:32:29 ingress-addon-legacy-791930 kubelet[1493]: E0214 03:32:29.246625 1493 remote_runtime.go:295] ContainerStatus "b3e161373ee0ab5eead129660cebee99e929b9c0976dea887050f0380ba9eb5d" from runtime service failed: rpc error: code = NotFound desc = could not find container "b3e161373ee0ab5eead129660cebee99e929b9c0976dea887050f0380ba9eb5d": container with ID starting with b3e161373ee0ab5eead129660cebee99e929b9c0976dea887050f0380ba9eb5d not found: ID does not exist
Feb 14 03:32:30 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:30.055284 1493 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-9ggnc" (UniqueName: "kubernetes.io/secret/7bf42c47-698d-4ce8-9017-4f5a8b7d3162-minikube-ingress-dns-token-9ggnc") pod "7bf42c47-698d-4ce8-9017-4f5a8b7d3162" (UID: "7bf42c47-698d-4ce8-9017-4f5a8b7d3162")
Feb 14 03:32:30 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:30.059518 1493 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bf42c47-698d-4ce8-9017-4f5a8b7d3162-minikube-ingress-dns-token-9ggnc" (OuterVolumeSpecName: "minikube-ingress-dns-token-9ggnc") pod "7bf42c47-698d-4ce8-9017-4f5a8b7d3162" (UID: "7bf42c47-698d-4ce8-9017-4f5a8b7d3162"). InnerVolumeSpecName "minikube-ingress-dns-token-9ggnc". PluginName "kubernetes.io/secret", VolumeGidValue ""
Feb 14 03:32:30 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:30.155779 1493 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-9ggnc" (UniqueName: "kubernetes.io/secret/7bf42c47-698d-4ce8-9017-4f5a8b7d3162-minikube-ingress-dns-token-9ggnc") on node "ingress-addon-legacy-791930" DevicePath ""
Feb 14 03:32:31 ingress-addon-legacy-791930 kubelet[1493]: E0214 03:32:31.904548 1493 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-b8zfn.17b39d39034c5f2b", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-b8zfn", UID:"c9555e7e-1441-421b-84ff-bc0b640150a5", APIVersion:"v1", ResourceVersion:"447", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-791930"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc16b2af3f580092b, ext:187576334432, loc:(*time.Location)(0x701e5a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc16b2af3f580092b, ext:187576334432, loc:(*time.Location)(0x701e5a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-b8zfn.17b39d39034c5f2b" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
Feb 14 03:32:31 ingress-addon-legacy-791930 kubelet[1493]: E0214 03:32:31.923123 1493 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-b8zfn.17b39d39034c5f2b", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-b8zfn", UID:"c9555e7e-1441-421b-84ff-bc0b640150a5", APIVersion:"v1", ResourceVersion:"447", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-791930"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc16b2af3f580092b, ext:187576334432, loc:(*time.Location)(0x701e5a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc16b2af3f6bf5582, ext:187597259945, loc:(*time.Location)(0x701e5a0)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-b8zfn.17b39d39034c5f2b" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
Feb 14 03:32:34 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:34.167282 1493 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c9555e7e-1441-421b-84ff-bc0b640150a5-webhook-cert") pod "c9555e7e-1441-421b-84ff-bc0b640150a5" (UID: "c9555e7e-1441-421b-84ff-bc0b640150a5")
Feb 14 03:32:34 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:34.167349 1493 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-npksv" (UniqueName: "kubernetes.io/secret/c9555e7e-1441-421b-84ff-bc0b640150a5-ingress-nginx-token-npksv") pod "c9555e7e-1441-421b-84ff-bc0b640150a5" (UID: "c9555e7e-1441-421b-84ff-bc0b640150a5")
Feb 14 03:32:34 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:34.171803 1493 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9555e7e-1441-421b-84ff-bc0b640150a5-ingress-nginx-token-npksv" (OuterVolumeSpecName: "ingress-nginx-token-npksv") pod "c9555e7e-1441-421b-84ff-bc0b640150a5" (UID: "c9555e7e-1441-421b-84ff-bc0b640150a5"). InnerVolumeSpecName "ingress-nginx-token-npksv". PluginName "kubernetes.io/secret", VolumeGidValue ""
Feb 14 03:32:34 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:34.172184 1493 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9555e7e-1441-421b-84ff-bc0b640150a5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c9555e7e-1441-421b-84ff-bc0b640150a5" (UID: "c9555e7e-1441-421b-84ff-bc0b640150a5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
Feb 14 03:32:34 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:34.267613 1493 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c9555e7e-1441-421b-84ff-bc0b640150a5-webhook-cert") on node "ingress-addon-legacy-791930" DevicePath ""
Feb 14 03:32:34 ingress-addon-legacy-791930 kubelet[1493]: I0214 03:32:34.267638 1493 reconciler.go:319] Volume detached for volume "ingress-nginx-token-npksv" (UniqueName: "kubernetes.io/secret/c9555e7e-1441-421b-84ff-bc0b640150a5-ingress-nginx-token-npksv") on node "ingress-addon-legacy-791930" DevicePath ""
Feb 14 03:32:34 ingress-addon-legacy-791930 kubelet[1493]: W0214 03:32:34.986389 1493 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/c9555e7e-1441-421b-84ff-bc0b640150a5/volumes" does not exist
Feb 14 03:32:35 ingress-addon-legacy-791930 kubelet[1493]: W0214 03:32:35.001739 1493 pod_container_deletor.go:77] Container "196e805474e3832406a6dfc6463c6cd31b709d52a85ddbee73bcc36add8bd701" not found in pod's containers
==> storage-provisioner [6bddf8c3e45ce251f9ec83a65c3c167225d965366184f2d7872b13d843e11d1e] <==
I0214 03:29:41.702810 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 03:29:41.717840 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 03:29:41.717895 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 03:29:41.726644 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 03:29:41.728058 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8053783d-85bd-4b58-aeb7-5221a906cf4e", APIVersion:"v1", ResourceVersion:"392", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-791930_feffa12f-3d89-4206-9b8c-e9dc8db2633a became leader
I0214 03:29:41.729529 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-791930_feffa12f-3d89-4206-9b8c-e9dc8db2633a!
I0214 03:29:41.830648 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-791930_feffa12f-3d89-4206-9b8c-e9dc8db2633a!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p ingress-addon-legacy-791930 -n ingress-addon-legacy-791930
helpers_test.go:261: (dbg) Run: kubectl --context ingress-addon-legacy-791930 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (162.08s)
=== RUN TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-920904
multinode_test.go:321: (dbg) Run: out/minikube-linux-amd64 stop -p multinode-920904
E0214 03:41:13.611283 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
multinode_test.go:321: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p multinode-920904: exit status 82 (2m2.558126837s)
-- stdout --
* Stopping node "multinode-920904-m03" ...
* Stopping node "multinode-920904-m02" ...
-- /stdout --
** stderr **
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
multinode_test.go:323: failed to run minikube stop. args "out/minikube-linux-amd64 node list -p multinode-920904" : exit status 82
multinode_test.go:326: (dbg) Run: out/minikube-linux-amd64 start -p multinode-920904 --wait=true -v=8 --alsologtostderr
E0214 03:44:58.298506 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:45:56.223005 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
multinode_test.go:326: (dbg) Done: out/minikube-linux-amd64 start -p multinode-920904 --wait=true -v=8 --alsologtostderr: (3m7.182197054s)
multinode_test.go:331: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-920904
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p multinode-920904 -n multinode-920904
helpers_test.go:244: <<< TestMultiNode/serial/RestartKeepsNodes FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestMultiNode/serial/RestartKeepsNodes]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p multinode-920904 logs -n 25: (1.565957823s)
helpers_test.go:252: TestMultiNode/serial/RestartKeepsNodes logs:
-- stdout --
==> Audit <==
|---------|-----------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|-----------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m02:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /tmp/TestMultiNodeserialCopyFile142466148/001/cp-test_multinode-920904-m02.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m02:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904:/home/docker/cp-test_multinode-920904-m02_multinode-920904.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n multinode-920904 sudo cat | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /home/docker/cp-test_multinode-920904-m02_multinode-920904.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m02:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03:/home/docker/cp-test_multinode-920904-m02_multinode-920904-m03.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n multinode-920904-m03 sudo cat | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /home/docker/cp-test_multinode-920904-m02_multinode-920904-m03.txt | | | | | |
| cp | multinode-920904 cp testdata/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03:/home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /tmp/TestMultiNodeserialCopyFile142466148/001/cp-test_multinode-920904-m03.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904:/home/docker/cp-test_multinode-920904-m03_multinode-920904.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n multinode-920904 sudo cat | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /home/docker/cp-test_multinode-920904-m03_multinode-920904.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02:/home/docker/cp-test_multinode-920904-m03_multinode-920904-m02.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n multinode-920904-m02 sudo cat | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /home/docker/cp-test_multinode-920904-m03_multinode-920904-m02.txt | | | | | |
| node | multinode-920904 node stop m03 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| node | multinode-920904 node start | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | m03 -v=7 --alsologtostderr | | | | | |
| node | list -p multinode-920904 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | |
| stop | -p multinode-920904 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | |
| start | -p multinode-920904 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:43 UTC | 14 Feb 24 03:46 UTC |
| | --wait=true -v=8 | | | | | |
| | --alsologtostderr | | | | | |
| node | list -p multinode-920904 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:46 UTC | |
|---------|-----------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 03:43:00
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 03:43:00.734022 1521705 out.go:291] Setting OutFile to fd 1 ...
I0214 03:43:00.734271 1521705 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:43:00.734279 1521705 out.go:304] Setting ErrFile to fd 2...
I0214 03:43:00.734284 1521705 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:43:00.734466 1521705 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:43:00.735019 1521705 out.go:298] Setting JSON to false
I0214 03:43:00.736026 1521705 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":23128,"bootTime":1707859053,"procs":186,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:43:00.736088 1521705 start.go:138] virtualization: kvm guest
I0214 03:43:00.738761 1521705 out.go:177] * [multinode-920904] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 03:43:00.740634 1521705 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:43:00.742069 1521705 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:43:00.740687 1521705 notify.go:220] Checking for updates...
I0214 03:43:00.743673 1521705 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:43:00.745294 1521705 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:43:00.746735 1521705 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:43:00.748360 1521705 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:43:00.750166 1521705 config.go:182] Loaded profile config "multinode-920904": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:43:00.750254 1521705 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:43:00.750892 1521705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:43:00.750949 1521705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:43:00.765856 1521705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43039
I0214 03:43:00.766346 1521705 main.go:141] libmachine: () Calling .GetVersion
I0214 03:43:00.766979 1521705 main.go:141] libmachine: Using API Version 1
I0214 03:43:00.767003 1521705 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:43:00.767320 1521705 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:43:00.767516 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:43:00.802515 1521705 out.go:177] * Using the kvm2 driver based on existing profile
I0214 03:43:00.803945 1521705 start.go:296] selected driver: kvm2
I0214 03:43:00.803964 1521705 start.go:900] validating driver "kvm2" against &{Name:multinode-920904 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubern
etesVersion:v1.28.4 ClusterName:multinode-920904 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.169 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.100 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true} {Name:m03 IP:192.168.39.48 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingr
ess-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableO
ptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:43:00.804117 1521705 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:43:00.804465 1521705 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:43:00.804557 1521705 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 03:43:00.819152 1521705 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 03:43:00.820111 1521705 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:43:00.820193 1521705 cni.go:84] Creating CNI manager for ""
I0214 03:43:00.820211 1521705 cni.go:136] multinode detected (3 nodes found), recommending kindnet
I0214 03:43:00.820282 1521705 start.go:339] cluster config:
{Name:multinode-920904 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-920904 Namespace:default APIServerHA
VIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.169 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.100 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true} {Name:m03 IP:192.168.39.48 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false k
ong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMne
tClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:43:00.820446 1521705 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:43:00.824573 1521705 out.go:177] * Starting "multinode-920904" primary control-plane node in "multinode-920904" cluster
I0214 03:43:00.825925 1521705 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:43:00.825980 1521705 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 03:43:00.825993 1521705 cache.go:56] Caching tarball of preloaded images
I0214 03:43:00.826098 1521705 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:43:00.826112 1521705 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:43:00.826270 1521705 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/config.json ...
I0214 03:43:00.826502 1521705 start.go:360] acquireMachinesLock for multinode-920904: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:43:00.826574 1521705 start.go:364] duration metric: took 51.042µs to acquireMachinesLock for "multinode-920904"
I0214 03:43:00.826594 1521705 start.go:96] Skipping create...Using existing machine configuration
I0214 03:43:00.826601 1521705 fix.go:54] fixHost starting:
I0214 03:43:00.826891 1521705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:43:00.826929 1521705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:43:00.841173 1521705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38675
I0214 03:43:00.841641 1521705 main.go:141] libmachine: () Calling .GetVersion
I0214 03:43:00.842077 1521705 main.go:141] libmachine: Using API Version 1
I0214 03:43:00.842104 1521705 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:43:00.842431 1521705 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:43:00.842640 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:43:00.842770 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetState
I0214 03:43:00.844264 1521705 fix.go:112] recreateIfNeeded on multinode-920904: state=Running err=<nil>
W0214 03:43:00.844293 1521705 fix.go:138] unexpected machine state, will restart: <nil>
I0214 03:43:00.846376 1521705 out.go:177] * Updating the running kvm2 "multinode-920904" VM ...
I0214 03:43:00.847829 1521705 machine.go:94] provisionDockerMachine start ...
I0214 03:43:00.847851 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:43:00.848081 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:00.850815 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:00.851251 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:00.851305 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:00.851469 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:00.851646 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:00.851810 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:00.851973 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:00.852114 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:43:00.852458 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:43:00.852469 1521705 main.go:141] libmachine: About to run SSH command:
hostname
I0214 03:43:00.970771 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-920904
I0214 03:43:00.970812 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetMachineName
I0214 03:43:00.971114 1521705 buildroot.go:166] provisioning hostname "multinode-920904"
I0214 03:43:00.971161 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetMachineName
I0214 03:43:00.971390 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:00.974222 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:00.974667 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:00.974708 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:00.974929 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:00.975131 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:00.975280 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:00.975417 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:00.975526 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:43:00.975914 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:43:00.975933 1521705 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-920904 && echo "multinode-920904" | sudo tee /etc/hostname
I0214 03:43:01.099037 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-920904
I0214 03:43:01.099080 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:01.102072 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.102478 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.102509 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.102719 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:01.102923 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.103116 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.103244 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:01.103443 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:43:01.103791 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:43:01.103817 1521705 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-920904' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-920904/g' /etc/hosts;
else
echo '127.0.1.1 multinode-920904' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:43:01.214759 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:43:01.214790 1521705 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:43:01.214825 1521705 buildroot.go:174] setting up certificates
I0214 03:43:01.214843 1521705 provision.go:84] configureAuth start
I0214 03:43:01.214859 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetMachineName
I0214 03:43:01.215227 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetIP
I0214 03:43:01.218225 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.218581 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.218611 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.218782 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:01.221224 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.221597 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.221626 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.221763 1521705 provision.go:143] copyHostCerts
I0214 03:43:01.221795 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:43:01.221845 1521705 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:43:01.221857 1521705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:43:01.221935 1521705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:43:01.222029 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:43:01.222055 1521705 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:43:01.222063 1521705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:43:01.222105 1521705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:43:01.222232 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:43:01.222267 1521705 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:43:01.222277 1521705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:43:01.222319 1521705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:43:01.222419 1521705 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.multinode-920904 san=[127.0.0.1 192.168.39.169 localhost minikube multinode-920904]
I0214 03:43:01.427206 1521705 provision.go:177] copyRemoteCerts
I0214 03:43:01.427280 1521705 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:43:01.427307 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:01.430222 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.430609 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.430641 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.430759 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:01.430973 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.431142 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:01.431294 1521705 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:43:01.520347 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:43:01.520419 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:43:01.546316 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:43:01.546389 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
I0214 03:43:01.570124 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:43:01.570204 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 03:43:01.593565 1521705 provision.go:87] duration metric: took 378.702346ms to configureAuth
I0214 03:43:01.593602 1521705 buildroot.go:189] setting minikube options for container-runtime
I0214 03:43:01.593942 1521705 config.go:182] Loaded profile config "multinode-920904": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:43:01.594044 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:01.597065 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.597502 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.597555 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.597688 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:01.597918 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.598102 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.598281 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:01.598424 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:43:01.598787 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:43:01.598805 1521705 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:44:32.470872 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:44:32.470934 1521705 machine.go:97] duration metric: took 1m31.623078019s to provisionDockerMachine
I0214 03:44:32.470960 1521705 start.go:293] postStartSetup for "multinode-920904" (driver="kvm2")
I0214 03:44:32.470974 1521705 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:44:32.470999 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.471403 1521705 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:44:32.471445 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:44:32.474369 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.474808 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.474842 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.474946 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:44:32.475164 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.475328 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:44:32.475466 1521705 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:44:32.564320 1521705 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:44:32.568321 1521705 command_runner.go:130] > NAME=Buildroot
I0214 03:44:32.568341 1521705 command_runner.go:130] > VERSION=2021.02.12-1-g19d536a-dirty
I0214 03:44:32.568345 1521705 command_runner.go:130] > ID=buildroot
I0214 03:44:32.568351 1521705 command_runner.go:130] > VERSION_ID=2021.02.12
I0214 03:44:32.568357 1521705 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:44:32.568407 1521705 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:44:32.568428 1521705 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:44:32.568521 1521705 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:44:32.568632 1521705 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:44:32.568645 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:44:32.568729 1521705 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:44:32.577829 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:44:32.599895 1521705 start.go:296] duration metric: took 128.920961ms for postStartSetup
I0214 03:44:32.599937 1521705 fix.go:56] duration metric: took 1m31.773336339s for fixHost
I0214 03:44:32.599959 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:44:32.602679 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.603062 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.603095 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.603226 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:44:32.603423 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.603603 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.603778 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:44:32.603922 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:44:32.604271 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:44:32.604288 1521705 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:44:32.713858 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707882272.704244212
I0214 03:44:32.713885 1521705 fix.go:216] guest clock: 1707882272.704244212
I0214 03:44:32.713896 1521705 fix.go:229] Guest: 2024-02-14 03:44:32.704244212 +0000 UTC Remote: 2024-02-14 03:44:32.599941613 +0000 UTC m=+91.921500841 (delta=104.302599ms)
I0214 03:44:32.713922 1521705 fix.go:200] guest clock delta is within tolerance: 104.302599ms
I0214 03:44:32.713929 1521705 start.go:83] releasing machines lock for "multinode-920904", held for 1m31.887341851s
I0214 03:44:32.713972 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.714246 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetIP
I0214 03:44:32.717021 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.717425 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.717468 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.717677 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.718217 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.718401 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.718527 1521705 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:44:32.718585 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:44:32.718656 1521705 ssh_runner.go:195] Run: cat /version.json
I0214 03:44:32.718683 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:44:32.721277 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.721312 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.721660 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.721688 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.721728 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.721748 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.721816 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:44:32.721956 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:44:32.722029 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.722125 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.722248 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:44:32.722282 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:44:32.722534 1521705 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:44:32.722552 1521705 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:44:32.806773 1521705 command_runner.go:130] > {"iso_version": "v1.32.1-1703784139-17866", "kicbase_version": "v0.0.42-1703723663-17866", "minikube_version": "v1.32.0", "commit": "eb69424d8f623d7cabea57d4395ce87adf1b5fc3"}
I0214 03:44:32.806919 1521705 ssh_runner.go:195] Run: systemctl --version
I0214 03:44:32.841769 1521705 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0214 03:44:32.841821 1521705 command_runner.go:130] > systemd 247 (247)
I0214 03:44:32.841834 1521705 command_runner.go:130] > -PAM -AUDIT -SELINUX -IMA -APPARMOR -SMACK -SYSVINIT -UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ +LZ4 -ZSTD +SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid
I0214 03:44:32.841883 1521705 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:44:32.994210 1521705 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0214 03:44:33.006874 1521705 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0214 03:44:33.007232 1521705 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:44:33.007314 1521705 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:44:33.023268 1521705 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0214 03:44:33.023299 1521705 start.go:494] detecting cgroup driver to use...
I0214 03:44:33.023393 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:44:33.048684 1521705 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:44:33.060954 1521705 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:44:33.061026 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:44:33.073483 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:44:33.086206 1521705 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:44:33.236631 1521705 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:44:33.376765 1521705 docker.go:233] disabling docker service ...
I0214 03:44:33.376857 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:44:33.391995 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:44:33.404485 1521705 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:44:33.544518 1521705 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:44:33.686296 1521705 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:44:33.700850 1521705 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:44:33.718023 1521705 command_runner.go:130] > runtime-endpoint: unix:///var/run/crio/crio.sock
I0214 03:44:33.718074 1521705 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:44:33.718135 1521705 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:44:33.728191 1521705 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:44:33.728266 1521705 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:44:33.738292 1521705 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:44:33.747912 1521705 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:44:33.758327 1521705 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:44:33.769080 1521705 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:44:33.778359 1521705 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0214 03:44:33.778616 1521705 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:44:33.787785 1521705 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:44:33.926541 1521705 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:44:34.247365 1521705 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:44:34.247445 1521705 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:44:34.252744 1521705 command_runner.go:130] > File: /var/run/crio/crio.sock
I0214 03:44:34.252763 1521705 command_runner.go:130] > Size: 0 Blocks: 0 IO Block: 4096 socket
I0214 03:44:34.252770 1521705 command_runner.go:130] > Device: 16h/22d Inode: 1405 Links: 1
I0214 03:44:34.252776 1521705 command_runner.go:130] > Access: (0660/srw-rw----) Uid: ( 0/ root) Gid: ( 0/ root)
I0214 03:44:34.252781 1521705 command_runner.go:130] > Access: 2024-02-14 03:44:34.111384934 +0000
I0214 03:44:34.252787 1521705 command_runner.go:130] > Modify: 2024-02-14 03:44:34.090383650 +0000
I0214 03:44:34.252792 1521705 command_runner.go:130] > Change: 2024-02-14 03:44:34.090383650 +0000
I0214 03:44:34.252796 1521705 command_runner.go:130] > Birth: -
I0214 03:44:34.252871 1521705 start.go:562] Will wait 60s for crictl version
I0214 03:44:34.252943 1521705 ssh_runner.go:195] Run: which crictl
I0214 03:44:34.256442 1521705 command_runner.go:130] > /usr/bin/crictl
I0214 03:44:34.256809 1521705 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:44:34.295950 1521705 command_runner.go:130] > Version: 0.1.0
I0214 03:44:34.296046 1521705 command_runner.go:130] > RuntimeName: cri-o
I0214 03:44:34.296087 1521705 command_runner.go:130] > RuntimeVersion: 1.24.1
I0214 03:44:34.296102 1521705 command_runner.go:130] > RuntimeApiVersion: v1
I0214 03:44:34.296138 1521705 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:44:34.296229 1521705 ssh_runner.go:195] Run: crio --version
I0214 03:44:34.345588 1521705 command_runner.go:130] > crio version 1.24.1
I0214 03:44:34.345619 1521705 command_runner.go:130] > Version: 1.24.1
I0214 03:44:34.345631 1521705 command_runner.go:130] > GitCommit: a3bbde8a77c323aa6a485da9a9046299155c6016
I0214 03:44:34.345636 1521705 command_runner.go:130] > GitTreeState: dirty
I0214 03:44:34.345642 1521705 command_runner.go:130] > BuildDate: 2023-12-28T22:46:29Z
I0214 03:44:34.345659 1521705 command_runner.go:130] > GoVersion: go1.19.9
I0214 03:44:34.345667 1521705 command_runner.go:130] > Compiler: gc
I0214 03:44:34.345675 1521705 command_runner.go:130] > Platform: linux/amd64
I0214 03:44:34.345685 1521705 command_runner.go:130] > Linkmode: dynamic
I0214 03:44:34.345699 1521705 command_runner.go:130] > BuildTags: exclude_graphdriver_devicemapper, containers_image_ostree_stub, seccomp
I0214 03:44:34.345710 1521705 command_runner.go:130] > SeccompEnabled: true
I0214 03:44:34.345716 1521705 command_runner.go:130] > AppArmorEnabled: false
I0214 03:44:34.345832 1521705 ssh_runner.go:195] Run: crio --version
I0214 03:44:34.391599 1521705 command_runner.go:130] > crio version 1.24.1
I0214 03:44:34.391644 1521705 command_runner.go:130] > Version: 1.24.1
I0214 03:44:34.391665 1521705 command_runner.go:130] > GitCommit: a3bbde8a77c323aa6a485da9a9046299155c6016
I0214 03:44:34.391673 1521705 command_runner.go:130] > GitTreeState: dirty
I0214 03:44:34.391688 1521705 command_runner.go:130] > BuildDate: 2023-12-28T22:46:29Z
I0214 03:44:34.391702 1521705 command_runner.go:130] > GoVersion: go1.19.9
I0214 03:44:34.391711 1521705 command_runner.go:130] > Compiler: gc
I0214 03:44:34.391719 1521705 command_runner.go:130] > Platform: linux/amd64
I0214 03:44:34.391726 1521705 command_runner.go:130] > Linkmode: dynamic
I0214 03:44:34.391735 1521705 command_runner.go:130] > BuildTags: exclude_graphdriver_devicemapper, containers_image_ostree_stub, seccomp
I0214 03:44:34.391740 1521705 command_runner.go:130] > SeccompEnabled: true
I0214 03:44:34.391747 1521705 command_runner.go:130] > AppArmorEnabled: false
I0214 03:44:34.394930 1521705 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:44:34.396249 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetIP
I0214 03:44:34.398897 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:34.399286 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:34.399307 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:34.399561 1521705 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:44:34.403869 1521705 command_runner.go:130] > 192.168.39.1 host.minikube.internal
I0214 03:44:34.403956 1521705 kubeadm.go:877] updating cluster {Name:multinode-920904 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.
28.4 ClusterName:multinode-920904 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.169 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.100 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true} {Name:m03 IP:192.168.39.48 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:fal
se inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimization
s:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 03:44:34.404071 1521705 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:44:34.404113 1521705 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:44:34.453379 1521705 command_runner.go:130] > {
I0214 03:44:34.453401 1521705 command_runner.go:130] > "images": [
I0214 03:44:34.453405 1521705 command_runner.go:130] > {
I0214 03:44:34.453415 1521705 command_runner.go:130] > "id": "c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc",
I0214 03:44:34.453421 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453429 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd:v20230809-80a64d96"
I0214 03:44:34.453432 1521705 command_runner.go:130] > ],
I0214 03:44:34.453437 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.453454 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052",
I0214 03:44:34.453476 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"
I0214 03:44:34.453483 1521705 command_runner.go:130] > ],
I0214 03:44:34.453487 1521705 command_runner.go:130] > "size": "65258016",
I0214 03:44:34.453492 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.453496 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.453504 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.453510 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.453514 1521705 command_runner.go:130] > },
I0214 03:44:34.453520 1521705 command_runner.go:130] > {
I0214 03:44:34.453529 1521705 command_runner.go:130] > "id": "8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a",
I0214 03:44:34.453540 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453553 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox:1.28"
I0214 03:44:34.453562 1521705 command_runner.go:130] > ],
I0214 03:44:34.453570 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.453580 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335",
I0214 03:44:34.453590 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12"
I0214 03:44:34.453597 1521705 command_runner.go:130] > ],
I0214 03:44:34.453603 1521705 command_runner.go:130] > "size": "1363676",
I0214 03:44:34.453610 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.453622 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.453633 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.453644 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.453653 1521705 command_runner.go:130] > },
I0214 03:44:34.453661 1521705 command_runner.go:130] > {
I0214 03:44:34.453667 1521705 command_runner.go:130] > "id": "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562",
I0214 03:44:34.453674 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453679 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner:v5"
I0214 03:44:34.453685 1521705 command_runner.go:130] > ],
I0214 03:44:34.453690 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.453699 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944",
I0214 03:44:34.453715 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"
I0214 03:44:34.453725 1521705 command_runner.go:130] > ],
I0214 03:44:34.453736 1521705 command_runner.go:130] > "size": "31470524",
I0214 03:44:34.453745 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.453755 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.453770 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.453778 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.453781 1521705 command_runner.go:130] > },
I0214 03:44:34.453787 1521705 command_runner.go:130] > {
I0214 03:44:34.453798 1521705 command_runner.go:130] > "id": "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc",
I0214 03:44:34.453808 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453819 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns:v1.10.1"
I0214 03:44:34.453828 1521705 command_runner.go:130] > ],
I0214 03:44:34.453836 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.453851 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e",
I0214 03:44:34.453871 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"
I0214 03:44:34.453880 1521705 command_runner.go:130] > ],
I0214 03:44:34.453890 1521705 command_runner.go:130] > "size": "53621675",
I0214 03:44:34.453901 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.453911 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.453921 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.453931 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.453940 1521705 command_runner.go:130] > },
I0214 03:44:34.453951 1521705 command_runner.go:130] > {
I0214 03:44:34.453960 1521705 command_runner.go:130] > "id": "73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9",
I0214 03:44:34.453970 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453982 1521705 command_runner.go:130] > "registry.k8s.io/etcd:3.5.9-0"
I0214 03:44:34.453992 1521705 command_runner.go:130] > ],
I0214 03:44:34.454002 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454017 1521705 command_runner.go:130] > "registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15",
I0214 03:44:34.454031 1521705 command_runner.go:130] > "registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"
I0214 03:44:34.454040 1521705 command_runner.go:130] > ],
I0214 03:44:34.454048 1521705 command_runner.go:130] > "size": "295456551",
I0214 03:44:34.454052 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454062 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.454072 1521705 command_runner.go:130] > },
I0214 03:44:34.454082 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454092 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454101 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454110 1521705 command_runner.go:130] > },
I0214 03:44:34.454119 1521705 command_runner.go:130] > {
I0214 03:44:34.454135 1521705 command_runner.go:130] > "id": "7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257",
I0214 03:44:34.454144 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454157 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver:v1.28.4"
I0214 03:44:34.454167 1521705 command_runner.go:130] > ],
I0214 03:44:34.454177 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454192 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499",
I0214 03:44:34.454207 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"
I0214 03:44:34.454216 1521705 command_runner.go:130] > ],
I0214 03:44:34.454223 1521705 command_runner.go:130] > "size": "127226832",
I0214 03:44:34.454259 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454278 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.454284 1521705 command_runner.go:130] > },
I0214 03:44:34.454292 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454302 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454309 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454314 1521705 command_runner.go:130] > },
I0214 03:44:34.454322 1521705 command_runner.go:130] > {
I0214 03:44:34.454336 1521705 command_runner.go:130] > "id": "d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591",
I0214 03:44:34.454349 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454362 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager:v1.28.4"
I0214 03:44:34.454371 1521705 command_runner.go:130] > ],
I0214 03:44:34.454382 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454395 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c",
I0214 03:44:34.454409 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"
I0214 03:44:34.454415 1521705 command_runner.go:130] > ],
I0214 03:44:34.454424 1521705 command_runner.go:130] > "size": "123261750",
I0214 03:44:34.454433 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454443 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.454452 1521705 command_runner.go:130] > },
I0214 03:44:34.454462 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454476 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454482 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454487 1521705 command_runner.go:130] > },
I0214 03:44:34.454495 1521705 command_runner.go:130] > {
I0214 03:44:34.454510 1521705 command_runner.go:130] > "id": "83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e",
I0214 03:44:34.454520 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454535 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy:v1.28.4"
I0214 03:44:34.454544 1521705 command_runner.go:130] > ],
I0214 03:44:34.454553 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454584 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e",
I0214 03:44:34.454599 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"
I0214 03:44:34.454605 1521705 command_runner.go:130] > ],
I0214 03:44:34.454616 1521705 command_runner.go:130] > "size": "74749335",
I0214 03:44:34.454629 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.454636 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454643 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454650 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454659 1521705 command_runner.go:130] > },
I0214 03:44:34.454666 1521705 command_runner.go:130] > {
I0214 03:44:34.454679 1521705 command_runner.go:130] > "id": "e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1",
I0214 03:44:34.454686 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454696 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler:v1.28.4"
I0214 03:44:34.454703 1521705 command_runner.go:130] > ],
I0214 03:44:34.454722 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454741 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba",
I0214 03:44:34.454753 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"
I0214 03:44:34.454758 1521705 command_runner.go:130] > ],
I0214 03:44:34.454765 1521705 command_runner.go:130] > "size": "61551410",
I0214 03:44:34.454772 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454783 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.454789 1521705 command_runner.go:130] > },
I0214 03:44:34.454800 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454807 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454817 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454823 1521705 command_runner.go:130] > },
I0214 03:44:34.454829 1521705 command_runner.go:130] > {
I0214 03:44:34.454838 1521705 command_runner.go:130] > "id": "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c",
I0214 03:44:34.454842 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454848 1521705 command_runner.go:130] > "registry.k8s.io/pause:3.9"
I0214 03:44:34.454854 1521705 command_runner.go:130] > ],
I0214 03:44:34.454866 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454878 1521705 command_runner.go:130] > "registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097",
I0214 03:44:34.454896 1521705 command_runner.go:130] > "registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"
I0214 03:44:34.454906 1521705 command_runner.go:130] > ],
I0214 03:44:34.454913 1521705 command_runner.go:130] > "size": "750414",
I0214 03:44:34.454920 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454927 1521705 command_runner.go:130] > "value": "65535"
I0214 03:44:34.454931 1521705 command_runner.go:130] > },
I0214 03:44:34.454938 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454949 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454960 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454969 1521705 command_runner.go:130] > }
I0214 03:44:34.454977 1521705 command_runner.go:130] > ]
I0214 03:44:34.454986 1521705 command_runner.go:130] > }
I0214 03:44:34.455254 1521705 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:44:34.455268 1521705 crio.go:415] Images already preloaded, skipping extraction
I0214 03:44:34.455328 1521705 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:44:34.489344 1521705 command_runner.go:130] > {
I0214 03:44:34.489372 1521705 command_runner.go:130] > "images": [
I0214 03:44:34.489376 1521705 command_runner.go:130] > {
I0214 03:44:34.489384 1521705 command_runner.go:130] > "id": "c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc",
I0214 03:44:34.489390 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.489395 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd:v20230809-80a64d96"
I0214 03:44:34.489399 1521705 command_runner.go:130] > ],
I0214 03:44:34.489403 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.489414 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052",
I0214 03:44:34.489431 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"
I0214 03:44:34.489440 1521705 command_runner.go:130] > ],
I0214 03:44:34.489451 1521705 command_runner.go:130] > "size": "65258016",
I0214 03:44:34.489459 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.489464 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.489478 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.489485 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.489489 1521705 command_runner.go:130] > },
I0214 03:44:34.489494 1521705 command_runner.go:130] > {
I0214 03:44:34.489504 1521705 command_runner.go:130] > "id": "8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a",
I0214 03:44:34.489515 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.489527 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox:1.28"
I0214 03:44:34.489535 1521705 command_runner.go:130] > ],
I0214 03:44:34.489546 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.489561 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335",
I0214 03:44:34.489570 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12"
I0214 03:44:34.489576 1521705 command_runner.go:130] > ],
I0214 03:44:34.489581 1521705 command_runner.go:130] > "size": "1363676",
I0214 03:44:34.489590 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.489610 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.489625 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.489632 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.489641 1521705 command_runner.go:130] > },
I0214 03:44:34.489654 1521705 command_runner.go:130] > {
I0214 03:44:34.489664 1521705 command_runner.go:130] > "id": "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562",
I0214 03:44:34.489673 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.489685 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner:v5"
I0214 03:44:34.489699 1521705 command_runner.go:130] > ],
I0214 03:44:34.489710 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.489726 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944",
I0214 03:44:34.489741 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"
I0214 03:44:34.489748 1521705 command_runner.go:130] > ],
I0214 03:44:34.489752 1521705 command_runner.go:130] > "size": "31470524",
I0214 03:44:34.489762 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.489773 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.489783 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.489793 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.489802 1521705 command_runner.go:130] > },
I0214 03:44:34.489811 1521705 command_runner.go:130] > {
I0214 03:44:34.489824 1521705 command_runner.go:130] > "id": "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc",
I0214 03:44:34.489832 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.489844 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns:v1.10.1"
I0214 03:44:34.489853 1521705 command_runner.go:130] > ],
I0214 03:44:34.489861 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.489877 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e",
I0214 03:44:34.489901 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"
I0214 03:44:34.489910 1521705 command_runner.go:130] > ],
I0214 03:44:34.489919 1521705 command_runner.go:130] > "size": "53621675",
I0214 03:44:34.489924 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.489933 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.489944 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.489955 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.489963 1521705 command_runner.go:130] > },
I0214 03:44:34.489985 1521705 command_runner.go:130] > {
I0214 03:44:34.489998 1521705 command_runner.go:130] > "id": "73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9",
I0214 03:44:34.490083 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490106 1521705 command_runner.go:130] > "registry.k8s.io/etcd:3.5.9-0"
I0214 03:44:34.490117 1521705 command_runner.go:130] > ],
I0214 03:44:34.490128 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490161 1521705 command_runner.go:130] > "registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15",
I0214 03:44:34.490179 1521705 command_runner.go:130] > "registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"
I0214 03:44:34.490190 1521705 command_runner.go:130] > ],
I0214 03:44:34.490202 1521705 command_runner.go:130] > "size": "295456551",
I0214 03:44:34.490213 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.490225 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.490235 1521705 command_runner.go:130] > },
I0214 03:44:34.490245 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.490256 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.490268 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.490279 1521705 command_runner.go:130] > },
I0214 03:44:34.490290 1521705 command_runner.go:130] > {
I0214 03:44:34.490313 1521705 command_runner.go:130] > "id": "7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257",
I0214 03:44:34.490323 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490335 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver:v1.28.4"
I0214 03:44:34.490346 1521705 command_runner.go:130] > ],
I0214 03:44:34.490358 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490375 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499",
I0214 03:44:34.490406 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"
I0214 03:44:34.490415 1521705 command_runner.go:130] > ],
I0214 03:44:34.490424 1521705 command_runner.go:130] > "size": "127226832",
I0214 03:44:34.490436 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.490448 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.490459 1521705 command_runner.go:130] > },
I0214 03:44:34.490470 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.490479 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.490491 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.490500 1521705 command_runner.go:130] > },
I0214 03:44:34.490504 1521705 command_runner.go:130] > {
I0214 03:44:34.490516 1521705 command_runner.go:130] > "id": "d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591",
I0214 03:44:34.490529 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490539 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager:v1.28.4"
I0214 03:44:34.490546 1521705 command_runner.go:130] > ],
I0214 03:44:34.490555 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490578 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c",
I0214 03:44:34.490596 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"
I0214 03:44:34.490607 1521705 command_runner.go:130] > ],
I0214 03:44:34.490620 1521705 command_runner.go:130] > "size": "123261750",
I0214 03:44:34.490628 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.490640 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.490651 1521705 command_runner.go:130] > },
I0214 03:44:34.490659 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.490670 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.490677 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.490689 1521705 command_runner.go:130] > },
I0214 03:44:34.490700 1521705 command_runner.go:130] > {
I0214 03:44:34.490711 1521705 command_runner.go:130] > "id": "83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e",
I0214 03:44:34.490724 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490737 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy:v1.28.4"
I0214 03:44:34.490748 1521705 command_runner.go:130] > ],
I0214 03:44:34.490759 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490803 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e",
I0214 03:44:34.490821 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"
I0214 03:44:34.490832 1521705 command_runner.go:130] > ],
I0214 03:44:34.490849 1521705 command_runner.go:130] > "size": "74749335",
I0214 03:44:34.490861 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.490872 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.490882 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.490892 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.490902 1521705 command_runner.go:130] > },
I0214 03:44:34.490913 1521705 command_runner.go:130] > {
I0214 03:44:34.490928 1521705 command_runner.go:130] > "id": "e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1",
I0214 03:44:34.490940 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490953 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler:v1.28.4"
I0214 03:44:34.490964 1521705 command_runner.go:130] > ],
I0214 03:44:34.490979 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490992 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba",
I0214 03:44:34.491009 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"
I0214 03:44:34.491021 1521705 command_runner.go:130] > ],
I0214 03:44:34.491033 1521705 command_runner.go:130] > "size": "61551410",
I0214 03:44:34.491045 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.491056 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.491149 1521705 command_runner.go:130] > },
I0214 03:44:34.491173 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.491180 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.491191 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.491200 1521705 command_runner.go:130] > },
I0214 03:44:34.491209 1521705 command_runner.go:130] > {
I0214 03:44:34.491223 1521705 command_runner.go:130] > "id": "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c",
I0214 03:44:34.491233 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.491244 1521705 command_runner.go:130] > "registry.k8s.io/pause:3.9"
I0214 03:44:34.491252 1521705 command_runner.go:130] > ],
I0214 03:44:34.491256 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.491271 1521705 command_runner.go:130] > "registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097",
I0214 03:44:34.491296 1521705 command_runner.go:130] > "registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"
I0214 03:44:34.491305 1521705 command_runner.go:130] > ],
I0214 03:44:34.491315 1521705 command_runner.go:130] > "size": "750414",
I0214 03:44:34.491325 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.491340 1521705 command_runner.go:130] > "value": "65535"
I0214 03:44:34.491348 1521705 command_runner.go:130] > },
I0214 03:44:34.491363 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.491374 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.491385 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.491406 1521705 command_runner.go:130] > }
I0214 03:44:34.491415 1521705 command_runner.go:130] > ]
I0214 03:44:34.491423 1521705 command_runner.go:130] > }
I0214 03:44:34.491595 1521705 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:44:34.491610 1521705 cache_images.go:84] Images are preloaded, skipping loading
I0214 03:44:34.491618 1521705 kubeadm.go:928] updating node { 192.168.39.169 8443 v1.28.4 crio true true} ...
I0214 03:44:34.491773 1521705 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=multinode-920904 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.169
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:multinode-920904 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:44:34.491863 1521705 ssh_runner.go:195] Run: crio config
I0214 03:44:34.551661 1521705 command_runner.go:130] > # The CRI-O configuration file specifies all of the available configuration
I0214 03:44:34.551689 1521705 command_runner.go:130] > # options and command-line flags for the crio(8) OCI Kubernetes Container Runtime
I0214 03:44:34.551704 1521705 command_runner.go:130] > # daemon, but in a TOML format that can be more easily modified and versioned.
I0214 03:44:34.551707 1521705 command_runner.go:130] > #
I0214 03:44:34.551730 1521705 command_runner.go:130] > # Please refer to crio.conf(5) for details of all configuration options.
I0214 03:44:34.551742 1521705 command_runner.go:130] > # CRI-O supports partial configuration reload during runtime, which can be
I0214 03:44:34.551756 1521705 command_runner.go:130] > # done by sending SIGHUP to the running process. Currently supported options
I0214 03:44:34.551770 1521705 command_runner.go:130] > # are explicitly mentioned with: 'This option supports live configuration
I0214 03:44:34.551776 1521705 command_runner.go:130] > # reload'.
I0214 03:44:34.551785 1521705 command_runner.go:130] > # CRI-O reads its storage defaults from the containers-storage.conf(5) file
I0214 03:44:34.551796 1521705 command_runner.go:130] > # located at /etc/containers/storage.conf. Modify this storage configuration if
I0214 03:44:34.551808 1521705 command_runner.go:130] > # you want to change the system's defaults. If you want to modify storage just
I0214 03:44:34.551818 1521705 command_runner.go:130] > # for CRI-O, you can change the storage configuration options here.
I0214 03:44:34.551832 1521705 command_runner.go:130] > [crio]
I0214 03:44:34.551838 1521705 command_runner.go:130] > # Path to the "root directory". CRI-O stores all of its data, including
I0214 03:44:34.551843 1521705 command_runner.go:130] > # containers images, in this directory.
I0214 03:44:34.551849 1521705 command_runner.go:130] > root = "/var/lib/containers/storage"
I0214 03:44:34.551863 1521705 command_runner.go:130] > # Path to the "run directory". CRI-O stores all of its state in this directory.
I0214 03:44:34.551994 1521705 command_runner.go:130] > runroot = "/var/run/containers/storage"
I0214 03:44:34.552021 1521705 command_runner.go:130] > # Storage driver used to manage the storage of images and containers. Please
I0214 03:44:34.552032 1521705 command_runner.go:130] > # refer to containers-storage.conf(5) to see all available storage drivers.
I0214 03:44:34.552144 1521705 command_runner.go:130] > storage_driver = "overlay"
I0214 03:44:34.552165 1521705 command_runner.go:130] > # List to pass options to the storage driver. Please refer to
I0214 03:44:34.552176 1521705 command_runner.go:130] > # containers-storage.conf(5) to see all available storage options.
I0214 03:44:34.552197 1521705 command_runner.go:130] > storage_option = [
I0214 03:44:34.552479 1521705 command_runner.go:130] > "overlay.mountopt=nodev,metacopy=on",
I0214 03:44:34.552582 1521705 command_runner.go:130] > ]
I0214 03:44:34.552594 1521705 command_runner.go:130] > # The default log directory where all logs will go unless directly specified by
I0214 03:44:34.552603 1521705 command_runner.go:130] > # the kubelet. The log directory specified must be an absolute directory.
I0214 03:44:34.553124 1521705 command_runner.go:130] > # log_dir = "/var/log/crio/pods"
I0214 03:44:34.553135 1521705 command_runner.go:130] > # Location for CRI-O to lay down the temporary version file.
I0214 03:44:34.553140 1521705 command_runner.go:130] > # It is used to check if crio wipe should wipe containers, which should
I0214 03:44:34.553145 1521705 command_runner.go:130] > # always happen on a node reboot
I0214 03:44:34.553548 1521705 command_runner.go:130] > # version_file = "/var/run/crio/version"
I0214 03:44:34.553560 1521705 command_runner.go:130] > # Location for CRI-O to lay down the persistent version file.
I0214 03:44:34.553570 1521705 command_runner.go:130] > # It is used to check if crio wipe should wipe images, which should
I0214 03:44:34.553587 1521705 command_runner.go:130] > # only happen when CRI-O has been upgraded
I0214 03:44:34.553879 1521705 command_runner.go:130] > # version_file_persist = "/var/lib/crio/version"
I0214 03:44:34.553889 1521705 command_runner.go:130] > # InternalWipe is whether CRI-O should wipe containers and images after a reboot when the server starts.
I0214 03:44:34.553900 1521705 command_runner.go:130] > # If set to false, one must use the external command 'crio wipe' to wipe the containers and images in these situations.
I0214 03:44:34.554207 1521705 command_runner.go:130] > # internal_wipe = true
I0214 03:44:34.554215 1521705 command_runner.go:130] > # Location for CRI-O to lay down the clean shutdown file.
I0214 03:44:34.554221 1521705 command_runner.go:130] > # It is used to check whether crio had time to sync before shutting down.
I0214 03:44:34.554230 1521705 command_runner.go:130] > # If not found, crio wipe will clear the storage directory.
I0214 03:44:34.554631 1521705 command_runner.go:130] > # clean_shutdown_file = "/var/lib/crio/clean.shutdown"
I0214 03:44:34.554640 1521705 command_runner.go:130] > # The crio.api table contains settings for the kubelet/gRPC interface.
I0214 03:44:34.554649 1521705 command_runner.go:130] > [crio.api]
I0214 03:44:34.554658 1521705 command_runner.go:130] > # Path to AF_LOCAL socket on which CRI-O will listen.
I0214 03:44:34.554930 1521705 command_runner.go:130] > # listen = "/var/run/crio/crio.sock"
I0214 03:44:34.554939 1521705 command_runner.go:130] > # IP address on which the stream server will listen.
I0214 03:44:34.555275 1521705 command_runner.go:130] > # stream_address = "127.0.0.1"
I0214 03:44:34.555286 1521705 command_runner.go:130] > # The port on which the stream server will listen. If the port is set to "0", then
I0214 03:44:34.555293 1521705 command_runner.go:130] > # CRI-O will allocate a random free port number.
I0214 03:44:34.555755 1521705 command_runner.go:130] > # stream_port = "0"
I0214 03:44:34.555764 1521705 command_runner.go:130] > # Enable encrypted TLS transport of the stream server.
I0214 03:44:34.555861 1521705 command_runner.go:130] > # stream_enable_tls = false
I0214 03:44:34.555879 1521705 command_runner.go:130] > # Length of time until open streams terminate due to lack of activity
I0214 03:44:34.555888 1521705 command_runner.go:130] > # stream_idle_timeout = ""
I0214 03:44:34.555900 1521705 command_runner.go:130] > # Path to the x509 certificate file used to serve the encrypted stream. This
I0214 03:44:34.555914 1521705 command_runner.go:130] > # file can change, and CRI-O will automatically pick up the changes within 5
I0214 03:44:34.555922 1521705 command_runner.go:130] > # minutes.
I0214 03:44:34.555933 1521705 command_runner.go:130] > # stream_tls_cert = ""
I0214 03:44:34.555944 1521705 command_runner.go:130] > # Path to the key file used to serve the encrypted stream. This file can
I0214 03:44:34.555964 1521705 command_runner.go:130] > # change and CRI-O will automatically pick up the changes within 5 minutes.
I0214 03:44:34.555996 1521705 command_runner.go:130] > # stream_tls_key = ""
I0214 03:44:34.556011 1521705 command_runner.go:130] > # Path to the x509 CA(s) file used to verify and authenticate client
I0214 03:44:34.556026 1521705 command_runner.go:130] > # communication with the encrypted stream. This file can change and CRI-O will
I0214 03:44:34.556039 1521705 command_runner.go:130] > # automatically pick up the changes within 5 minutes.
I0214 03:44:34.556051 1521705 command_runner.go:130] > # stream_tls_ca = ""
I0214 03:44:34.556068 1521705 command_runner.go:130] > # Maximum grpc send message size in bytes. If not set or <=0, then CRI-O will default to 16 * 1024 * 1024.
I0214 03:44:34.556079 1521705 command_runner.go:130] > grpc_max_send_msg_size = 16777216
I0214 03:44:34.556096 1521705 command_runner.go:130] > # Maximum grpc receive message size. If not set or <= 0, then CRI-O will default to 16 * 1024 * 1024.
I0214 03:44:34.556108 1521705 command_runner.go:130] > grpc_max_recv_msg_size = 16777216
I0214 03:44:34.556140 1521705 command_runner.go:130] > # The crio.runtime table contains settings pertaining to the OCI runtime used
I0214 03:44:34.556153 1521705 command_runner.go:130] > # and options for how to set up and manage the OCI runtime.
I0214 03:44:34.556164 1521705 command_runner.go:130] > [crio.runtime]
I0214 03:44:34.556178 1521705 command_runner.go:130] > # A list of ulimits to be set in containers by default, specified as
I0214 03:44:34.556191 1521705 command_runner.go:130] > # "<ulimit name>=<soft limit>:<hard limit>", for example:
I0214 03:44:34.556201 1521705 command_runner.go:130] > # "nofile=1024:2048"
I0214 03:44:34.556213 1521705 command_runner.go:130] > # If nothing is set here, settings will be inherited from the CRI-O daemon
I0214 03:44:34.556224 1521705 command_runner.go:130] > # default_ulimits = [
I0214 03:44:34.556233 1521705 command_runner.go:130] > # ]
I0214 03:44:34.556248 1521705 command_runner.go:130] > # If true, the runtime will not use pivot_root, but instead use MS_MOVE.
I0214 03:44:34.556260 1521705 command_runner.go:130] > # no_pivot = false
I0214 03:44:34.556273 1521705 command_runner.go:130] > # decryption_keys_path is the path where the keys required for
I0214 03:44:34.556285 1521705 command_runner.go:130] > # image decryption are stored. This option supports live configuration reload.
I0214 03:44:34.556297 1521705 command_runner.go:130] > # decryption_keys_path = "/etc/crio/keys/"
I0214 03:44:34.556311 1521705 command_runner.go:130] > # Path to the conmon binary, used for monitoring the OCI runtime.
I0214 03:44:34.556324 1521705 command_runner.go:130] > # Will be searched for using $PATH if empty.
I0214 03:44:34.556339 1521705 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorEnv.
I0214 03:44:34.556355 1521705 command_runner.go:130] > conmon = "/usr/libexec/crio/conmon"
I0214 03:44:34.556367 1521705 command_runner.go:130] > # Cgroup setting for conmon
I0214 03:44:34.556381 1521705 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorCgroup.
I0214 03:44:34.556392 1521705 command_runner.go:130] > conmon_cgroup = "pod"
I0214 03:44:34.556405 1521705 command_runner.go:130] > # Environment variable list for the conmon process, used for passing necessary
I0214 03:44:34.556417 1521705 command_runner.go:130] > # environment variables to conmon or the runtime.
I0214 03:44:34.556438 1521705 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorEnv.
I0214 03:44:34.556447 1521705 command_runner.go:130] > conmon_env = [
I0214 03:44:34.556459 1521705 command_runner.go:130] > "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
I0214 03:44:34.556467 1521705 command_runner.go:130] > ]
I0214 03:44:34.556489 1521705 command_runner.go:130] > # Additional environment variables to set for all the
I0214 03:44:34.556502 1521705 command_runner.go:130] > # containers. These are overridden if set in the
I0214 03:44:34.556515 1521705 command_runner.go:130] > # container image spec or in the container runtime configuration.
I0214 03:44:34.556526 1521705 command_runner.go:130] > # default_env = [
I0214 03:44:34.556535 1521705 command_runner.go:130] > # ]
I0214 03:44:34.556546 1521705 command_runner.go:130] > # If true, SELinux will be used for pod separation on the host.
I0214 03:44:34.556555 1521705 command_runner.go:130] > # selinux = false
I0214 03:44:34.556567 1521705 command_runner.go:130] > # Path to the seccomp.json profile which is used as the default seccomp profile
I0214 03:44:34.556582 1521705 command_runner.go:130] > # for the runtime. If not specified, then the internal default seccomp profile
I0214 03:44:34.556595 1521705 command_runner.go:130] > # will be used. This option supports live configuration reload.
I0214 03:44:34.556606 1521705 command_runner.go:130] > # seccomp_profile = ""
I0214 03:44:34.556618 1521705 command_runner.go:130] > # Changes the meaning of an empty seccomp profile. By default
I0214 03:44:34.556631 1521705 command_runner.go:130] > # (and according to CRI spec), an empty profile means unconfined.
I0214 03:44:34.556645 1521705 command_runner.go:130] > # This option tells CRI-O to treat an empty profile as the default profile,
I0214 03:44:34.556656 1521705 command_runner.go:130] > # which might increase security.
I0214 03:44:34.556668 1521705 command_runner.go:130] > seccomp_use_default_when_empty = false
I0214 03:44:34.556683 1521705 command_runner.go:130] > # Used to change the name of the default AppArmor profile of CRI-O. The default
I0214 03:44:34.556697 1521705 command_runner.go:130] > # profile name is "crio-default". This profile only takes effect if the user
I0214 03:44:34.556714 1521705 command_runner.go:130] > # does not specify a profile via the Kubernetes Pod's metadata annotation. If
I0214 03:44:34.556729 1521705 command_runner.go:130] > # the profile is set to "unconfined", then this equals to disabling AppArmor.
I0214 03:44:34.556740 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.556749 1521705 command_runner.go:130] > # apparmor_profile = "crio-default"
I0214 03:44:34.556763 1521705 command_runner.go:130] > # Path to the blockio class configuration file for configuring
I0214 03:44:34.556774 1521705 command_runner.go:130] > # the cgroup blockio controller.
I0214 03:44:34.556788 1521705 command_runner.go:130] > # blockio_config_file = ""
I0214 03:44:34.556803 1521705 command_runner.go:130] > # Used to change irqbalance service config file path which is used for configuring
I0214 03:44:34.556814 1521705 command_runner.go:130] > # irqbalance daemon.
I0214 03:44:34.556824 1521705 command_runner.go:130] > # irqbalance_config_file = "/etc/sysconfig/irqbalance"
I0214 03:44:34.556839 1521705 command_runner.go:130] > # Path to the RDT configuration file for configuring the resctrl pseudo-filesystem.
I0214 03:44:34.556851 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.556862 1521705 command_runner.go:130] > # rdt_config_file = ""
I0214 03:44:34.556873 1521705 command_runner.go:130] > # Cgroup management implementation used for the runtime.
I0214 03:44:34.556885 1521705 command_runner.go:130] > cgroup_manager = "cgroupfs"
I0214 03:44:34.556899 1521705 command_runner.go:130] > # Specify whether the image pull must be performed in a separate cgroup.
I0214 03:44:34.556910 1521705 command_runner.go:130] > # separate_pull_cgroup = ""
I0214 03:44:34.556922 1521705 command_runner.go:130] > # List of default capabilities for containers. If it is empty or commented out,
I0214 03:44:34.556940 1521705 command_runner.go:130] > # only the capabilities defined in the containers json file by the user/kube
I0214 03:44:34.556951 1521705 command_runner.go:130] > # will be added.
I0214 03:44:34.556961 1521705 command_runner.go:130] > # default_capabilities = [
I0214 03:44:34.556971 1521705 command_runner.go:130] > # "CHOWN",
I0214 03:44:34.556980 1521705 command_runner.go:130] > # "DAC_OVERRIDE",
I0214 03:44:34.556990 1521705 command_runner.go:130] > # "FSETID",
I0214 03:44:34.557000 1521705 command_runner.go:130] > # "FOWNER",
I0214 03:44:34.557007 1521705 command_runner.go:130] > # "SETGID",
I0214 03:44:34.557017 1521705 command_runner.go:130] > # "SETUID",
I0214 03:44:34.557026 1521705 command_runner.go:130] > # "SETPCAP",
I0214 03:44:34.557036 1521705 command_runner.go:130] > # "NET_BIND_SERVICE",
I0214 03:44:34.557043 1521705 command_runner.go:130] > # "KILL",
I0214 03:44:34.557050 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557063 1521705 command_runner.go:130] > # List of default sysctls. If it is empty or commented out, only the sysctls
I0214 03:44:34.557076 1521705 command_runner.go:130] > # defined in the container json file by the user/kube will be added.
I0214 03:44:34.557087 1521705 command_runner.go:130] > # default_sysctls = [
I0214 03:44:34.557096 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557105 1521705 command_runner.go:130] > # List of devices on the host that a
I0214 03:44:34.557126 1521705 command_runner.go:130] > # user can specify with the "io.kubernetes.cri-o.Devices" allowed annotation.
I0214 03:44:34.557136 1521705 command_runner.go:130] > # allowed_devices = [
I0214 03:44:34.557144 1521705 command_runner.go:130] > # "/dev/fuse",
I0214 03:44:34.557154 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557163 1521705 command_runner.go:130] > # List of additional devices. specified as
I0214 03:44:34.557180 1521705 command_runner.go:130] > # "<device-on-host>:<device-on-container>:<permissions>", for example: "--device=/dev/sdc:/dev/xvdc:rwm".
I0214 03:44:34.557193 1521705 command_runner.go:130] > # If it is empty or commented out, only the devices
I0214 03:44:34.557237 1521705 command_runner.go:130] > # defined in the container json file by the user/kube will be added.
I0214 03:44:34.557248 1521705 command_runner.go:130] > # additional_devices = [
I0214 03:44:34.557267 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557281 1521705 command_runner.go:130] > # List of directories to scan for CDI Spec files.
I0214 03:44:34.557291 1521705 command_runner.go:130] > # cdi_spec_dirs = [
I0214 03:44:34.557299 1521705 command_runner.go:130] > # "/etc/cdi",
I0214 03:44:34.557310 1521705 command_runner.go:130] > # "/var/run/cdi",
I0214 03:44:34.557319 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557331 1521705 command_runner.go:130] > # Change the default behavior of setting container devices uid/gid from CRI's
I0214 03:44:34.557345 1521705 command_runner.go:130] > # SecurityContext (RunAsUser/RunAsGroup) instead of taking host's uid/gid.
I0214 03:44:34.557355 1521705 command_runner.go:130] > # Defaults to false.
I0214 03:44:34.557370 1521705 command_runner.go:130] > # device_ownership_from_security_context = false
I0214 03:44:34.557384 1521705 command_runner.go:130] > # Path to OCI hooks directories for automatically executed hooks. If one of the
I0214 03:44:34.557398 1521705 command_runner.go:130] > # directories does not exist, then CRI-O will automatically skip them.
I0214 03:44:34.557408 1521705 command_runner.go:130] > # hooks_dir = [
I0214 03:44:34.557421 1521705 command_runner.go:130] > # "/usr/share/containers/oci/hooks.d",
I0214 03:44:34.557435 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557449 1521705 command_runner.go:130] > # Path to the file specifying the defaults mounts for each container. The
I0214 03:44:34.557463 1521705 command_runner.go:130] > # format of the config is /SRC:/DST, one mount per line. Notice that CRI-O reads
I0214 03:44:34.557476 1521705 command_runner.go:130] > # its default mounts from the following two files:
I0214 03:44:34.557486 1521705 command_runner.go:130] > #
I0214 03:44:34.557498 1521705 command_runner.go:130] > # 1) /etc/containers/mounts.conf (i.e., default_mounts_file): This is the
I0214 03:44:34.557513 1521705 command_runner.go:130] > # override file, where users can either add in their own default mounts, or
I0214 03:44:34.557527 1521705 command_runner.go:130] > # override the default mounts shipped with the package.
I0214 03:44:34.557536 1521705 command_runner.go:130] > #
I0214 03:44:34.557548 1521705 command_runner.go:130] > # 2) /usr/share/containers/mounts.conf: This is the default file read for
I0214 03:44:34.557561 1521705 command_runner.go:130] > # mounts. If you want CRI-O to read from a different, specific mounts file,
I0214 03:44:34.557574 1521705 command_runner.go:130] > # you can change the default_mounts_file. Note, if this is done, CRI-O will
I0214 03:44:34.557586 1521705 command_runner.go:130] > # only add mounts it finds in this file.
I0214 03:44:34.557599 1521705 command_runner.go:130] > #
I0214 03:44:34.557610 1521705 command_runner.go:130] > # default_mounts_file = ""
I0214 03:44:34.557626 1521705 command_runner.go:130] > # Maximum number of processes allowed in a container.
I0214 03:44:34.557641 1521705 command_runner.go:130] > # This option is deprecated. The Kubelet flag '--pod-pids-limit' should be used instead.
I0214 03:44:34.557651 1521705 command_runner.go:130] > pids_limit = 1024
I0214 03:44:34.557666 1521705 command_runner.go:130] > # Maximum sized allowed for the container log file. Negative numbers indicate
I0214 03:44:34.557678 1521705 command_runner.go:130] > # that no size limit is imposed. If it is positive, it must be >= 8192 to
I0214 03:44:34.557693 1521705 command_runner.go:130] > # match/exceed conmon's read buffer. The file is truncated and re-opened so the
I0214 03:44:34.557710 1521705 command_runner.go:130] > # limit is never exceeded. This option is deprecated. The Kubelet flag '--container-log-max-size' should be used instead.
I0214 03:44:34.557720 1521705 command_runner.go:130] > # log_size_max = -1
I0214 03:44:34.557736 1521705 command_runner.go:130] > # Whether container output should be logged to journald in addition to the kuberentes log file
I0214 03:44:34.557746 1521705 command_runner.go:130] > # log_to_journald = false
I0214 03:44:34.557758 1521705 command_runner.go:130] > # Path to directory in which container exit files are written to by conmon.
I0214 03:44:34.557770 1521705 command_runner.go:130] > # container_exits_dir = "/var/run/crio/exits"
I0214 03:44:34.557783 1521705 command_runner.go:130] > # Path to directory for container attach sockets.
I0214 03:44:34.557796 1521705 command_runner.go:130] > # container_attach_socket_dir = "/var/run/crio"
I0214 03:44:34.557809 1521705 command_runner.go:130] > # The prefix to use for the source of the bind mounts.
I0214 03:44:34.557820 1521705 command_runner.go:130] > # bind_mount_prefix = ""
I0214 03:44:34.557835 1521705 command_runner.go:130] > # If set to true, all containers will run in read-only mode.
I0214 03:44:34.557845 1521705 command_runner.go:130] > # read_only = false
I0214 03:44:34.557857 1521705 command_runner.go:130] > # Changes the verbosity of the logs based on the level it is set to. Options
I0214 03:44:34.557871 1521705 command_runner.go:130] > # are fatal, panic, error, warn, info, debug and trace. This option supports
I0214 03:44:34.557882 1521705 command_runner.go:130] > # live configuration reload.
I0214 03:44:34.557891 1521705 command_runner.go:130] > # log_level = "info"
I0214 03:44:34.557904 1521705 command_runner.go:130] > # Filter the log messages by the provided regular expression.
I0214 03:44:34.557919 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.557929 1521705 command_runner.go:130] > # log_filter = ""
I0214 03:44:34.557940 1521705 command_runner.go:130] > # The UID mappings for the user namespace of each container. A range is
I0214 03:44:34.557954 1521705 command_runner.go:130] > # specified in the form containerUID:HostUID:Size. Multiple ranges must be
I0214 03:44:34.557963 1521705 command_runner.go:130] > # separated by comma.
I0214 03:44:34.557974 1521705 command_runner.go:130] > # uid_mappings = ""
I0214 03:44:34.557988 1521705 command_runner.go:130] > # The GID mappings for the user namespace of each container. A range is
I0214 03:44:34.558002 1521705 command_runner.go:130] > # specified in the form containerGID:HostGID:Size. Multiple ranges must be
I0214 03:44:34.558012 1521705 command_runner.go:130] > # separated by comma.
I0214 03:44:34.558022 1521705 command_runner.go:130] > # gid_mappings = ""
I0214 03:44:34.558035 1521705 command_runner.go:130] > # If set, CRI-O will reject any attempt to map host UIDs below this value
I0214 03:44:34.558052 1521705 command_runner.go:130] > # into user namespaces. A negative value indicates that no minimum is set,
I0214 03:44:34.558066 1521705 command_runner.go:130] > # so specifying mappings will only be allowed for pods that run as UID 0.
I0214 03:44:34.558082 1521705 command_runner.go:130] > # minimum_mappable_uid = -1
I0214 03:44:34.558096 1521705 command_runner.go:130] > # If set, CRI-O will reject any attempt to map host GIDs below this value
I0214 03:44:34.558110 1521705 command_runner.go:130] > # into user namespaces. A negative value indicates that no minimum is set,
I0214 03:44:34.558124 1521705 command_runner.go:130] > # so specifying mappings will only be allowed for pods that run as UID 0.
I0214 03:44:34.558135 1521705 command_runner.go:130] > # minimum_mappable_gid = -1
I0214 03:44:34.558149 1521705 command_runner.go:130] > # The minimal amount of time in seconds to wait before issuing a timeout
I0214 03:44:34.558163 1521705 command_runner.go:130] > # regarding the proper termination of the container. The lowest possible
I0214 03:44:34.558177 1521705 command_runner.go:130] > # value is 30s, whereas lower values are not considered by CRI-O.
I0214 03:44:34.558187 1521705 command_runner.go:130] > # ctr_stop_timeout = 30
I0214 03:44:34.558199 1521705 command_runner.go:130] > # drop_infra_ctr determines whether CRI-O drops the infra container
I0214 03:44:34.558212 1521705 command_runner.go:130] > # when a pod does not have a private PID namespace, and does not use
I0214 03:44:34.558224 1521705 command_runner.go:130] > # a kernel separating runtime (like kata).
I0214 03:44:34.558237 1521705 command_runner.go:130] > # It requires manage_ns_lifecycle to be true.
I0214 03:44:34.558247 1521705 command_runner.go:130] > drop_infra_ctr = false
I0214 03:44:34.558259 1521705 command_runner.go:130] > # infra_ctr_cpuset determines what CPUs will be used to run infra containers.
I0214 03:44:34.558272 1521705 command_runner.go:130] > # You can use linux CPU list format to specify desired CPUs.
I0214 03:44:34.558292 1521705 command_runner.go:130] > # To get better isolation for guaranteed pods, set this parameter to be equal to kubelet reserved-cpus.
I0214 03:44:34.558303 1521705 command_runner.go:130] > # infra_ctr_cpuset = ""
I0214 03:44:34.558317 1521705 command_runner.go:130] > # The directory where the state of the managed namespaces gets tracked.
I0214 03:44:34.558329 1521705 command_runner.go:130] > # Only used when manage_ns_lifecycle is true.
I0214 03:44:34.558339 1521705 command_runner.go:130] > # namespaces_dir = "/var/run"
I0214 03:44:34.558352 1521705 command_runner.go:130] > # pinns_path is the path to find the pinns binary, which is needed to manage namespace lifecycle
I0214 03:44:34.558363 1521705 command_runner.go:130] > pinns_path = "/usr/bin/pinns"
I0214 03:44:34.558375 1521705 command_runner.go:130] > # default_runtime is the _name_ of the OCI runtime to be used as the default.
I0214 03:44:34.558389 1521705 command_runner.go:130] > # The name is matched against the runtimes map below. If this value is changed,
I0214 03:44:34.558404 1521705 command_runner.go:130] > # the corresponding existing entry from the runtimes map below will be ignored.
I0214 03:44:34.558415 1521705 command_runner.go:130] > # default_runtime = "runc"
I0214 03:44:34.558432 1521705 command_runner.go:130] > # A list of paths that, when absent from the host,
I0214 03:44:34.558449 1521705 command_runner.go:130] > # will cause a container creation to fail (as opposed to the current behavior being created as a directory).
I0214 03:44:34.558468 1521705 command_runner.go:130] > # This option is to protect from source locations whose existence as a directory could jepordize the health of the node, and whose
I0214 03:44:34.558480 1521705 command_runner.go:130] > # creation as a file is not desired either.
I0214 03:44:34.558498 1521705 command_runner.go:130] > # An example is /etc/hostname, which will cause failures on reboot if it's created as a directory, but often doesn't exist because
I0214 03:44:34.558510 1521705 command_runner.go:130] > # the hostname is being managed dynamically.
I0214 03:44:34.558518 1521705 command_runner.go:130] > # absent_mount_sources_to_reject = [
I0214 03:44:34.558531 1521705 command_runner.go:130] > # ]
I0214 03:44:34.558545 1521705 command_runner.go:130] > # The "crio.runtime.runtimes" table defines a list of OCI compatible runtimes.
I0214 03:44:34.558560 1521705 command_runner.go:130] > # The runtime to use is picked based on the runtime handler provided by the CRI.
I0214 03:44:34.558575 1521705 command_runner.go:130] > # If no runtime handler is provided, the runtime will be picked based on the level
I0214 03:44:34.558589 1521705 command_runner.go:130] > # of trust of the workload. Each entry in the table should follow the format:
I0214 03:44:34.558597 1521705 command_runner.go:130] > #
I0214 03:44:34.558606 1521705 command_runner.go:130] > #[crio.runtime.runtimes.runtime-handler]
I0214 03:44:34.558618 1521705 command_runner.go:130] > # runtime_path = "/path/to/the/executable"
I0214 03:44:34.558629 1521705 command_runner.go:130] > # runtime_type = "oci"
I0214 03:44:34.558639 1521705 command_runner.go:130] > # runtime_root = "/path/to/the/root"
I0214 03:44:34.558651 1521705 command_runner.go:130] > # privileged_without_host_devices = false
I0214 03:44:34.558662 1521705 command_runner.go:130] > # allowed_annotations = []
I0214 03:44:34.558672 1521705 command_runner.go:130] > # Where:
I0214 03:44:34.558684 1521705 command_runner.go:130] > # - runtime-handler: name used to identify the runtime
I0214 03:44:34.558698 1521705 command_runner.go:130] > # - runtime_path (optional, string): absolute path to the runtime executable in
I0214 03:44:34.558712 1521705 command_runner.go:130] > # the host filesystem. If omitted, the runtime-handler identifier should match
I0214 03:44:34.558727 1521705 command_runner.go:130] > # the runtime executable name, and the runtime executable should be placed
I0214 03:44:34.558737 1521705 command_runner.go:130] > # in $PATH.
I0214 03:44:34.558755 1521705 command_runner.go:130] > # - runtime_type (optional, string): type of runtime, one of: "oci", "vm". If
I0214 03:44:34.558791 1521705 command_runner.go:130] > # omitted, an "oci" runtime is assumed.
I0214 03:44:34.558808 1521705 command_runner.go:130] > # - runtime_root (optional, string): root directory for storage of containers
I0214 03:44:34.558818 1521705 command_runner.go:130] > # state.
I0214 03:44:34.558833 1521705 command_runner.go:130] > # - runtime_config_path (optional, string): the path for the runtime configuration
I0214 03:44:34.558847 1521705 command_runner.go:130] > # file. This can only be used with when using the VM runtime_type.
I0214 03:44:34.558860 1521705 command_runner.go:130] > # - privileged_without_host_devices (optional, bool): an option for restricting
I0214 03:44:34.558875 1521705 command_runner.go:130] > # host devices from being passed to privileged containers.
I0214 03:44:34.558889 1521705 command_runner.go:130] > # - allowed_annotations (optional, array of strings): an option for specifying
I0214 03:44:34.558904 1521705 command_runner.go:130] > # a list of experimental annotations that this runtime handler is allowed to process.
I0214 03:44:34.558916 1521705 command_runner.go:130] > # The currently recognized values are:
I0214 03:44:34.558931 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.userns-mode" for configuring a user namespace for the pod.
I0214 03:44:34.558948 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.cgroup2-mount-hierarchy-rw" for mounting cgroups writably when set to "true".
I0214 03:44:34.558962 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.Devices" for configuring devices for the pod.
I0214 03:44:34.558976 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.ShmSize" for configuring the size of /dev/shm.
I0214 03:44:34.558992 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.UnifiedCgroup.$CTR_NAME" for configuring the cgroup v2 unified block for a container.
I0214 03:44:34.559007 1521705 command_runner.go:130] > # "io.containers.trace-syscall" for tracing syscalls via the OCI seccomp BPF hook.
I0214 03:44:34.559027 1521705 command_runner.go:130] > # "io.kubernetes.cri.rdt-class" for setting the RDT class of a container
I0214 03:44:34.559045 1521705 command_runner.go:130] > # - monitor_exec_cgroup (optional, string): if set to "container", indicates exec probes
I0214 03:44:34.559057 1521705 command_runner.go:130] > # should be moved to the container's cgroup
I0214 03:44:34.559069 1521705 command_runner.go:130] > [crio.runtime.runtimes.runc]
I0214 03:44:34.559080 1521705 command_runner.go:130] > runtime_path = "/usr/bin/runc"
I0214 03:44:34.559088 1521705 command_runner.go:130] > runtime_type = "oci"
I0214 03:44:34.559099 1521705 command_runner.go:130] > runtime_root = "/run/runc"
I0214 03:44:34.559108 1521705 command_runner.go:130] > runtime_config_path = ""
I0214 03:44:34.559118 1521705 command_runner.go:130] > monitor_path = ""
I0214 03:44:34.559129 1521705 command_runner.go:130] > monitor_cgroup = ""
I0214 03:44:34.559139 1521705 command_runner.go:130] > monitor_exec_cgroup = ""
I0214 03:44:34.559153 1521705 command_runner.go:130] > # crun is a fast and lightweight fully featured OCI runtime and C library for
I0214 03:44:34.559164 1521705 command_runner.go:130] > # running containers
I0214 03:44:34.559173 1521705 command_runner.go:130] > #[crio.runtime.runtimes.crun]
I0214 03:44:34.559188 1521705 command_runner.go:130] > # Kata Containers is an OCI runtime, where containers are run inside lightweight
I0214 03:44:34.559269 1521705 command_runner.go:130] > # VMs. Kata provides additional isolation towards the host, minimizing the host attack
I0214 03:44:34.559283 1521705 command_runner.go:130] > # surface and mitigating the consequences of containers breakout.
I0214 03:44:34.559291 1521705 command_runner.go:130] > # Kata Containers with the default configured VMM
I0214 03:44:34.559300 1521705 command_runner.go:130] > #[crio.runtime.runtimes.kata-runtime]
I0214 03:44:34.559315 1521705 command_runner.go:130] > # Kata Containers with the QEMU VMM
I0214 03:44:34.559327 1521705 command_runner.go:130] > #[crio.runtime.runtimes.kata-qemu]
I0214 03:44:34.559340 1521705 command_runner.go:130] > # Kata Containers with the Firecracker VMM
I0214 03:44:34.559351 1521705 command_runner.go:130] > #[crio.runtime.runtimes.kata-fc]
I0214 03:44:34.559369 1521705 command_runner.go:130] > # The workloads table defines ways to customize containers with different resources
I0214 03:44:34.559382 1521705 command_runner.go:130] > # that work based on annotations, rather than the CRI.
I0214 03:44:34.559393 1521705 command_runner.go:130] > # Note, the behavior of this table is EXPERIMENTAL and may change at any time.
I0214 03:44:34.559410 1521705 command_runner.go:130] > # Each workload, has a name, activation_annotation, annotation_prefix and set of resources it supports mutating.
I0214 03:44:34.559431 1521705 command_runner.go:130] > # The currently supported resources are "cpu" (to configure the cpu shares) and "cpuset" to configure the cpuset.
I0214 03:44:34.559444 1521705 command_runner.go:130] > # Each resource can have a default value specified, or be empty.
I0214 03:44:34.559463 1521705 command_runner.go:130] > # For a container to opt-into this workload, the pod should be configured with the annotation $activation_annotation (key only, value is ignored).
I0214 03:44:34.559480 1521705 command_runner.go:130] > # To customize per-container, an annotation of the form $annotation_prefix.$resource/$ctrName = "value" can be specified
I0214 03:44:34.559494 1521705 command_runner.go:130] > # signifying for that resource type to override the default value.
I0214 03:44:34.559510 1521705 command_runner.go:130] > # If the annotation_prefix is not present, every container in the pod will be given the default values.
I0214 03:44:34.559521 1521705 command_runner.go:130] > # Example:
I0214 03:44:34.559532 1521705 command_runner.go:130] > # [crio.runtime.workloads.workload-type]
I0214 03:44:34.559545 1521705 command_runner.go:130] > # activation_annotation = "io.crio/workload"
I0214 03:44:34.559557 1521705 command_runner.go:130] > # annotation_prefix = "io.crio.workload-type"
I0214 03:44:34.559573 1521705 command_runner.go:130] > # [crio.runtime.workloads.workload-type.resources]
I0214 03:44:34.559584 1521705 command_runner.go:130] > # cpuset = 0
I0214 03:44:34.559594 1521705 command_runner.go:130] > # cpushares = "0-1"
I0214 03:44:34.559603 1521705 command_runner.go:130] > # Where:
I0214 03:44:34.559614 1521705 command_runner.go:130] > # The workload name is workload-type.
I0214 03:44:34.559630 1521705 command_runner.go:130] > # To specify, the pod must have the "io.crio.workload" annotation (this is a precise string match).
I0214 03:44:34.559644 1521705 command_runner.go:130] > # This workload supports setting cpuset and cpu resources.
I0214 03:44:34.559656 1521705 command_runner.go:130] > # annotation_prefix is used to customize the different resources.
I0214 03:44:34.559671 1521705 command_runner.go:130] > # To configure the cpu shares a container gets in the example above, the pod would have to have the following annotation:
I0214 03:44:34.559685 1521705 command_runner.go:130] > # "io.crio.workload-type/$container_name = {"cpushares": "value"}"
I0214 03:44:34.559694 1521705 command_runner.go:130] > #
I0214 03:44:34.559707 1521705 command_runner.go:130] > # The crio.image table contains settings pertaining to the management of OCI images.
I0214 03:44:34.559715 1521705 command_runner.go:130] > #
I0214 03:44:34.559727 1521705 command_runner.go:130] > # CRI-O reads its configured registries defaults from the system wide
I0214 03:44:34.559741 1521705 command_runner.go:130] > # containers-registries.conf(5) located in /etc/containers/registries.conf. If
I0214 03:44:34.559755 1521705 command_runner.go:130] > # you want to modify just CRI-O, you can change the registries configuration in
I0214 03:44:34.559770 1521705 command_runner.go:130] > # this file. Otherwise, leave insecure_registries and registries commented out to
I0214 03:44:34.559784 1521705 command_runner.go:130] > # use the system's defaults from /etc/containers/registries.conf.
I0214 03:44:34.559798 1521705 command_runner.go:130] > [crio.image]
I0214 03:44:34.559812 1521705 command_runner.go:130] > # Default transport for pulling images from a remote container storage.
I0214 03:44:34.559824 1521705 command_runner.go:130] > # default_transport = "docker://"
I0214 03:44:34.559841 1521705 command_runner.go:130] > # The path to a file containing credentials necessary for pulling images from
I0214 03:44:34.559860 1521705 command_runner.go:130] > # secure registries. The file is similar to that of /var/lib/kubelet/config.json
I0214 03:44:34.559870 1521705 command_runner.go:130] > # global_auth_file = ""
I0214 03:44:34.559879 1521705 command_runner.go:130] > # The image used to instantiate infra containers.
I0214 03:44:34.559892 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.559904 1521705 command_runner.go:130] > pause_image = "registry.k8s.io/pause:3.9"
I0214 03:44:34.559919 1521705 command_runner.go:130] > # The path to a file containing credentials specific for pulling the pause_image from
I0214 03:44:34.559933 1521705 command_runner.go:130] > # above. The file is similar to that of /var/lib/kubelet/config.json
I0214 03:44:34.559946 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.559956 1521705 command_runner.go:130] > # pause_image_auth_file = ""
I0214 03:44:34.559968 1521705 command_runner.go:130] > # The command to run to have a container stay in the paused state.
I0214 03:44:34.559982 1521705 command_runner.go:130] > # When explicitly set to "", it will fallback to the entrypoint and command
I0214 03:44:34.559995 1521705 command_runner.go:130] > # specified in the pause image. When commented out, it will fallback to the
I0214 03:44:34.560009 1521705 command_runner.go:130] > # default: "/pause". This option supports live configuration reload.
I0214 03:44:34.560021 1521705 command_runner.go:130] > # pause_command = "/pause"
I0214 03:44:34.560038 1521705 command_runner.go:130] > # Path to the file which decides what sort of policy we use when deciding
I0214 03:44:34.560052 1521705 command_runner.go:130] > # whether or not to trust an image that we've pulled. It is not recommended that
I0214 03:44:34.560067 1521705 command_runner.go:130] > # this option be used, as the default behavior of using the system-wide default
I0214 03:44:34.560081 1521705 command_runner.go:130] > # policy (i.e., /etc/containers/policy.json) is most often preferred. Please
I0214 03:44:34.560094 1521705 command_runner.go:130] > # refer to containers-policy.json(5) for more details.
I0214 03:44:34.560105 1521705 command_runner.go:130] > # signature_policy = ""
I0214 03:44:34.560119 1521705 command_runner.go:130] > # List of registries to skip TLS verification for pulling images. Please
I0214 03:44:34.560133 1521705 command_runner.go:130] > # consider configuring the registries via /etc/containers/registries.conf before
I0214 03:44:34.560143 1521705 command_runner.go:130] > # changing them here.
I0214 03:44:34.560154 1521705 command_runner.go:130] > # insecure_registries = [
I0214 03:44:34.560162 1521705 command_runner.go:130] > # ]
I0214 03:44:34.560174 1521705 command_runner.go:130] > # Controls how image volumes are handled. The valid values are mkdir, bind and
I0214 03:44:34.560186 1521705 command_runner.go:130] > # ignore; the latter will ignore volumes entirely.
I0214 03:44:34.560197 1521705 command_runner.go:130] > # image_volumes = "mkdir"
I0214 03:44:34.560209 1521705 command_runner.go:130] > # Temporary directory to use for storing big files
I0214 03:44:34.560218 1521705 command_runner.go:130] > # big_files_temporary_dir = ""
I0214 03:44:34.560232 1521705 command_runner.go:130] > # The crio.network table containers settings pertaining to the management of
I0214 03:44:34.560243 1521705 command_runner.go:130] > # CNI plugins.
I0214 03:44:34.560259 1521705 command_runner.go:130] > [crio.network]
I0214 03:44:34.560273 1521705 command_runner.go:130] > # The default CNI network name to be selected. If not set or "", then
I0214 03:44:34.560286 1521705 command_runner.go:130] > # CRI-O will pick-up the first one found in network_dir.
I0214 03:44:34.560296 1521705 command_runner.go:130] > # cni_default_network = ""
I0214 03:44:34.560308 1521705 command_runner.go:130] > # Path to the directory where CNI configuration files are located.
I0214 03:44:34.560319 1521705 command_runner.go:130] > # network_dir = "/etc/cni/net.d/"
I0214 03:44:34.560332 1521705 command_runner.go:130] > # Paths to directories where CNI plugin binaries are located.
I0214 03:44:34.560342 1521705 command_runner.go:130] > # plugin_dirs = [
I0214 03:44:34.560353 1521705 command_runner.go:130] > # "/opt/cni/bin/",
I0214 03:44:34.560361 1521705 command_runner.go:130] > # ]
I0214 03:44:34.560375 1521705 command_runner.go:130] > # A necessary configuration for Prometheus based metrics retrieval
I0214 03:44:34.560384 1521705 command_runner.go:130] > [crio.metrics]
I0214 03:44:34.560394 1521705 command_runner.go:130] > # Globally enable or disable metrics support.
I0214 03:44:34.560404 1521705 command_runner.go:130] > enable_metrics = true
I0214 03:44:34.560416 1521705 command_runner.go:130] > # Specify enabled metrics collectors.
I0214 03:44:34.560432 1521705 command_runner.go:130] > # Per default all metrics are enabled.
I0214 03:44:34.560446 1521705 command_runner.go:130] > # It is possible, to prefix the metrics with "container_runtime_" and "crio_".
I0214 03:44:34.560461 1521705 command_runner.go:130] > # For example, the metrics collector "operations" would be treated in the same
I0214 03:44:34.560477 1521705 command_runner.go:130] > # way as "crio_operations" and "container_runtime_crio_operations".
I0214 03:44:34.560486 1521705 command_runner.go:130] > # metrics_collectors = [
I0214 03:44:34.560496 1521705 command_runner.go:130] > # "operations",
I0214 03:44:34.560509 1521705 command_runner.go:130] > # "operations_latency_microseconds_total",
I0214 03:44:34.560520 1521705 command_runner.go:130] > # "operations_latency_microseconds",
I0214 03:44:34.560531 1521705 command_runner.go:130] > # "operations_errors",
I0214 03:44:34.560540 1521705 command_runner.go:130] > # "image_pulls_by_digest",
I0214 03:44:34.560550 1521705 command_runner.go:130] > # "image_pulls_by_name",
I0214 03:44:34.560559 1521705 command_runner.go:130] > # "image_pulls_by_name_skipped",
I0214 03:44:34.560567 1521705 command_runner.go:130] > # "image_pulls_failures",
I0214 03:44:34.560578 1521705 command_runner.go:130] > # "image_pulls_successes",
I0214 03:44:34.560590 1521705 command_runner.go:130] > # "image_pulls_layer_size",
I0214 03:44:34.560601 1521705 command_runner.go:130] > # "image_layer_reuse",
I0214 03:44:34.560609 1521705 command_runner.go:130] > # "containers_oom_total",
I0214 03:44:34.560620 1521705 command_runner.go:130] > # "containers_oom",
I0214 03:44:34.560631 1521705 command_runner.go:130] > # "processes_defunct",
I0214 03:44:34.560641 1521705 command_runner.go:130] > # "operations_total",
I0214 03:44:34.560650 1521705 command_runner.go:130] > # "operations_latency_seconds",
I0214 03:44:34.560665 1521705 command_runner.go:130] > # "operations_latency_seconds_total",
I0214 03:44:34.560677 1521705 command_runner.go:130] > # "operations_errors_total",
I0214 03:44:34.560688 1521705 command_runner.go:130] > # "image_pulls_bytes_total",
I0214 03:44:34.560701 1521705 command_runner.go:130] > # "image_pulls_skipped_bytes_total",
I0214 03:44:34.560712 1521705 command_runner.go:130] > # "image_pulls_failure_total",
I0214 03:44:34.560723 1521705 command_runner.go:130] > # "image_pulls_success_total",
I0214 03:44:34.560734 1521705 command_runner.go:130] > # "image_layer_reuse_total",
I0214 03:44:34.560743 1521705 command_runner.go:130] > # "containers_oom_count_total",
I0214 03:44:34.560752 1521705 command_runner.go:130] > # ]
I0214 03:44:34.560762 1521705 command_runner.go:130] > # The port on which the metrics server will listen.
I0214 03:44:34.560773 1521705 command_runner.go:130] > # metrics_port = 9090
I0214 03:44:34.560785 1521705 command_runner.go:130] > # Local socket path to bind the metrics server to
I0214 03:44:34.560796 1521705 command_runner.go:130] > # metrics_socket = ""
I0214 03:44:34.560806 1521705 command_runner.go:130] > # The certificate for the secure metrics server.
I0214 03:44:34.560817 1521705 command_runner.go:130] > # If the certificate is not available on disk, then CRI-O will generate a
I0214 03:44:34.560832 1521705 command_runner.go:130] > # self-signed one. CRI-O also watches for changes of this path and reloads the
I0214 03:44:34.560843 1521705 command_runner.go:130] > # certificate on any modification event.
I0214 03:44:34.560853 1521705 command_runner.go:130] > # metrics_cert = ""
I0214 03:44:34.560870 1521705 command_runner.go:130] > # The certificate key for the secure metrics server.
I0214 03:44:34.560882 1521705 command_runner.go:130] > # Behaves in the same way as the metrics_cert.
I0214 03:44:34.560892 1521705 command_runner.go:130] > # metrics_key = ""
I0214 03:44:34.560903 1521705 command_runner.go:130] > # A necessary configuration for OpenTelemetry trace data exporting
I0214 03:44:34.560913 1521705 command_runner.go:130] > [crio.tracing]
I0214 03:44:34.560925 1521705 command_runner.go:130] > # Globally enable or disable exporting OpenTelemetry traces.
I0214 03:44:34.560940 1521705 command_runner.go:130] > # enable_tracing = false
I0214 03:44:34.560954 1521705 command_runner.go:130] > # Address on which the gRPC trace collector listens on.
I0214 03:44:34.560966 1521705 command_runner.go:130] > # tracing_endpoint = "0.0.0.0:4317"
I0214 03:44:34.560978 1521705 command_runner.go:130] > # Number of samples to collect per million spans.
I0214 03:44:34.560989 1521705 command_runner.go:130] > # tracing_sampling_rate_per_million = 0
I0214 03:44:34.560997 1521705 command_runner.go:130] > # Necessary information pertaining to container and pod stats reporting.
I0214 03:44:34.561002 1521705 command_runner.go:130] > [crio.stats]
I0214 03:44:34.561010 1521705 command_runner.go:130] > # The number of seconds between collecting pod and container stats.
I0214 03:44:34.561018 1521705 command_runner.go:130] > # If set to 0, the stats are collected on-demand instead.
I0214 03:44:34.561024 1521705 command_runner.go:130] > # stats_collection_period = 0
I0214 03:44:34.561107 1521705 command_runner.go:130] ! time="2024-02-14 03:44:34.536905526Z" level=info msg="Starting CRI-O, version: 1.24.1, git: a3bbde8a77c323aa6a485da9a9046299155c6016(dirty)"
I0214 03:44:34.561128 1521705 command_runner.go:130] ! level=info msg="Using default capabilities: CAP_CHOWN, CAP_DAC_OVERRIDE, CAP_FSETID, CAP_FOWNER, CAP_SETGID, CAP_SETUID, CAP_SETPCAP, CAP_NET_BIND_SERVICE, CAP_KILL"
I0214 03:44:34.561312 1521705 cni.go:84] Creating CNI manager for ""
I0214 03:44:34.561331 1521705 cni.go:136] multinode detected (3 nodes found), recommending kindnet
I0214 03:44:34.561347 1521705 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 03:44:34.561390 1521705 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.169 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-920904 NodeName:multinode-920904 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.169"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.169 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:
/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 03:44:34.561564 1521705 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.169
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "multinode-920904"
kubeletExtraArgs:
node-ip: 192.168.39.169
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.169"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 03:44:34.561656 1521705 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:44:34.570457 1521705 command_runner.go:130] > kubeadm
I0214 03:44:34.570473 1521705 command_runner.go:130] > kubectl
I0214 03:44:34.570480 1521705 command_runner.go:130] > kubelet
I0214 03:44:34.570744 1521705 binaries.go:44] Found k8s binaries, skipping transfer
I0214 03:44:34.570810 1521705 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 03:44:34.579053 1521705 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (316 bytes)
I0214 03:44:34.595962 1521705 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:44:34.612258 1521705 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2160 bytes)
I0214 03:44:34.628600 1521705 ssh_runner.go:195] Run: grep 192.168.39.169 control-plane.minikube.internal$ /etc/hosts
I0214 03:44:34.632320 1521705 command_runner.go:130] > 192.168.39.169 control-plane.minikube.internal
I0214 03:44:34.632371 1521705 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:44:34.788381 1521705 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:44:34.802441 1521705 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904 for IP: 192.168.39.169
I0214 03:44:34.802463 1521705 certs.go:194] generating shared ca certs ...
I0214 03:44:34.802484 1521705 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:44:34.802693 1521705 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:44:34.802766 1521705 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:44:34.802791 1521705 certs.go:256] generating profile certs ...
I0214 03:44:34.802905 1521705 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/client.key
I0214 03:44:34.802998 1521705 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.key.0118bbc7
I0214 03:44:34.803059 1521705 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.key
I0214 03:44:34.803074 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:44:34.803094 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:44:34.803111 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:44:34.803127 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:44:34.803143 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:44:34.803159 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:44:34.803186 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:44:34.803203 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:44:34.803263 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:44:34.803306 1521705 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:44:34.803320 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:44:34.803355 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:44:34.803391 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:44:34.803432 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:44:34.803488 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:44:34.803525 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:44:34.803545 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:34.803563 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:44:34.804220 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:44:34.827065 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:44:34.850477 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:44:34.872255 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:44:34.893746 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 03:44:34.914905 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 03:44:34.935835 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:44:34.956911 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:44:34.978134 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:44:34.999476 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:44:35.020841 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:44:35.041881 1521705 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 03:44:35.060060 1521705 ssh_runner.go:195] Run: openssl version
I0214 03:44:35.065164 1521705 command_runner.go:130] > OpenSSL 1.1.1n 15 Mar 2022
I0214 03:44:35.065462 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:44:35.075425 1521705 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:44:35.079860 1521705 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:44:35.079920 1521705 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:44:35.079965 1521705 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:44:35.085040 1521705 command_runner.go:130] > 51391683
I0214 03:44:35.085247 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:44:35.093781 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:44:35.103984 1521705 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:44:35.108116 1521705 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:44:35.108279 1521705 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:44:35.108397 1521705 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:44:35.113957 1521705 command_runner.go:130] > 3ec20f2e
I0214 03:44:35.114031 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:44:35.122648 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:44:35.133370 1521705 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:35.137806 1521705 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:35.138037 1521705 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:35.138094 1521705 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:35.143350 1521705 command_runner.go:130] > b5213941
I0214 03:44:35.143415 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:44:35.153019 1521705 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:44:35.157426 1521705 command_runner.go:130] > File: /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:44:35.157443 1521705 command_runner.go:130] > Size: 1164 Blocks: 8 IO Block: 4096 regular file
I0214 03:44:35.157449 1521705 command_runner.go:130] > Device: fd01h/64769d Inode: 532797 Links: 1
I0214 03:44:35.157456 1521705 command_runner.go:130] > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root)
I0214 03:44:35.157461 1521705 command_runner.go:130] > Access: 2024-02-14 03:38:07.755157448 +0000
I0214 03:44:35.157466 1521705 command_runner.go:130] > Modify: 2024-02-14 03:38:07.755157448 +0000
I0214 03:44:35.157471 1521705 command_runner.go:130] > Change: 2024-02-14 03:38:07.755157448 +0000
I0214 03:44:35.157480 1521705 command_runner.go:130] > Birth: 2024-02-14 03:38:07.755157448 +0000
I0214 03:44:35.157529 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 03:44:35.162543 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.162813 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 03:44:35.167903 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.168150 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 03:44:35.173273 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.173342 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 03:44:35.178314 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.178551 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 03:44:35.183790 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.183843 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 03:44:35.188908 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.189070 1521705 kubeadm.go:391] StartCluster: {Name:multinode-920904 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.
4 ClusterName:multinode-920904 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.169 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.100 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true} {Name:m03 IP:192.168.39.48 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false
inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:f
alse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:44:35.189210 1521705 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 03:44:35.189291 1521705 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 03:44:35.232480 1521705 command_runner.go:130] > 3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986
I0214 03:44:35.232524 1521705 command_runner.go:130] > 5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9
I0214 03:44:35.232531 1521705 command_runner.go:130] > 27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c
I0214 03:44:35.232537 1521705 command_runner.go:130] > 16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8
I0214 03:44:35.232543 1521705 command_runner.go:130] > 718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf
I0214 03:44:35.232551 1521705 command_runner.go:130] > 554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547
I0214 03:44:35.232570 1521705 command_runner.go:130] > ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72
I0214 03:44:35.232585 1521705 command_runner.go:130] > e4741d213bd818d97421b82b9b141f40379e0ed9b967da233ad26dba6ccded3f
I0214 03:44:35.234101 1521705 cri.go:89] found id: "3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986"
I0214 03:44:35.234121 1521705 cri.go:89] found id: "5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9"
I0214 03:44:35.234142 1521705 cri.go:89] found id: "27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c"
I0214 03:44:35.234147 1521705 cri.go:89] found id: "16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8"
I0214 03:44:35.234152 1521705 cri.go:89] found id: "718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf"
I0214 03:44:35.234162 1521705 cri.go:89] found id: "554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547"
I0214 03:44:35.234175 1521705 cri.go:89] found id: "ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72"
I0214 03:44:35.234182 1521705 cri.go:89] found id: "e4741d213bd818d97421b82b9b141f40379e0ed9b967da233ad26dba6ccded3f"
I0214 03:44:35.234189 1521705 cri.go:89] found id: ""
I0214 03:44:35.234236 1521705 ssh_runner.go:195] Run: sudo runc list -f json
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 03:37:45 UTC, ends at Wed 2024-02-14 03:46:08 UTC. --
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.597402914Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707882368597392029,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125543,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=bc6ccf6a-44d7-4048-a19f-3cb704be4341 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.598142218Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=97597df0-bc4c-4f76-9a46-1d417fd45daf name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.598193218Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=97597df0-bc4c-4f76-9a46-1d417fd45daf name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.598624166Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:0f3566216aa1257a74b709833810d52a856b587e47fd8ac6d97770661b5a43a9,PodSandboxId:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707882322395267160,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6,PodSandboxId:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:1,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707882286834675197,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern
etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4,PodSandboxId:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707882285986838652,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol
\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:17df1e9f2c31572f561f74ff9a1dfa3420d1f51b639e4a472eac377710a3becf,PodSandboxId:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707882285359886533,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e
9c8b435,},Annotations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475,PodSandboxId:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707882285271700480,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]st
ring{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7,PodSandboxId:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707882278505325412,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kube
rnetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3,PodSandboxId:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707882278345898440,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.contai
ner.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe,PodSandboxId:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707882278001333172,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartC
ount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89,PodSandboxId:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707882277968425103,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f5e2e82998e84a400f5668ccea34368ed24a3c7598a70f47406e0eb33164e87e,PodSandboxId:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707881967969420711,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 0,io.ku
bernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986,PodSandboxId:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707881917032754683,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9,PodSandboxId:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1707881916682538980,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annot
ations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c,PodSandboxId:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,State:CONTAINER_EXITED,CreatedAt:1707881914349117123,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kube
rnetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8,PodSandboxId:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707881912567200070,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]string{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMe
ssagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf,PodSandboxId:353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707881891926165223,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547,PodSandboxId:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707881891742857592,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,
},},&Container{Id:ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72,PodSandboxId:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707881891530400166,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e4741d213bd818d97421b82b9b141f403
79e0ed9b967da233ad26dba6ccded3f,PodSandboxId:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707881891463750831,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=97597df0-bc4c-4f76-9a46-1
d417fd45daf name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.641733845Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=0319e8fe-1bed-4a13-8525-521b9ebc996f name=/runtime.v1.RuntimeService/Version
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.641812014Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=0319e8fe-1bed-4a13-8525-521b9ebc996f name=/runtime.v1.RuntimeService/Version
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.643225111Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=c8a394e0-a57b-4e7e-b237-a009f7b37b25 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.643653306Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707882368643639583,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125543,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=c8a394e0-a57b-4e7e-b237-a009f7b37b25 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.644305570Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=3bd6a47e-653e-4554-8130-6bf5a07632ac name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.644351843Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=3bd6a47e-653e-4554-8130-6bf5a07632ac name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.644737615Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:0f3566216aa1257a74b709833810d52a856b587e47fd8ac6d97770661b5a43a9,PodSandboxId:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707882322395267160,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6,PodSandboxId:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:1,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707882286834675197,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern
etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4,PodSandboxId:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707882285986838652,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol
\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:17df1e9f2c31572f561f74ff9a1dfa3420d1f51b639e4a472eac377710a3becf,PodSandboxId:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707882285359886533,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e
9c8b435,},Annotations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475,PodSandboxId:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707882285271700480,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]st
ring{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7,PodSandboxId:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707882278505325412,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kube
rnetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3,PodSandboxId:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707882278345898440,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.contai
ner.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe,PodSandboxId:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707882278001333172,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartC
ount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89,PodSandboxId:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707882277968425103,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f5e2e82998e84a400f5668ccea34368ed24a3c7598a70f47406e0eb33164e87e,PodSandboxId:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707881967969420711,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 0,io.ku
bernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986,PodSandboxId:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707881917032754683,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9,PodSandboxId:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1707881916682538980,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annot
ations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c,PodSandboxId:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,State:CONTAINER_EXITED,CreatedAt:1707881914349117123,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kube
rnetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8,PodSandboxId:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707881912567200070,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]string{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMe
ssagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf,PodSandboxId:353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707881891926165223,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547,PodSandboxId:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707881891742857592,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,
},},&Container{Id:ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72,PodSandboxId:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707881891530400166,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e4741d213bd818d97421b82b9b141f403
79e0ed9b967da233ad26dba6ccded3f,PodSandboxId:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707881891463750831,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=3bd6a47e-653e-4554-8130-6
bf5a07632ac name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.685783073Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=685ba5b8-34ab-44ca-b622-3c1dd909c836 name=/runtime.v1.RuntimeService/Version
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.685841872Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=685ba5b8-34ab-44ca-b622-3c1dd909c836 name=/runtime.v1.RuntimeService/Version
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.687024253Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=383e9843-a6c5-4693-a67b-cf6bf8c7cfbf name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.687414106Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707882368687401387,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125543,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=383e9843-a6c5-4693-a67b-cf6bf8c7cfbf name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.687947141Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=695d66de-9e4f-4f8a-8993-a65aa70dfbb9 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.688025810Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=695d66de-9e4f-4f8a-8993-a65aa70dfbb9 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.688362859Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:0f3566216aa1257a74b709833810d52a856b587e47fd8ac6d97770661b5a43a9,PodSandboxId:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707882322395267160,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6,PodSandboxId:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:1,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707882286834675197,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern
etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4,PodSandboxId:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707882285986838652,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol
\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:17df1e9f2c31572f561f74ff9a1dfa3420d1f51b639e4a472eac377710a3becf,PodSandboxId:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707882285359886533,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e
9c8b435,},Annotations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475,PodSandboxId:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707882285271700480,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]st
ring{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7,PodSandboxId:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707882278505325412,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kube
rnetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3,PodSandboxId:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707882278345898440,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.contai
ner.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe,PodSandboxId:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707882278001333172,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartC
ount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89,PodSandboxId:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707882277968425103,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f5e2e82998e84a400f5668ccea34368ed24a3c7598a70f47406e0eb33164e87e,PodSandboxId:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707881967969420711,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 0,io.ku
bernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986,PodSandboxId:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707881917032754683,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9,PodSandboxId:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1707881916682538980,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annot
ations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c,PodSandboxId:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,State:CONTAINER_EXITED,CreatedAt:1707881914349117123,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kube
rnetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8,PodSandboxId:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707881912567200070,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]string{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMe
ssagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf,PodSandboxId:353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707881891926165223,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547,PodSandboxId:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707881891742857592,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,
},},&Container{Id:ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72,PodSandboxId:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707881891530400166,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e4741d213bd818d97421b82b9b141f403
79e0ed9b967da233ad26dba6ccded3f,PodSandboxId:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707881891463750831,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=695d66de-9e4f-4f8a-8993-a
65aa70dfbb9 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.732192362Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=56d42e7d-29e9-45ab-aded-69fcb122acfa name=/runtime.v1.RuntimeService/Version
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.732273826Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=56d42e7d-29e9-45ab-aded-69fcb122acfa name=/runtime.v1.RuntimeService/Version
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.734134786Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=00557b47-a172-470f-a5e6-10ab9d764aaf name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.734636600Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707882368734621012,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125543,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=00557b47-a172-470f-a5e6-10ab9d764aaf name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.735319984Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=245a7709-9940-4ede-acf1-d35189a899a3 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.735394958Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=245a7709-9940-4ede-acf1-d35189a899a3 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:46:08 multinode-920904 crio[2888]: time="2024-02-14 03:46:08.735808907Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:0f3566216aa1257a74b709833810d52a856b587e47fd8ac6d97770661b5a43a9,PodSandboxId:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707882322395267160,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6,PodSandboxId:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:1,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707882286834675197,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern
etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4,PodSandboxId:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707882285986838652,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol
\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:17df1e9f2c31572f561f74ff9a1dfa3420d1f51b639e4a472eac377710a3becf,PodSandboxId:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707882285359886533,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e
9c8b435,},Annotations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475,PodSandboxId:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707882285271700480,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]st
ring{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7,PodSandboxId:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707882278505325412,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kube
rnetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3,PodSandboxId:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707882278345898440,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.contai
ner.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe,PodSandboxId:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707882278001333172,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartC
ount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89,PodSandboxId:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707882277968425103,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f5e2e82998e84a400f5668ccea34368ed24a3c7598a70f47406e0eb33164e87e,PodSandboxId:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707881967969420711,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 0,io.ku
bernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986,PodSandboxId:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707881917032754683,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9,PodSandboxId:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1707881916682538980,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annot
ations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c,PodSandboxId:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,State:CONTAINER_EXITED,CreatedAt:1707881914349117123,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kube
rnetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8,PodSandboxId:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707881912567200070,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]string{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMe
ssagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf,PodSandboxId:353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707881891926165223,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547,PodSandboxId:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707881891742857592,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,
},},&Container{Id:ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72,PodSandboxId:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707881891530400166,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e4741d213bd818d97421b82b9b141f403
79e0ed9b967da233ad26dba6ccded3f,PodSandboxId:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707881891463750831,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=245a7709-9940-4ede-acf1-d
35189a899a3 name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
0f3566216aa12 8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a 46 seconds ago Running busybox 1 2c77162a27641 busybox-5b5d89c9d6-vfm4b
756cb939eedab c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc About a minute ago Running kindnet-cni 1 93233e00e5db7 kindnet-z6pzc
c68148b204af4 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc About a minute ago Running coredns 1 b89bd686af502 coredns-5dd5756b68-pdpj9
17df1e9f2c315 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 About a minute ago Running storage-provisioner 1 1c65195deedc0 storage-provisioner
31097f7bbab9d 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e About a minute ago Running kube-proxy 1 7ba4a85a0adbc kube-proxy-tqs9l
9b760e70fa057 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 About a minute ago Running kube-scheduler 1 0a4149b0dc6b3 kube-scheduler-multinode-920904
cbee2963809e1 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 About a minute ago Running etcd 1 a549b707a1f44 etcd-multinode-920904
2d22ba7cad9b5 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 About a minute ago Running kube-apiserver 1 539b2a75bf3dc kube-apiserver-multinode-920904
dd468dc00b761 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 About a minute ago Running kube-controller-manager 1 30f6d1d1b65cd kube-controller-manager-multinode-920904
f5e2e82998e84 gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 6 minutes ago Exited busybox 0 8f69e6bc15e36 busybox-5b5d89c9d6-vfm4b
3c895812a4edb ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 7 minutes ago Exited coredns 0 d7d9ca749ff58 coredns-5dd5756b68-pdpj9
5a23ae349dd42 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 7 minutes ago Exited storage-provisioner 0 9f1e2ecab08f6 storage-provisioner
27fc4fd406688 c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc 7 minutes ago Exited kindnet-cni 0 9320dd54abfbf kindnet-z6pzc
16cf4f0e3c363 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 7 minutes ago Exited kube-proxy 0 04d7a5fd34112 kube-proxy-tqs9l
718f1ba82ee49 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 7 minutes ago Exited kube-scheduler 0 353a50f5abaa2 kube-scheduler-multinode-920904
554d78e9f4988 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 7 minutes ago Exited etcd 0 0fd91233e1946 etcd-multinode-920904
ba1cab6d5491a 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 7 minutes ago Exited kube-apiserver 0 f98b361622007 kube-apiserver-multinode-920904
e4741d213bd81 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 7 minutes ago Exited kube-controller-manager 0 7d9ffb468d165 kube-controller-manager-multinode-920904
==> coredns [3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986] <==
[INFO] 10.244.1.2:39455 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001970411s
[INFO] 10.244.1.2:47611 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000221389s
[INFO] 10.244.1.2:39773 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000100421s
[INFO] 10.244.1.2:56317 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001220097s
[INFO] 10.244.1.2:53097 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000200154s
[INFO] 10.244.1.2:53427 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000076069s
[INFO] 10.244.1.2:41972 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000184662s
[INFO] 10.244.0.3:39821 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000105964s
[INFO] 10.244.0.3:50909 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000112587s
[INFO] 10.244.0.3:59089 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000080452s
[INFO] 10.244.0.3:46772 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000102313s
[INFO] 10.244.1.2:36231 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000254136s
[INFO] 10.244.1.2:38831 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000228594s
[INFO] 10.244.1.2:52834 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000141666s
[INFO] 10.244.1.2:59346 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000247719s
[INFO] 10.244.0.3:38783 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000132293s
[INFO] 10.244.0.3:56592 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000161711s
[INFO] 10.244.0.3:41824 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000105703s
[INFO] 10.244.0.3:37372 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000090808s
[INFO] 10.244.1.2:51249 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000107574s
[INFO] 10.244.1.2:39473 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000254537s
[INFO] 10.244.1.2:59674 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000076546s
[INFO] 10.244.1.2:39285 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000079207s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> coredns [c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:36829 - 63389 "HINFO IN 3521760805028779142.724315420791163652. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.028859784s
==> describe nodes <==
Name: multinode-920904
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-920904
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=multinode-920904
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T03_38_19_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:38:15 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-920904
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:46:04 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:44:42 +0000 Wed, 14 Feb 2024 03:38:13 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:44:42 +0000 Wed, 14 Feb 2024 03:38:13 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:44:42 +0000 Wed, 14 Feb 2024 03:38:13 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:44:42 +0000 Wed, 14 Feb 2024 03:38:35 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.169
Hostname: multinode-920904
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 8ace496719884738923672e00b4b674a
System UUID: 8ace4967-1988-4738-9236-72e00b4b674a
Boot ID: 16abca97-55c7-4bcb-92f4-3d588d85e570
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-vfm4b 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m43s
kube-system coredns-5dd5756b68-pdpj9 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 7m38s
kube-system etcd-multinode-920904 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 7m51s
kube-system kindnet-z6pzc 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 7m38s
kube-system kube-apiserver-multinode-920904 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m53s
kube-system kube-controller-manager-multinode-920904 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m53s
kube-system kube-proxy-tqs9l 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m38s
kube-system kube-scheduler-multinode-920904 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m52s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m37s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 100m (5%!)(MISSING)
memory 220Mi (10%!)(MISSING) 220Mi (10%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 7m36s kube-proxy
Normal Starting 82s kube-proxy
Normal NodeAllocatableEnforced 7m51s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 7m51s kubelet Node multinode-920904 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m51s kubelet Node multinode-920904 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 7m51s kubelet Node multinode-920904 status is now: NodeHasSufficientPID
Normal Starting 7m51s kubelet Starting kubelet.
Normal RegisteredNode 7m39s node-controller Node multinode-920904 event: Registered Node multinode-920904 in Controller
Normal NodeReady 7m34s kubelet Node multinode-920904 status is now: NodeReady
Normal Starting 93s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 93s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 92s (x8 over 93s) kubelet Node multinode-920904 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 92s (x8 over 93s) kubelet Node multinode-920904 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 92s (x7 over 93s) kubelet Node multinode-920904 status is now: NodeHasSufficientPID
Normal RegisteredNode 73s node-controller Node multinode-920904 event: Registered Node multinode-920904 in Controller
Name: multinode-920904-m02
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-920904-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=multinode-920904
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_45_25_0700
minikube.k8s.io/version=v1.32.0
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:45:24 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-920904-m02
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:46:05 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:45:54 +0000 Wed, 14 Feb 2024 03:45:24 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:45:54 +0000 Wed, 14 Feb 2024 03:45:24 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:45:54 +0000 Wed, 14 Feb 2024 03:45:24 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:45:54 +0000 Wed, 14 Feb 2024 03:45:32 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.100
Hostname: multinode-920904-m02
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 9cf8fd3abeeb435084990fad447a659c
System UUID: 9cf8fd3a-beeb-4350-8499-0fad447a659c
Boot ID: 23f20c33-560b-4832-b349-b5a1b3ec6ac3
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-6jnl5 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 51s
kube-system kindnet-2x6cd 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 6m56s
kube-system kube-proxy-txk85 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m56s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m49s kube-proxy
Normal Starting 41s kube-proxy
Normal NodeHasSufficientMemory 6m56s (x5 over 6m58s) kubelet Node multinode-920904-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m56s (x5 over 6m58s) kubelet Node multinode-920904-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m56s (x5 over 6m58s) kubelet Node multinode-920904-m02 status is now: NodeHasSufficientPID
Normal NodeReady 6m46s kubelet Node multinode-920904-m02 status is now: NodeReady
Normal NodeHasSufficientMemory 45s (x5 over 47s) kubelet Node multinode-920904-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 45s (x5 over 47s) kubelet Node multinode-920904-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 45s (x5 over 47s) kubelet Node multinode-920904-m02 status is now: NodeHasSufficientPID
Normal NodeReady 37s kubelet Node multinode-920904-m02 status is now: NodeReady
Name: multinode-920904-m03
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-920904-m03
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=multinode-920904
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_45_55_0700
minikube.k8s.io/version=v1.32.0
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:45:55 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-920904-m03
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:46:05 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:46:05 +0000 Wed, 14 Feb 2024 03:45:55 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:46:05 +0000 Wed, 14 Feb 2024 03:45:55 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:46:05 +0000 Wed, 14 Feb 2024 03:45:55 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:46:05 +0000 Wed, 14 Feb 2024 03:46:05 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.48
Hostname: multinode-920904-m03
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: c4f59e9b6b064bd4b4c48ddeeddc476c
System UUID: c4f59e9b-6b06-4bd4-b4c4-8ddeeddc476c
Boot ID: e9846e30-655e-4c7f-910e-aca5eb6d3c22
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.2.0/24
PodCIDRs: 10.244.2.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system kindnet-69j24 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 6m7s
kube-system kube-proxy-ftb7r 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m7s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 5m18s kube-proxy
Normal Starting 6m1s kube-proxy
Normal Starting 8s kube-proxy
Normal NodeHasNoDiskPressure 6m7s (x5 over 6m8s) kubelet Node multinode-920904-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m7s (x5 over 6m8s) kubelet Node multinode-920904-m03 status is now: NodeHasSufficientPID
Normal NodeHasSufficientMemory 6m7s (x5 over 6m8s) kubelet Node multinode-920904-m03 status is now: NodeHasSufficientMemory
Normal NodeReady 5m58s kubelet Node multinode-920904-m03 status is now: NodeReady
Normal NodeHasNoDiskPressure 5m23s (x5 over 5m24s) kubelet Node multinode-920904-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m23s (x5 over 5m24s) kubelet Node multinode-920904-m03 status is now: NodeHasSufficientPID
Normal NodeHasSufficientMemory 5m23s (x5 over 5m24s) kubelet Node multinode-920904-m03 status is now: NodeHasSufficientMemory
Normal NodeReady 5m14s kubelet Node multinode-920904-m03 status is now: NodeReady
Normal NodeHasSufficientMemory 14s (x5 over 16s) kubelet Node multinode-920904-m03 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 14s (x5 over 16s) kubelet Node multinode-920904-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 14s (x5 over 16s) kubelet Node multinode-920904-m03 status is now: NodeHasSufficientPID
Normal NodeReady 4s kubelet Node multinode-920904-m03 status is now: NodeReady
==> dmesg <==
[ +4.343119] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.483474] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.134520] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +4.981392] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +10.195124] systemd-fstab-generator[642]: Ignoring "noauto" for root device
[ +0.096857] systemd-fstab-generator[653]: Ignoring "noauto" for root device
[ +0.141067] systemd-fstab-generator[666]: Ignoring "noauto" for root device
[ +0.102826] systemd-fstab-generator[677]: Ignoring "noauto" for root device
[ +0.199286] systemd-fstab-generator[701]: Ignoring "noauto" for root device
[Feb14 03:38] systemd-fstab-generator[802]: Ignoring "noauto" for root device
[ +3.781343] systemd-fstab-generator[981]: Ignoring "noauto" for root device
[ +8.761063] systemd-fstab-generator[1317]: Ignoring "noauto" for root device
[ +12.862802] systemd-fstab-generator[1502]: Ignoring "noauto" for root device
[ +6.685330] kauditd_printk_skb: 18 callbacks suppressed
[Feb14 03:44] systemd-fstab-generator[2815]: Ignoring "noauto" for root device
[ +0.151579] systemd-fstab-generator[2826]: Ignoring "noauto" for root device
[ +0.167971] systemd-fstab-generator[2839]: Ignoring "noauto" for root device
[ +0.140528] systemd-fstab-generator[2850]: Ignoring "noauto" for root device
[ +0.242186] systemd-fstab-generator[2873]: Ignoring "noauto" for root device
[ +0.861190] systemd-fstab-generator[2982]: Ignoring "noauto" for root device
[ +1.791248] systemd-fstab-generator[3105]: Ignoring "noauto" for root device
[ +19.743566] systemd-fstab-generator[3917]: Ignoring "noauto" for root device
==> etcd [554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547] <==
{"level":"info","ts":"2024-02-14T03:38:13.606681Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"88d17c48ad0ae483","local-member-attributes":"{Name:multinode-920904 ClientURLs:[https://192.168.39.169:2379]}","request-path":"/0/members/88d17c48ad0ae483/attributes","cluster-id":"dd1030519101f266","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T03:38:13.606837Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T03:38:13.6097Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T03:38:13.610989Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T03:38:13.611902Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.169:2379"}
{"level":"info","ts":"2024-02-14T03:38:13.611995Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T03:38:13.612022Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-02-14T03:38:13.612223Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"dd1030519101f266","local-member-id":"88d17c48ad0ae483","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:38:13.612308Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:38:13.612343Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:39:12.009151Z","caller":"traceutil/trace.go:171","msg":"trace[1811816891] transaction","detail":"{read_only:false; response_revision:446; number_of_response:1; }","duration":"201.493192ms","start":"2024-02-14T03:39:11.807619Z","end":"2024-02-14T03:39:12.009112Z","steps":["trace[1811816891] 'process raft request' (duration: 117.52979ms)","trace[1811816891] 'compare' (duration: 83.587032ms)"],"step_count":2}
{"level":"info","ts":"2024-02-14T03:39:12.272245Z","caller":"traceutil/trace.go:171","msg":"trace[1495052735] transaction","detail":"{read_only:false; response_revision:447; number_of_response:1; }","duration":"253.307554ms","start":"2024-02-14T03:39:12.018922Z","end":"2024-02-14T03:39:12.27223Z","steps":["trace[1495052735] 'process raft request' (duration: 188.005246ms)","trace[1495052735] 'compare' (duration: 65.199162ms)"],"step_count":2}
{"level":"warn","ts":"2024-02-14T03:40:01.335451Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"193.269217ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/\" range_end:\"/registry/services/endpoints0\" count_only:true ","response":"range_response_count:0 size:7"}
{"level":"info","ts":"2024-02-14T03:40:01.33586Z","caller":"traceutil/trace.go:171","msg":"trace[1409512178] range","detail":"{range_begin:/registry/services/endpoints/; range_end:/registry/services/endpoints0; response_count:0; response_revision:571; }","duration":"193.763023ms","start":"2024-02-14T03:40:01.142064Z","end":"2024-02-14T03:40:01.335827Z","steps":["trace[1409512178] 'count revisions from in-memory index tree' (duration: 193.169491ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T03:43:01.735307Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}
{"level":"info","ts":"2024-02-14T03:43:01.735417Z","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"multinode-920904","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.169:2380"],"advertise-client-urls":["https://192.168.39.169:2379"]}
{"level":"warn","ts":"2024-02-14T03:43:01.736879Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
{"level":"warn","ts":"2024-02-14T03:43:01.737096Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
WARNING: 2024/02/14 03:43:01 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
{"level":"warn","ts":"2024-02-14T03:43:01.838459Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.39.169:2379: use of closed network connection"}
{"level":"warn","ts":"2024-02-14T03:43:01.838601Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.39.169:2379: use of closed network connection"}
{"level":"info","ts":"2024-02-14T03:43:01.838705Z","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"88d17c48ad0ae483","current-leader-member-id":"88d17c48ad0ae483"}
{"level":"info","ts":"2024-02-14T03:43:01.841691Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.39.169:2380"}
{"level":"info","ts":"2024-02-14T03:43:01.841873Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.39.169:2380"}
{"level":"info","ts":"2024-02-14T03:43:01.841909Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"multinode-920904","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.169:2380"],"advertise-client-urls":["https://192.168.39.169:2379"]}
==> etcd [cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3] <==
{"level":"info","ts":"2024-02-14T03:44:40.204585Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"88d17c48ad0ae483","initial-advertise-peer-urls":["https://192.168.39.169:2380"],"listen-peer-urls":["https://192.168.39.169:2380"],"advertise-client-urls":["https://192.168.39.169:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.39.169:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-02-14T03:44:40.204687Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-02-14T03:44:40.20482Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.39.169:2380"}
{"level":"info","ts":"2024-02-14T03:44:40.204851Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.39.169:2380"}
{"level":"info","ts":"2024-02-14T03:44:40.204114Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T03:44:40.204866Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T03:44:40.204874Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T03:44:40.205687Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 switched to configuration voters=(9858797710873388163)"}
{"level":"info","ts":"2024-02-14T03:44:40.206071Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"dd1030519101f266","local-member-id":"88d17c48ad0ae483","added-peer-id":"88d17c48ad0ae483","added-peer-peer-urls":["https://192.168.39.169:2380"]}
{"level":"info","ts":"2024-02-14T03:44:40.206446Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"dd1030519101f266","local-member-id":"88d17c48ad0ae483","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:44:40.20661Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:44:41.357591Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 is starting a new election at term 2"}
{"level":"info","ts":"2024-02-14T03:44:41.357683Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 became pre-candidate at term 2"}
{"level":"info","ts":"2024-02-14T03:44:41.3577Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 received MsgPreVoteResp from 88d17c48ad0ae483 at term 2"}
{"level":"info","ts":"2024-02-14T03:44:41.357712Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 became candidate at term 3"}
{"level":"info","ts":"2024-02-14T03:44:41.357717Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 received MsgVoteResp from 88d17c48ad0ae483 at term 3"}
{"level":"info","ts":"2024-02-14T03:44:41.357726Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 became leader at term 3"}
{"level":"info","ts":"2024-02-14T03:44:41.357733Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 88d17c48ad0ae483 elected leader 88d17c48ad0ae483 at term 3"}
{"level":"info","ts":"2024-02-14T03:44:41.360659Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"88d17c48ad0ae483","local-member-attributes":"{Name:multinode-920904 ClientURLs:[https://192.168.39.169:2379]}","request-path":"/0/members/88d17c48ad0ae483/attributes","cluster-id":"dd1030519101f266","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T03:44:41.360828Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T03:44:41.360954Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T03:44:41.361009Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-02-14T03:44:41.361119Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T03:44:41.362152Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T03:44:41.362281Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.169:2379"}
==> kernel <==
03:46:09 up 8 min, 0 users, load average: 0.95, 0.55, 0.28
Linux multinode-920904 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kindnet [27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c] <==
I0214 03:42:15.928931 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:42:25.934047 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:42:25.934097 1 main.go:227] handling current node
I0214 03:42:25.934108 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:42:25.934114 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:42:25.934609 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:42:25.934693 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:42:35.947058 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:42:35.947114 1 main.go:227] handling current node
I0214 03:42:35.947136 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:42:35.947142 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:42:35.947298 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:42:35.947336 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:42:45.959065 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:42:45.959378 1 main.go:227] handling current node
I0214 03:42:45.959421 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:42:45.959559 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:42:45.959725 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:42:45.959753 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:42:55.972756 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:42:55.972808 1 main.go:227] handling current node
I0214 03:42:55.972824 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:42:55.972829 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:42:55.972962 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:42:55.972967 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
==> kindnet [756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6] <==
I0214 03:45:28.236621 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:45:38.249991 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:45:38.250046 1 main.go:227] handling current node
I0214 03:45:38.250063 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:45:38.250070 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:45:38.250195 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:45:38.250230 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:45:48.262914 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:45:48.262964 1 main.go:227] handling current node
I0214 03:45:48.262978 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:45:48.262990 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:45:48.263107 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:45:48.263112 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:45:58.273135 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:45:58.273259 1 main.go:227] handling current node
I0214 03:45:58.273305 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:45:58.273330 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:45:58.273603 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:45:58.273659 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.2.0/24]
I0214 03:46:08.281588 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:46:08.281637 1 main.go:227] handling current node
I0214 03:46:08.281653 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:46:08.281659 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:46:08.281759 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:46:08.281788 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.2.0/24]
==> kube-apiserver [2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe] <==
I0214 03:44:42.787390 1 establishing_controller.go:76] Starting EstablishingController
I0214 03:44:42.787449 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0214 03:44:42.788062 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0214 03:44:42.788109 1 crd_finalizer.go:266] Starting CRDFinalizer
I0214 03:44:42.883312 1 shared_informer.go:318] Caches are synced for crd-autoregister
I0214 03:44:42.884660 1 aggregator.go:166] initial CRD sync complete...
I0214 03:44:42.884709 1 autoregister_controller.go:141] Starting autoregister controller
I0214 03:44:42.884716 1 cache.go:32] Waiting for caches to sync for autoregister controller
I0214 03:44:42.920078 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0214 03:44:42.943281 1 shared_informer.go:318] Caches are synced for node_authorizer
I0214 03:44:42.967400 1 apf_controller.go:377] Running API Priority and Fairness config worker
I0214 03:44:42.967685 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I0214 03:44:42.968808 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0214 03:44:42.975642 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0214 03:44:42.976207 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0214 03:44:42.976842 1 shared_informer.go:318] Caches are synced for configmaps
I0214 03:44:42.986856 1 cache.go:39] Caches are synced for autoregister controller
I0214 03:44:43.781831 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0214 03:44:45.965077 1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0214 03:44:46.236014 1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0214 03:44:46.246754 1 controller.go:624] quota admission added evaluator for: deployments.apps
I0214 03:44:46.347135 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0214 03:44:46.362701 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0214 03:44:56.180084 1 controller.go:624] quota admission added evaluator for: endpoints
I0214 03:44:56.220717 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
==> kube-apiserver [ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72] <==
I0214 03:43:01.753892 1 autoregister_controller.go:165] Shutting down autoregister controller
I0214 03:43:01.753935 1 crdregistration_controller.go:142] Shutting down crd-autoregister controller
I0214 03:43:01.753962 1 apiapproval_controller.go:198] Shutting down KubernetesAPIApprovalPolicyConformantConditionController
I0214 03:43:01.754000 1 nonstructuralschema_controller.go:204] Shutting down NonStructuralSchemaConditionController
I0214 03:43:01.754015 1 establishing_controller.go:87] Shutting down EstablishingController
I0214 03:43:01.754039 1 naming_controller.go:302] Shutting down NamingConditionController
I0214 03:43:01.754056 1 controller.go:115] Shutting down OpenAPI V3 controller
I0214 03:43:01.754075 1 controller.go:162] Shutting down OpenAPI controller
I0214 03:43:01.754093 1 customresource_discovery_controller.go:325] Shutting down DiscoveryController
I0214 03:43:01.754153 1 gc_controller.go:91] Shutting down apiserver lease garbage collector
I0214 03:43:01.754172 1 available_controller.go:439] Shutting down AvailableConditionController
I0214 03:43:01.754200 1 apf_controller.go:384] Shutting down API Priority and Fairness config worker
I0214 03:43:01.754216 1 gc_controller.go:91] Shutting down apiserver lease garbage collector
I0214 03:43:01.754223 1 crd_finalizer.go:278] Shutting down CRDFinalizer
I0214 03:43:01.754349 1 controller.go:129] Ending legacy_token_tracking_controller
I0214 03:43:01.754360 1 controller.go:130] Shutting down legacy_token_tracking_controller
I0214 03:43:01.758007 1 dynamic_cafile_content.go:171] "Shutting down controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I0214 03:43:01.758615 1 dynamic_cafile_content.go:171] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I0214 03:43:01.758801 1 dynamic_serving_content.go:146] "Shutting down controller" name="aggregator-proxy-cert::/var/lib/minikube/certs/front-proxy-client.crt::/var/lib/minikube/certs/front-proxy-client.key"
I0214 03:43:01.758838 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting"
I0214 03:43:01.758851 1 controller.go:86] Shutting down OpenAPI V3 AggregationController
I0214 03:43:01.758911 1 controller.go:84] Shutting down OpenAPI AggregationController
I0214 03:43:01.759009 1 secure_serving.go:258] Stopped listening on [::]:8443
I0214 03:43:01.759025 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
I0214 03:43:01.768086 1 dynamic_serving_content.go:146] "Shutting down controller" name="serving-cert::/var/lib/minikube/certs/apiserver.crt::/var/lib/minikube/certs/apiserver.key"
==> kube-controller-manager [dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89] <==
I0214 03:45:18.330837 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="33.191676ms"
I0214 03:45:18.330953 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="56.326µs"
I0214 03:45:18.347876 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="16.671915ms"
I0214 03:45:18.358867 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="10.931493ms"
I0214 03:45:18.358979 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="36.889µs"
I0214 03:45:24.260887 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-920904-m02\" does not exist"
I0214 03:45:24.267404 1 event.go:307] "Event occurred" object="default/busybox-5b5d89c9d6-xqpsh" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-5b5d89c9d6-xqpsh"
I0214 03:45:24.282827 1 range_allocator.go:380] "Set node PodCIDR" node="multinode-920904-m02" podCIDRs=["10.244.1.0/24"]
I0214 03:45:24.788449 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="74.217µs"
I0214 03:45:24.817774 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="268.038µs"
I0214 03:45:24.834570 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="378.574µs"
I0214 03:45:24.842909 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="66.896µs"
I0214 03:45:24.852907 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="51.307µs"
I0214 03:45:26.719732 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="53.833µs"
I0214 03:45:32.329671 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:45:32.350599 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="141.261µs"
I0214 03:45:32.370081 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="49.788µs"
I0214 03:45:34.872711 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="12.794836ms"
I0214 03:45:34.873086 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="109.021µs"
I0214 03:45:36.215681 1 event.go:307] "Event occurred" object="default/busybox-5b5d89c9d6-6jnl5" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-5b5d89c9d6-6jnl5"
I0214 03:45:52.907668 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:45:55.387110 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-920904-m03\" does not exist"
I0214 03:45:55.387692 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:45:55.402106 1 range_allocator.go:380] "Set node PodCIDR" node="multinode-920904-m03" podCIDRs=["10.244.2.0/24"]
I0214 03:46:05.698442 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m03"
==> kube-controller-manager [e4741d213bd818d97421b82b9b141f40379e0ed9b967da233ad26dba6ccded3f] <==
I0214 03:40:02.548844 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-920904-m03\" does not exist"
I0214 03:40:02.552305 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:40:02.569599 1 range_allocator.go:380] "Set node PodCIDR" node="multinode-920904-m03" podCIDRs=["10.244.2.0/24"]
I0214 03:40:02.589150 1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-69j24"
I0214 03:40:02.595616 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-ftb7r"
I0214 03:40:05.188294 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="multinode-920904-m03"
I0214 03:40:05.188425 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node multinode-920904-m03 event: Registered Node multinode-920904-m03 in Controller"
I0214 03:40:11.946628 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:40:43.959758 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:40:45.212056 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RemovingNode" message="Node multinode-920904-m03 event: Removing Node multinode-920904-m03 from Controller"
I0214 03:40:46.643232 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-920904-m03\" does not exist"
I0214 03:40:46.647068 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:40:46.661929 1 range_allocator.go:380] "Set node PodCIDR" node="multinode-920904-m03" podCIDRs=["10.244.3.0/24"]
I0214 03:40:50.213043 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node multinode-920904-m03 event: Registered Node multinode-920904-m03 in Controller"
I0214 03:40:55.256681 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:41:35.246929 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m03"
I0214 03:41:35.247521 1 event.go:307] "Event occurred" object="multinode-920904-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-920904-m02 status is now: NodeNotReady"
I0214 03:41:35.261571 1 event.go:307] "Event occurred" object="default/busybox-5b5d89c9d6-xqpsh" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:41:35.277876 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="15.961469ms"
I0214 03:41:35.278785 1 event.go:307] "Event occurred" object="kube-system/kube-proxy-txk85" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:41:35.283053 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="79.772µs"
I0214 03:41:35.296115 1 event.go:307] "Event occurred" object="kube-system/kindnet-2x6cd" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:41:40.308402 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-920904-m03 status is now: NodeNotReady"
I0214 03:41:40.322984 1 event.go:307] "Event occurred" object="kube-system/kindnet-69j24" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:41:40.344792 1 event.go:307] "Event occurred" object="kube-system/kube-proxy-ftb7r" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
==> kube-proxy [16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8] <==
I0214 03:38:32.757346 1 server_others.go:69] "Using iptables proxy"
I0214 03:38:32.768901 1 node.go:141] Successfully retrieved node IP: 192.168.39.169
I0214 03:38:32.825225 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 03:38:32.825321 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 03:38:32.828160 1 server_others.go:152] "Using iptables Proxier"
I0214 03:38:32.828222 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 03:38:32.828590 1 server.go:846] "Version info" version="v1.28.4"
I0214 03:38:32.828625 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:38:32.829293 1 config.go:188] "Starting service config controller"
I0214 03:38:32.829345 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 03:38:32.829366 1 config.go:97] "Starting endpoint slice config controller"
I0214 03:38:32.829370 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 03:38:32.831732 1 config.go:315] "Starting node config controller"
I0214 03:38:32.831768 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 03:38:32.930374 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 03:38:32.930651 1 shared_informer.go:318] Caches are synced for service config
I0214 03:38:32.933249 1 shared_informer.go:318] Caches are synced for node config
==> kube-proxy [31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475] <==
I0214 03:44:45.885253 1 server_others.go:69] "Using iptables proxy"
I0214 03:44:45.907456 1 node.go:141] Successfully retrieved node IP: 192.168.39.169
I0214 03:44:46.046300 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 03:44:46.046356 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 03:44:46.068988 1 server_others.go:152] "Using iptables Proxier"
I0214 03:44:46.069974 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 03:44:46.071952 1 server.go:846] "Version info" version="v1.28.4"
I0214 03:44:46.072003 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:44:46.073147 1 config.go:188] "Starting service config controller"
I0214 03:44:46.073219 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 03:44:46.073260 1 config.go:97] "Starting endpoint slice config controller"
I0214 03:44:46.073277 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 03:44:46.073896 1 config.go:315] "Starting node config controller"
I0214 03:44:46.073939 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 03:44:46.174085 1 shared_informer.go:318] Caches are synced for node config
I0214 03:44:46.174165 1 shared_informer.go:318] Caches are synced for service config
I0214 03:44:46.174185 1 shared_informer.go:318] Caches are synced for endpoint slice config
==> kube-scheduler [718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf] <==
E0214 03:38:15.372932 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:38:15.373463 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:38:15.373690 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 03:38:16.221279 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:38:16.221331 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 03:38:16.244695 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 03:38:16.244745 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 03:38:16.268713 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 03:38:16.268764 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 03:38:16.270022 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 03:38:16.270063 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 03:38:16.395772 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:38:16.395854 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 03:38:16.434250 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 03:38:16.434407 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0214 03:38:16.454427 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:38:16.454526 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:38:16.514633 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:38:16.514713 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0214 03:38:16.563539 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 03:38:16.563676 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0214 03:38:16.852757 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 03:38:16.852809 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0214 03:38:19.544820 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0214 03:43:01.734666 1 run.go:74] "command failed" err="finished without leader elect"
==> kube-scheduler [9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7] <==
I0214 03:44:40.514750 1 serving.go:348] Generated self-signed cert in-memory
W0214 03:44:42.829202 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0214 03:44:42.829381 1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0214 03:44:42.829542 1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
W0214 03:44:42.830167 1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0214 03:44:42.895443 1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"
I0214 03:44:42.895606 1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:44:42.903380 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0214 03:44:42.903453 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 03:44:42.907283 1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
I0214 03:44:42.907383 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0214 03:44:43.004132 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 03:37:45 UTC, ends at Wed 2024-02-14 03:46:09 UTC. --
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.722408 3111 topology_manager.go:215] "Topology Admit Handler" podUID="a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5" podNamespace="kube-system" podName="coredns-5dd5756b68-pdpj9"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.722612 3111 topology_manager.go:215] "Topology Admit Handler" podUID="7baac180-46a6-4d2f-a403-8eff3369f7c0" podNamespace="kube-system" podName="kube-proxy-tqs9l"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.722694 3111 topology_manager.go:215] "Topology Admit Handler" podUID="57e775c4-dfa0-409a-a6c1-81c354ae5205" podNamespace="kube-system" podName="kindnet-z6pzc"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.722737 3111 topology_manager.go:215] "Topology Admit Handler" podUID="7b3e114a-bf3d-4001-8f21-6be4e9c8b435" podNamespace="kube-system" podName="storage-provisioner"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.722779 3111 topology_manager.go:215] "Topology Admit Handler" podUID="ada46005-8413-4ffa-9e70-b2a0cb3c7941" podNamespace="default" podName="busybox-5b5d89c9d6-vfm4b"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.734859 3111 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.762129 3111 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/7b3e114a-bf3d-4001-8f21-6be4e9c8b435-tmp\") pod \"storage-provisioner\" (UID: \"7b3e114a-bf3d-4001-8f21-6be4e9c8b435\") " pod="kube-system/storage-provisioner"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.762187 3111 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7baac180-46a6-4d2f-a403-8eff3369f7c0-lib-modules\") pod \"kube-proxy-tqs9l\" (UID: \"7baac180-46a6-4d2f-a403-8eff3369f7c0\") " pod="kube-system/kube-proxy-tqs9l"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.762249 3111 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/57e775c4-dfa0-409a-a6c1-81c354ae5205-cni-cfg\") pod \"kindnet-z6pzc\" (UID: \"57e775c4-dfa0-409a-a6c1-81c354ae5205\") " pod="kube-system/kindnet-z6pzc"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.762274 3111 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/57e775c4-dfa0-409a-a6c1-81c354ae5205-xtables-lock\") pod \"kindnet-z6pzc\" (UID: \"57e775c4-dfa0-409a-a6c1-81c354ae5205\") " pod="kube-system/kindnet-z6pzc"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.762345 3111 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/7baac180-46a6-4d2f-a403-8eff3369f7c0-xtables-lock\") pod \"kube-proxy-tqs9l\" (UID: \"7baac180-46a6-4d2f-a403-8eff3369f7c0\") " pod="kube-system/kube-proxy-tqs9l"
Feb 14 03:44:43 multinode-920904 kubelet[3111]: I0214 03:44:43.762372 3111 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57e775c4-dfa0-409a-a6c1-81c354ae5205-lib-modules\") pod \"kindnet-z6pzc\" (UID: \"57e775c4-dfa0-409a-a6c1-81c354ae5205\") " pod="kube-system/kindnet-z6pzc"
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.864361 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/pod48a5a80865aadc8364cca137e04141ac/crio-7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636: Error finding container 7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636: Status 404 returned error can't find the container with id 7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.864920 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/podb97b3113c9ba0043ea50e1edc3226133/crio-0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6: Error finding container 0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6: Status 404 returned error can't find the container with id 0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.865196 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/pode6f8f927d6b3cc2b372a318a8e285f39/crio-353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3: Error finding container 353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3: Status 404 returned error can't find the container with id 353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.865584 3111 manager.go:1106] Failed to create existing container: /kubepods/pod57e775c4-dfa0-409a-a6c1-81c354ae5205/crio-9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a: Error finding container 9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a: Status 404 returned error can't find the container with id 9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.865968 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/pod7b3e114a-bf3d-4001-8f21-6be4e9c8b435/crio-9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4: Error finding container 9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4: Status 404 returned error can't find the container with id 9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.866431 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/poda9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5/crio-d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c: Error finding container d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c: Status 404 returned error can't find the container with id d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.867131 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/podada46005-8413-4ffa-9e70-b2a0cb3c7941/crio-8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd: Error finding container 8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd: Status 404 returned error can't find the container with id 8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.867619 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/pod3be77efdd656fce83a1ee57d47f0da56/crio-f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d: Error finding container f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d: Status 404 returned error can't find the container with id f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.867916 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/pod7baac180-46a6-4d2f-a403-8eff3369f7c0/crio-04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7: Error finding container 04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7: Status 404 returned error can't find the container with id 04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7
Feb 14 03:45:36 multinode-920904 kubelet[3111]: E0214 03:45:36.919384 3111 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:45:36 multinode-920904 kubelet[3111]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:45:36 multinode-920904 kubelet[3111]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:45:36 multinode-920904 kubelet[3111]: > table="nat" chain="KUBE-KUBELET-CANARY"
-- /stdout --
** stderr **
E0214 03:46:08.284347 1522530 logs.go:258] failed to output last start logs: failed to read file /home/jenkins/minikube-integration/17909-1487441/.minikube/logs/lastStart.txt: bufio.Scanner: token too long
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p multinode-920904 -n multinode-920904
helpers_test.go:261: (dbg) Run: kubectl --context multinode-920904 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestMultiNode/serial/RestartKeepsNodes FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (312.12s)
=== RUN TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 stop
E0214 03:46:13.611737 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
multinode_test.go:345: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-920904 stop: exit status 82 (2m0.417819011s)
-- stdout --
* Stopping node "multinode-920904-m02" ...
-- /stdout --
** stderr **
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
multinode_test.go:347: failed to stop cluster. args "out/minikube-linux-amd64 -p multinode-920904 stop": exit status 82
multinode_test.go:351: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-920904 status: exit status 3 (18.651447438s)
-- stdout --
multinode-920904
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-920904-m02
type: Worker
host: Error
kubelet: Nonexistent
-- /stdout --
** stderr **
E0214 03:48:31.709672 1523069 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.100:22: connect: no route to host
E0214 03:48:31.709707 1523069 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.100:22: connect: no route to host
** /stderr **
multinode_test.go:354: failed to run minikube status. args "out/minikube-linux-amd64 -p multinode-920904 status" : exit status 3
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p multinode-920904 -n multinode-920904
helpers_test.go:244: <<< TestMultiNode/serial/StopMultiNode FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestMultiNode/serial/StopMultiNode]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p multinode-920904 logs -n 25: (1.589184898s)
helpers_test.go:252: TestMultiNode/serial/StopMultiNode logs:
-- stdout --
==> Audit <==
|---------|-----------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|-----------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m02:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904:/home/docker/cp-test_multinode-920904-m02_multinode-920904.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n multinode-920904 sudo cat | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /home/docker/cp-test_multinode-920904-m02_multinode-920904.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m02:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03:/home/docker/cp-test_multinode-920904-m02_multinode-920904-m03.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n multinode-920904-m03 sudo cat | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /home/docker/cp-test_multinode-920904-m02_multinode-920904-m03.txt | | | | | |
| cp | multinode-920904 cp testdata/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03:/home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /tmp/TestMultiNodeserialCopyFile142466148/001/cp-test_multinode-920904-m03.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904:/home/docker/cp-test_multinode-920904-m03_multinode-920904.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n multinode-920904 sudo cat | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /home/docker/cp-test_multinode-920904-m03_multinode-920904.txt | | | | | |
| cp | multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m02:/home/docker/cp-test_multinode-920904-m03_multinode-920904-m02.txt | | | | | |
| ssh | multinode-920904 ssh -n | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | multinode-920904-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-920904 ssh -n multinode-920904-m02 sudo cat | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | /home/docker/cp-test_multinode-920904-m03_multinode-920904-m02.txt | | | | | |
| node | multinode-920904 node stop m03 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| node | multinode-920904 node start | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | 14 Feb 24 03:40 UTC |
| | m03 -v=7 --alsologtostderr | | | | | |
| node | list -p multinode-920904 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | |
| stop | -p multinode-920904 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:40 UTC | |
| start | -p multinode-920904 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:43 UTC | 14 Feb 24 03:46 UTC |
| | --wait=true -v=8 | | | | | |
| | --alsologtostderr | | | | | |
| node | list -p multinode-920904 | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:46 UTC | |
| node | multinode-920904 node delete | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:46 UTC | 14 Feb 24 03:46 UTC |
| | m03 | | | | | |
| stop | multinode-920904 stop | multinode-920904 | jenkins | v1.32.0 | 14 Feb 24 03:46 UTC | |
|---------|-----------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 03:43:00
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 03:43:00.734022 1521705 out.go:291] Setting OutFile to fd 1 ...
I0214 03:43:00.734271 1521705 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:43:00.734279 1521705 out.go:304] Setting ErrFile to fd 2...
I0214 03:43:00.734284 1521705 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:43:00.734466 1521705 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:43:00.735019 1521705 out.go:298] Setting JSON to false
I0214 03:43:00.736026 1521705 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":23128,"bootTime":1707859053,"procs":186,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:43:00.736088 1521705 start.go:138] virtualization: kvm guest
I0214 03:43:00.738761 1521705 out.go:177] * [multinode-920904] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 03:43:00.740634 1521705 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:43:00.742069 1521705 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:43:00.740687 1521705 notify.go:220] Checking for updates...
I0214 03:43:00.743673 1521705 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:43:00.745294 1521705 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:43:00.746735 1521705 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:43:00.748360 1521705 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:43:00.750166 1521705 config.go:182] Loaded profile config "multinode-920904": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:43:00.750254 1521705 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:43:00.750892 1521705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:43:00.750949 1521705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:43:00.765856 1521705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43039
I0214 03:43:00.766346 1521705 main.go:141] libmachine: () Calling .GetVersion
I0214 03:43:00.766979 1521705 main.go:141] libmachine: Using API Version 1
I0214 03:43:00.767003 1521705 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:43:00.767320 1521705 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:43:00.767516 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:43:00.802515 1521705 out.go:177] * Using the kvm2 driver based on existing profile
I0214 03:43:00.803945 1521705 start.go:296] selected driver: kvm2
I0214 03:43:00.803964 1521705 start.go:900] validating driver "kvm2" against &{Name:multinode-920904 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubern
etesVersion:v1.28.4 ClusterName:multinode-920904 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.169 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.100 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true} {Name:m03 IP:192.168.39.48 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingr
ess-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableO
ptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:43:00.804117 1521705 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:43:00.804465 1521705 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:43:00.804557 1521705 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 03:43:00.819152 1521705 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 03:43:00.820111 1521705 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 03:43:00.820193 1521705 cni.go:84] Creating CNI manager for ""
I0214 03:43:00.820211 1521705 cni.go:136] multinode detected (3 nodes found), recommending kindnet
I0214 03:43:00.820282 1521705 start.go:339] cluster config:
{Name:multinode-920904 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-920904 Namespace:default APIServerHA
VIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.169 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.100 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true} {Name:m03 IP:192.168.39.48 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false k
ong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMne
tClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:43:00.820446 1521705 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 03:43:00.824573 1521705 out.go:177] * Starting "multinode-920904" primary control-plane node in "multinode-920904" cluster
I0214 03:43:00.825925 1521705 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:43:00.825980 1521705 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 03:43:00.825993 1521705 cache.go:56] Caching tarball of preloaded images
I0214 03:43:00.826098 1521705 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 03:43:00.826112 1521705 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 03:43:00.826270 1521705 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/config.json ...
I0214 03:43:00.826502 1521705 start.go:360] acquireMachinesLock for multinode-920904: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 03:43:00.826574 1521705 start.go:364] duration metric: took 51.042µs to acquireMachinesLock for "multinode-920904"
I0214 03:43:00.826594 1521705 start.go:96] Skipping create...Using existing machine configuration
I0214 03:43:00.826601 1521705 fix.go:54] fixHost starting:
I0214 03:43:00.826891 1521705 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:43:00.826929 1521705 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:43:00.841173 1521705 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38675
I0214 03:43:00.841641 1521705 main.go:141] libmachine: () Calling .GetVersion
I0214 03:43:00.842077 1521705 main.go:141] libmachine: Using API Version 1
I0214 03:43:00.842104 1521705 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:43:00.842431 1521705 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:43:00.842640 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:43:00.842770 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetState
I0214 03:43:00.844264 1521705 fix.go:112] recreateIfNeeded on multinode-920904: state=Running err=<nil>
W0214 03:43:00.844293 1521705 fix.go:138] unexpected machine state, will restart: <nil>
I0214 03:43:00.846376 1521705 out.go:177] * Updating the running kvm2 "multinode-920904" VM ...
I0214 03:43:00.847829 1521705 machine.go:94] provisionDockerMachine start ...
I0214 03:43:00.847851 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:43:00.848081 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:00.850815 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:00.851251 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:00.851305 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:00.851469 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:00.851646 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:00.851810 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:00.851973 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:00.852114 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:43:00.852458 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:43:00.852469 1521705 main.go:141] libmachine: About to run SSH command:
hostname
I0214 03:43:00.970771 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-920904
I0214 03:43:00.970812 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetMachineName
I0214 03:43:00.971114 1521705 buildroot.go:166] provisioning hostname "multinode-920904"
I0214 03:43:00.971161 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetMachineName
I0214 03:43:00.971390 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:00.974222 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:00.974667 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:00.974708 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:00.974929 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:00.975131 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:00.975280 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:00.975417 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:00.975526 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:43:00.975914 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:43:00.975933 1521705 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-920904 && echo "multinode-920904" | sudo tee /etc/hostname
I0214 03:43:01.099037 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-920904
I0214 03:43:01.099080 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:01.102072 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.102478 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.102509 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.102719 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:01.102923 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.103116 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.103244 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:01.103443 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:43:01.103791 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:43:01.103817 1521705 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-920904' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-920904/g' /etc/hosts;
else
echo '127.0.1.1 multinode-920904' | sudo tee -a /etc/hosts;
fi
fi
I0214 03:43:01.214759 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 03:43:01.214790 1521705 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 03:43:01.214825 1521705 buildroot.go:174] setting up certificates
I0214 03:43:01.214843 1521705 provision.go:84] configureAuth start
I0214 03:43:01.214859 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetMachineName
I0214 03:43:01.215227 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetIP
I0214 03:43:01.218225 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.218581 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.218611 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.218782 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:01.221224 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.221597 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.221626 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.221763 1521705 provision.go:143] copyHostCerts
I0214 03:43:01.221795 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:43:01.221845 1521705 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 03:43:01.221857 1521705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 03:43:01.221935 1521705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 03:43:01.222029 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:43:01.222055 1521705 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 03:43:01.222063 1521705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 03:43:01.222105 1521705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 03:43:01.222232 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:43:01.222267 1521705 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 03:43:01.222277 1521705 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 03:43:01.222319 1521705 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 03:43:01.222419 1521705 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.multinode-920904 san=[127.0.0.1 192.168.39.169 localhost minikube multinode-920904]
I0214 03:43:01.427206 1521705 provision.go:177] copyRemoteCerts
I0214 03:43:01.427280 1521705 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 03:43:01.427307 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:01.430222 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.430609 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.430641 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.430759 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:01.430973 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.431142 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:01.431294 1521705 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:43:01.520347 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0214 03:43:01.520419 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 03:43:01.546316 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem -> /etc/docker/server.pem
I0214 03:43:01.546389 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
I0214 03:43:01.570124 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0214 03:43:01.570204 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 03:43:01.593565 1521705 provision.go:87] duration metric: took 378.702346ms to configureAuth
I0214 03:43:01.593602 1521705 buildroot.go:189] setting minikube options for container-runtime
I0214 03:43:01.593942 1521705 config.go:182] Loaded profile config "multinode-920904": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:43:01.594044 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:43:01.597065 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.597502 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:43:01.597555 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:43:01.597688 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:43:01.597918 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.598102 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:43:01.598281 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:43:01.598424 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:43:01.598787 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:43:01.598805 1521705 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 03:44:32.470872 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 03:44:32.470934 1521705 machine.go:97] duration metric: took 1m31.623078019s to provisionDockerMachine
I0214 03:44:32.470960 1521705 start.go:293] postStartSetup for "multinode-920904" (driver="kvm2")
I0214 03:44:32.470974 1521705 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 03:44:32.470999 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.471403 1521705 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 03:44:32.471445 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:44:32.474369 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.474808 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.474842 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.474946 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:44:32.475164 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.475328 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:44:32.475466 1521705 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:44:32.564320 1521705 ssh_runner.go:195] Run: cat /etc/os-release
I0214 03:44:32.568321 1521705 command_runner.go:130] > NAME=Buildroot
I0214 03:44:32.568341 1521705 command_runner.go:130] > VERSION=2021.02.12-1-g19d536a-dirty
I0214 03:44:32.568345 1521705 command_runner.go:130] > ID=buildroot
I0214 03:44:32.568351 1521705 command_runner.go:130] > VERSION_ID=2021.02.12
I0214 03:44:32.568357 1521705 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0214 03:44:32.568407 1521705 info.go:137] Remote host: Buildroot 2021.02.12
I0214 03:44:32.568428 1521705 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 03:44:32.568521 1521705 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 03:44:32.568632 1521705 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 03:44:32.568645 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /etc/ssl/certs/14946922.pem
I0214 03:44:32.568729 1521705 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 03:44:32.577829 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:44:32.599895 1521705 start.go:296] duration metric: took 128.920961ms for postStartSetup
I0214 03:44:32.599937 1521705 fix.go:56] duration metric: took 1m31.773336339s for fixHost
I0214 03:44:32.599959 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:44:32.602679 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.603062 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.603095 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.603226 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:44:32.603423 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.603603 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.603778 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:44:32.603922 1521705 main.go:141] libmachine: Using SSH client type: native
I0214 03:44:32.604271 1521705 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.169 22 <nil> <nil>}
I0214 03:44:32.604288 1521705 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 03:44:32.713858 1521705 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707882272.704244212
I0214 03:44:32.713885 1521705 fix.go:216] guest clock: 1707882272.704244212
I0214 03:44:32.713896 1521705 fix.go:229] Guest: 2024-02-14 03:44:32.704244212 +0000 UTC Remote: 2024-02-14 03:44:32.599941613 +0000 UTC m=+91.921500841 (delta=104.302599ms)
I0214 03:44:32.713922 1521705 fix.go:200] guest clock delta is within tolerance: 104.302599ms
I0214 03:44:32.713929 1521705 start.go:83] releasing machines lock for "multinode-920904", held for 1m31.887341851s
I0214 03:44:32.713972 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.714246 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetIP
I0214 03:44:32.717021 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.717425 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.717468 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.717677 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.718217 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.718401 1521705 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:44:32.718527 1521705 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 03:44:32.718585 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:44:32.718656 1521705 ssh_runner.go:195] Run: cat /version.json
I0214 03:44:32.718683 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:44:32.721277 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.721312 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.721660 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.721688 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.721728 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:32.721748 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:32.721816 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:44:32.721956 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:44:32.722029 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.722125 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:44:32.722248 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:44:32.722282 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:44:32.722534 1521705 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:44:32.722552 1521705 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:44:32.806773 1521705 command_runner.go:130] > {"iso_version": "v1.32.1-1703784139-17866", "kicbase_version": "v0.0.42-1703723663-17866", "minikube_version": "v1.32.0", "commit": "eb69424d8f623d7cabea57d4395ce87adf1b5fc3"}
I0214 03:44:32.806919 1521705 ssh_runner.go:195] Run: systemctl --version
I0214 03:44:32.841769 1521705 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0214 03:44:32.841821 1521705 command_runner.go:130] > systemd 247 (247)
I0214 03:44:32.841834 1521705 command_runner.go:130] > -PAM -AUDIT -SELINUX -IMA -APPARMOR -SMACK -SYSVINIT -UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ +LZ4 -ZSTD +SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid
I0214 03:44:32.841883 1521705 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 03:44:32.994210 1521705 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0214 03:44:33.006874 1521705 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0214 03:44:33.007232 1521705 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 03:44:33.007314 1521705 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 03:44:33.023268 1521705 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0214 03:44:33.023299 1521705 start.go:494] detecting cgroup driver to use...
I0214 03:44:33.023393 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 03:44:33.048684 1521705 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 03:44:33.060954 1521705 docker.go:217] disabling cri-docker service (if available) ...
I0214 03:44:33.061026 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 03:44:33.073483 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 03:44:33.086206 1521705 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 03:44:33.236631 1521705 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 03:44:33.376765 1521705 docker.go:233] disabling docker service ...
I0214 03:44:33.376857 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 03:44:33.391995 1521705 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 03:44:33.404485 1521705 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 03:44:33.544518 1521705 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 03:44:33.686296 1521705 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 03:44:33.700850 1521705 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 03:44:33.718023 1521705 command_runner.go:130] > runtime-endpoint: unix:///var/run/crio/crio.sock
I0214 03:44:33.718074 1521705 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 03:44:33.718135 1521705 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:44:33.728191 1521705 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 03:44:33.728266 1521705 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:44:33.738292 1521705 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:44:33.747912 1521705 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 03:44:33.758327 1521705 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 03:44:33.769080 1521705 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 03:44:33.778359 1521705 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0214 03:44:33.778616 1521705 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 03:44:33.787785 1521705 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:44:33.926541 1521705 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 03:44:34.247365 1521705 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 03:44:34.247445 1521705 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 03:44:34.252744 1521705 command_runner.go:130] > File: /var/run/crio/crio.sock
I0214 03:44:34.252763 1521705 command_runner.go:130] > Size: 0 Blocks: 0 IO Block: 4096 socket
I0214 03:44:34.252770 1521705 command_runner.go:130] > Device: 16h/22d Inode: 1405 Links: 1
I0214 03:44:34.252776 1521705 command_runner.go:130] > Access: (0660/srw-rw----) Uid: ( 0/ root) Gid: ( 0/ root)
I0214 03:44:34.252781 1521705 command_runner.go:130] > Access: 2024-02-14 03:44:34.111384934 +0000
I0214 03:44:34.252787 1521705 command_runner.go:130] > Modify: 2024-02-14 03:44:34.090383650 +0000
I0214 03:44:34.252792 1521705 command_runner.go:130] > Change: 2024-02-14 03:44:34.090383650 +0000
I0214 03:44:34.252796 1521705 command_runner.go:130] > Birth: -
I0214 03:44:34.252871 1521705 start.go:562] Will wait 60s for crictl version
I0214 03:44:34.252943 1521705 ssh_runner.go:195] Run: which crictl
I0214 03:44:34.256442 1521705 command_runner.go:130] > /usr/bin/crictl
I0214 03:44:34.256809 1521705 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 03:44:34.295950 1521705 command_runner.go:130] > Version: 0.1.0
I0214 03:44:34.296046 1521705 command_runner.go:130] > RuntimeName: cri-o
I0214 03:44:34.296087 1521705 command_runner.go:130] > RuntimeVersion: 1.24.1
I0214 03:44:34.296102 1521705 command_runner.go:130] > RuntimeApiVersion: v1
I0214 03:44:34.296138 1521705 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 03:44:34.296229 1521705 ssh_runner.go:195] Run: crio --version
I0214 03:44:34.345588 1521705 command_runner.go:130] > crio version 1.24.1
I0214 03:44:34.345619 1521705 command_runner.go:130] > Version: 1.24.1
I0214 03:44:34.345631 1521705 command_runner.go:130] > GitCommit: a3bbde8a77c323aa6a485da9a9046299155c6016
I0214 03:44:34.345636 1521705 command_runner.go:130] > GitTreeState: dirty
I0214 03:44:34.345642 1521705 command_runner.go:130] > BuildDate: 2023-12-28T22:46:29Z
I0214 03:44:34.345659 1521705 command_runner.go:130] > GoVersion: go1.19.9
I0214 03:44:34.345667 1521705 command_runner.go:130] > Compiler: gc
I0214 03:44:34.345675 1521705 command_runner.go:130] > Platform: linux/amd64
I0214 03:44:34.345685 1521705 command_runner.go:130] > Linkmode: dynamic
I0214 03:44:34.345699 1521705 command_runner.go:130] > BuildTags: exclude_graphdriver_devicemapper, containers_image_ostree_stub, seccomp
I0214 03:44:34.345710 1521705 command_runner.go:130] > SeccompEnabled: true
I0214 03:44:34.345716 1521705 command_runner.go:130] > AppArmorEnabled: false
I0214 03:44:34.345832 1521705 ssh_runner.go:195] Run: crio --version
I0214 03:44:34.391599 1521705 command_runner.go:130] > crio version 1.24.1
I0214 03:44:34.391644 1521705 command_runner.go:130] > Version: 1.24.1
I0214 03:44:34.391665 1521705 command_runner.go:130] > GitCommit: a3bbde8a77c323aa6a485da9a9046299155c6016
I0214 03:44:34.391673 1521705 command_runner.go:130] > GitTreeState: dirty
I0214 03:44:34.391688 1521705 command_runner.go:130] > BuildDate: 2023-12-28T22:46:29Z
I0214 03:44:34.391702 1521705 command_runner.go:130] > GoVersion: go1.19.9
I0214 03:44:34.391711 1521705 command_runner.go:130] > Compiler: gc
I0214 03:44:34.391719 1521705 command_runner.go:130] > Platform: linux/amd64
I0214 03:44:34.391726 1521705 command_runner.go:130] > Linkmode: dynamic
I0214 03:44:34.391735 1521705 command_runner.go:130] > BuildTags: exclude_graphdriver_devicemapper, containers_image_ostree_stub, seccomp
I0214 03:44:34.391740 1521705 command_runner.go:130] > SeccompEnabled: true
I0214 03:44:34.391747 1521705 command_runner.go:130] > AppArmorEnabled: false
I0214 03:44:34.394930 1521705 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 03:44:34.396249 1521705 main.go:141] libmachine: (multinode-920904) Calling .GetIP
I0214 03:44:34.398897 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:34.399286 1521705 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:44:34.399307 1521705 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:44:34.399561 1521705 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 03:44:34.403869 1521705 command_runner.go:130] > 192.168.39.1 host.minikube.internal
I0214 03:44:34.403956 1521705 kubeadm.go:877] updating cluster {Name:multinode-920904 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.
28.4 ClusterName:multinode-920904 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.169 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.100 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true} {Name:m03 IP:192.168.39.48 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:fal
se inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimization
s:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 03:44:34.404071 1521705 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 03:44:34.404113 1521705 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:44:34.453379 1521705 command_runner.go:130] > {
I0214 03:44:34.453401 1521705 command_runner.go:130] > "images": [
I0214 03:44:34.453405 1521705 command_runner.go:130] > {
I0214 03:44:34.453415 1521705 command_runner.go:130] > "id": "c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc",
I0214 03:44:34.453421 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453429 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd:v20230809-80a64d96"
I0214 03:44:34.453432 1521705 command_runner.go:130] > ],
I0214 03:44:34.453437 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.453454 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052",
I0214 03:44:34.453476 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"
I0214 03:44:34.453483 1521705 command_runner.go:130] > ],
I0214 03:44:34.453487 1521705 command_runner.go:130] > "size": "65258016",
I0214 03:44:34.453492 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.453496 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.453504 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.453510 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.453514 1521705 command_runner.go:130] > },
I0214 03:44:34.453520 1521705 command_runner.go:130] > {
I0214 03:44:34.453529 1521705 command_runner.go:130] > "id": "8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a",
I0214 03:44:34.453540 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453553 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox:1.28"
I0214 03:44:34.453562 1521705 command_runner.go:130] > ],
I0214 03:44:34.453570 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.453580 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335",
I0214 03:44:34.453590 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12"
I0214 03:44:34.453597 1521705 command_runner.go:130] > ],
I0214 03:44:34.453603 1521705 command_runner.go:130] > "size": "1363676",
I0214 03:44:34.453610 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.453622 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.453633 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.453644 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.453653 1521705 command_runner.go:130] > },
I0214 03:44:34.453661 1521705 command_runner.go:130] > {
I0214 03:44:34.453667 1521705 command_runner.go:130] > "id": "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562",
I0214 03:44:34.453674 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453679 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner:v5"
I0214 03:44:34.453685 1521705 command_runner.go:130] > ],
I0214 03:44:34.453690 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.453699 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944",
I0214 03:44:34.453715 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"
I0214 03:44:34.453725 1521705 command_runner.go:130] > ],
I0214 03:44:34.453736 1521705 command_runner.go:130] > "size": "31470524",
I0214 03:44:34.453745 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.453755 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.453770 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.453778 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.453781 1521705 command_runner.go:130] > },
I0214 03:44:34.453787 1521705 command_runner.go:130] > {
I0214 03:44:34.453798 1521705 command_runner.go:130] > "id": "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc",
I0214 03:44:34.453808 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453819 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns:v1.10.1"
I0214 03:44:34.453828 1521705 command_runner.go:130] > ],
I0214 03:44:34.453836 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.453851 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e",
I0214 03:44:34.453871 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"
I0214 03:44:34.453880 1521705 command_runner.go:130] > ],
I0214 03:44:34.453890 1521705 command_runner.go:130] > "size": "53621675",
I0214 03:44:34.453901 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.453911 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.453921 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.453931 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.453940 1521705 command_runner.go:130] > },
I0214 03:44:34.453951 1521705 command_runner.go:130] > {
I0214 03:44:34.453960 1521705 command_runner.go:130] > "id": "73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9",
I0214 03:44:34.453970 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.453982 1521705 command_runner.go:130] > "registry.k8s.io/etcd:3.5.9-0"
I0214 03:44:34.453992 1521705 command_runner.go:130] > ],
I0214 03:44:34.454002 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454017 1521705 command_runner.go:130] > "registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15",
I0214 03:44:34.454031 1521705 command_runner.go:130] > "registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"
I0214 03:44:34.454040 1521705 command_runner.go:130] > ],
I0214 03:44:34.454048 1521705 command_runner.go:130] > "size": "295456551",
I0214 03:44:34.454052 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454062 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.454072 1521705 command_runner.go:130] > },
I0214 03:44:34.454082 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454092 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454101 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454110 1521705 command_runner.go:130] > },
I0214 03:44:34.454119 1521705 command_runner.go:130] > {
I0214 03:44:34.454135 1521705 command_runner.go:130] > "id": "7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257",
I0214 03:44:34.454144 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454157 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver:v1.28.4"
I0214 03:44:34.454167 1521705 command_runner.go:130] > ],
I0214 03:44:34.454177 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454192 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499",
I0214 03:44:34.454207 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"
I0214 03:44:34.454216 1521705 command_runner.go:130] > ],
I0214 03:44:34.454223 1521705 command_runner.go:130] > "size": "127226832",
I0214 03:44:34.454259 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454278 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.454284 1521705 command_runner.go:130] > },
I0214 03:44:34.454292 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454302 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454309 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454314 1521705 command_runner.go:130] > },
I0214 03:44:34.454322 1521705 command_runner.go:130] > {
I0214 03:44:34.454336 1521705 command_runner.go:130] > "id": "d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591",
I0214 03:44:34.454349 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454362 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager:v1.28.4"
I0214 03:44:34.454371 1521705 command_runner.go:130] > ],
I0214 03:44:34.454382 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454395 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c",
I0214 03:44:34.454409 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"
I0214 03:44:34.454415 1521705 command_runner.go:130] > ],
I0214 03:44:34.454424 1521705 command_runner.go:130] > "size": "123261750",
I0214 03:44:34.454433 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454443 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.454452 1521705 command_runner.go:130] > },
I0214 03:44:34.454462 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454476 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454482 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454487 1521705 command_runner.go:130] > },
I0214 03:44:34.454495 1521705 command_runner.go:130] > {
I0214 03:44:34.454510 1521705 command_runner.go:130] > "id": "83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e",
I0214 03:44:34.454520 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454535 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy:v1.28.4"
I0214 03:44:34.454544 1521705 command_runner.go:130] > ],
I0214 03:44:34.454553 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454584 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e",
I0214 03:44:34.454599 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"
I0214 03:44:34.454605 1521705 command_runner.go:130] > ],
I0214 03:44:34.454616 1521705 command_runner.go:130] > "size": "74749335",
I0214 03:44:34.454629 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.454636 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454643 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454650 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454659 1521705 command_runner.go:130] > },
I0214 03:44:34.454666 1521705 command_runner.go:130] > {
I0214 03:44:34.454679 1521705 command_runner.go:130] > "id": "e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1",
I0214 03:44:34.454686 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454696 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler:v1.28.4"
I0214 03:44:34.454703 1521705 command_runner.go:130] > ],
I0214 03:44:34.454722 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454741 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba",
I0214 03:44:34.454753 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"
I0214 03:44:34.454758 1521705 command_runner.go:130] > ],
I0214 03:44:34.454765 1521705 command_runner.go:130] > "size": "61551410",
I0214 03:44:34.454772 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454783 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.454789 1521705 command_runner.go:130] > },
I0214 03:44:34.454800 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454807 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454817 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454823 1521705 command_runner.go:130] > },
I0214 03:44:34.454829 1521705 command_runner.go:130] > {
I0214 03:44:34.454838 1521705 command_runner.go:130] > "id": "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c",
I0214 03:44:34.454842 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.454848 1521705 command_runner.go:130] > "registry.k8s.io/pause:3.9"
I0214 03:44:34.454854 1521705 command_runner.go:130] > ],
I0214 03:44:34.454866 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.454878 1521705 command_runner.go:130] > "registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097",
I0214 03:44:34.454896 1521705 command_runner.go:130] > "registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"
I0214 03:44:34.454906 1521705 command_runner.go:130] > ],
I0214 03:44:34.454913 1521705 command_runner.go:130] > "size": "750414",
I0214 03:44:34.454920 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.454927 1521705 command_runner.go:130] > "value": "65535"
I0214 03:44:34.454931 1521705 command_runner.go:130] > },
I0214 03:44:34.454938 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.454949 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.454960 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.454969 1521705 command_runner.go:130] > }
I0214 03:44:34.454977 1521705 command_runner.go:130] > ]
I0214 03:44:34.454986 1521705 command_runner.go:130] > }
I0214 03:44:34.455254 1521705 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:44:34.455268 1521705 crio.go:415] Images already preloaded, skipping extraction
I0214 03:44:34.455328 1521705 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:44:34.489344 1521705 command_runner.go:130] > {
I0214 03:44:34.489372 1521705 command_runner.go:130] > "images": [
I0214 03:44:34.489376 1521705 command_runner.go:130] > {
I0214 03:44:34.489384 1521705 command_runner.go:130] > "id": "c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc",
I0214 03:44:34.489390 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.489395 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd:v20230809-80a64d96"
I0214 03:44:34.489399 1521705 command_runner.go:130] > ],
I0214 03:44:34.489403 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.489414 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052",
I0214 03:44:34.489431 1521705 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"
I0214 03:44:34.489440 1521705 command_runner.go:130] > ],
I0214 03:44:34.489451 1521705 command_runner.go:130] > "size": "65258016",
I0214 03:44:34.489459 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.489464 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.489478 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.489485 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.489489 1521705 command_runner.go:130] > },
I0214 03:44:34.489494 1521705 command_runner.go:130] > {
I0214 03:44:34.489504 1521705 command_runner.go:130] > "id": "8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a",
I0214 03:44:34.489515 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.489527 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox:1.28"
I0214 03:44:34.489535 1521705 command_runner.go:130] > ],
I0214 03:44:34.489546 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.489561 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335",
I0214 03:44:34.489570 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12"
I0214 03:44:34.489576 1521705 command_runner.go:130] > ],
I0214 03:44:34.489581 1521705 command_runner.go:130] > "size": "1363676",
I0214 03:44:34.489590 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.489610 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.489625 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.489632 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.489641 1521705 command_runner.go:130] > },
I0214 03:44:34.489654 1521705 command_runner.go:130] > {
I0214 03:44:34.489664 1521705 command_runner.go:130] > "id": "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562",
I0214 03:44:34.489673 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.489685 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner:v5"
I0214 03:44:34.489699 1521705 command_runner.go:130] > ],
I0214 03:44:34.489710 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.489726 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944",
I0214 03:44:34.489741 1521705 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"
I0214 03:44:34.489748 1521705 command_runner.go:130] > ],
I0214 03:44:34.489752 1521705 command_runner.go:130] > "size": "31470524",
I0214 03:44:34.489762 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.489773 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.489783 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.489793 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.489802 1521705 command_runner.go:130] > },
I0214 03:44:34.489811 1521705 command_runner.go:130] > {
I0214 03:44:34.489824 1521705 command_runner.go:130] > "id": "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc",
I0214 03:44:34.489832 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.489844 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns:v1.10.1"
I0214 03:44:34.489853 1521705 command_runner.go:130] > ],
I0214 03:44:34.489861 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.489877 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e",
I0214 03:44:34.489901 1521705 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"
I0214 03:44:34.489910 1521705 command_runner.go:130] > ],
I0214 03:44:34.489919 1521705 command_runner.go:130] > "size": "53621675",
I0214 03:44:34.489924 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.489933 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.489944 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.489955 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.489963 1521705 command_runner.go:130] > },
I0214 03:44:34.489985 1521705 command_runner.go:130] > {
I0214 03:44:34.489998 1521705 command_runner.go:130] > "id": "73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9",
I0214 03:44:34.490083 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490106 1521705 command_runner.go:130] > "registry.k8s.io/etcd:3.5.9-0"
I0214 03:44:34.490117 1521705 command_runner.go:130] > ],
I0214 03:44:34.490128 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490161 1521705 command_runner.go:130] > "registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15",
I0214 03:44:34.490179 1521705 command_runner.go:130] > "registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"
I0214 03:44:34.490190 1521705 command_runner.go:130] > ],
I0214 03:44:34.490202 1521705 command_runner.go:130] > "size": "295456551",
I0214 03:44:34.490213 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.490225 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.490235 1521705 command_runner.go:130] > },
I0214 03:44:34.490245 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.490256 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.490268 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.490279 1521705 command_runner.go:130] > },
I0214 03:44:34.490290 1521705 command_runner.go:130] > {
I0214 03:44:34.490313 1521705 command_runner.go:130] > "id": "7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257",
I0214 03:44:34.490323 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490335 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver:v1.28.4"
I0214 03:44:34.490346 1521705 command_runner.go:130] > ],
I0214 03:44:34.490358 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490375 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499",
I0214 03:44:34.490406 1521705 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"
I0214 03:44:34.490415 1521705 command_runner.go:130] > ],
I0214 03:44:34.490424 1521705 command_runner.go:130] > "size": "127226832",
I0214 03:44:34.490436 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.490448 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.490459 1521705 command_runner.go:130] > },
I0214 03:44:34.490470 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.490479 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.490491 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.490500 1521705 command_runner.go:130] > },
I0214 03:44:34.490504 1521705 command_runner.go:130] > {
I0214 03:44:34.490516 1521705 command_runner.go:130] > "id": "d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591",
I0214 03:44:34.490529 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490539 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager:v1.28.4"
I0214 03:44:34.490546 1521705 command_runner.go:130] > ],
I0214 03:44:34.490555 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490578 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c",
I0214 03:44:34.490596 1521705 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"
I0214 03:44:34.490607 1521705 command_runner.go:130] > ],
I0214 03:44:34.490620 1521705 command_runner.go:130] > "size": "123261750",
I0214 03:44:34.490628 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.490640 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.490651 1521705 command_runner.go:130] > },
I0214 03:44:34.490659 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.490670 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.490677 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.490689 1521705 command_runner.go:130] > },
I0214 03:44:34.490700 1521705 command_runner.go:130] > {
I0214 03:44:34.490711 1521705 command_runner.go:130] > "id": "83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e",
I0214 03:44:34.490724 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490737 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy:v1.28.4"
I0214 03:44:34.490748 1521705 command_runner.go:130] > ],
I0214 03:44:34.490759 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490803 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e",
I0214 03:44:34.490821 1521705 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"
I0214 03:44:34.490832 1521705 command_runner.go:130] > ],
I0214 03:44:34.490849 1521705 command_runner.go:130] > "size": "74749335",
I0214 03:44:34.490861 1521705 command_runner.go:130] > "uid": null,
I0214 03:44:34.490872 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.490882 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.490892 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.490902 1521705 command_runner.go:130] > },
I0214 03:44:34.490913 1521705 command_runner.go:130] > {
I0214 03:44:34.490928 1521705 command_runner.go:130] > "id": "e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1",
I0214 03:44:34.490940 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.490953 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler:v1.28.4"
I0214 03:44:34.490964 1521705 command_runner.go:130] > ],
I0214 03:44:34.490979 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.490992 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba",
I0214 03:44:34.491009 1521705 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"
I0214 03:44:34.491021 1521705 command_runner.go:130] > ],
I0214 03:44:34.491033 1521705 command_runner.go:130] > "size": "61551410",
I0214 03:44:34.491045 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.491056 1521705 command_runner.go:130] > "value": "0"
I0214 03:44:34.491149 1521705 command_runner.go:130] > },
I0214 03:44:34.491173 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.491180 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.491191 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.491200 1521705 command_runner.go:130] > },
I0214 03:44:34.491209 1521705 command_runner.go:130] > {
I0214 03:44:34.491223 1521705 command_runner.go:130] > "id": "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c",
I0214 03:44:34.491233 1521705 command_runner.go:130] > "repoTags": [
I0214 03:44:34.491244 1521705 command_runner.go:130] > "registry.k8s.io/pause:3.9"
I0214 03:44:34.491252 1521705 command_runner.go:130] > ],
I0214 03:44:34.491256 1521705 command_runner.go:130] > "repoDigests": [
I0214 03:44:34.491271 1521705 command_runner.go:130] > "registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097",
I0214 03:44:34.491296 1521705 command_runner.go:130] > "registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"
I0214 03:44:34.491305 1521705 command_runner.go:130] > ],
I0214 03:44:34.491315 1521705 command_runner.go:130] > "size": "750414",
I0214 03:44:34.491325 1521705 command_runner.go:130] > "uid": {
I0214 03:44:34.491340 1521705 command_runner.go:130] > "value": "65535"
I0214 03:44:34.491348 1521705 command_runner.go:130] > },
I0214 03:44:34.491363 1521705 command_runner.go:130] > "username": "",
I0214 03:44:34.491374 1521705 command_runner.go:130] > "spec": null,
I0214 03:44:34.491385 1521705 command_runner.go:130] > "pinned": false
I0214 03:44:34.491406 1521705 command_runner.go:130] > }
I0214 03:44:34.491415 1521705 command_runner.go:130] > ]
I0214 03:44:34.491423 1521705 command_runner.go:130] > }
I0214 03:44:34.491595 1521705 crio.go:496] all images are preloaded for cri-o runtime.
I0214 03:44:34.491610 1521705 cache_images.go:84] Images are preloaded, skipping loading
I0214 03:44:34.491618 1521705 kubeadm.go:928] updating node { 192.168.39.169 8443 v1.28.4 crio true true} ...
I0214 03:44:34.491773 1521705 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=multinode-920904 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.169
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:multinode-920904 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 03:44:34.491863 1521705 ssh_runner.go:195] Run: crio config
I0214 03:44:34.551661 1521705 command_runner.go:130] > # The CRI-O configuration file specifies all of the available configuration
I0214 03:44:34.551689 1521705 command_runner.go:130] > # options and command-line flags for the crio(8) OCI Kubernetes Container Runtime
I0214 03:44:34.551704 1521705 command_runner.go:130] > # daemon, but in a TOML format that can be more easily modified and versioned.
I0214 03:44:34.551707 1521705 command_runner.go:130] > #
I0214 03:44:34.551730 1521705 command_runner.go:130] > # Please refer to crio.conf(5) for details of all configuration options.
I0214 03:44:34.551742 1521705 command_runner.go:130] > # CRI-O supports partial configuration reload during runtime, which can be
I0214 03:44:34.551756 1521705 command_runner.go:130] > # done by sending SIGHUP to the running process. Currently supported options
I0214 03:44:34.551770 1521705 command_runner.go:130] > # are explicitly mentioned with: 'This option supports live configuration
I0214 03:44:34.551776 1521705 command_runner.go:130] > # reload'.
I0214 03:44:34.551785 1521705 command_runner.go:130] > # CRI-O reads its storage defaults from the containers-storage.conf(5) file
I0214 03:44:34.551796 1521705 command_runner.go:130] > # located at /etc/containers/storage.conf. Modify this storage configuration if
I0214 03:44:34.551808 1521705 command_runner.go:130] > # you want to change the system's defaults. If you want to modify storage just
I0214 03:44:34.551818 1521705 command_runner.go:130] > # for CRI-O, you can change the storage configuration options here.
I0214 03:44:34.551832 1521705 command_runner.go:130] > [crio]
I0214 03:44:34.551838 1521705 command_runner.go:130] > # Path to the "root directory". CRI-O stores all of its data, including
I0214 03:44:34.551843 1521705 command_runner.go:130] > # containers images, in this directory.
I0214 03:44:34.551849 1521705 command_runner.go:130] > root = "/var/lib/containers/storage"
I0214 03:44:34.551863 1521705 command_runner.go:130] > # Path to the "run directory". CRI-O stores all of its state in this directory.
I0214 03:44:34.551994 1521705 command_runner.go:130] > runroot = "/var/run/containers/storage"
I0214 03:44:34.552021 1521705 command_runner.go:130] > # Storage driver used to manage the storage of images and containers. Please
I0214 03:44:34.552032 1521705 command_runner.go:130] > # refer to containers-storage.conf(5) to see all available storage drivers.
I0214 03:44:34.552144 1521705 command_runner.go:130] > storage_driver = "overlay"
I0214 03:44:34.552165 1521705 command_runner.go:130] > # List to pass options to the storage driver. Please refer to
I0214 03:44:34.552176 1521705 command_runner.go:130] > # containers-storage.conf(5) to see all available storage options.
I0214 03:44:34.552197 1521705 command_runner.go:130] > storage_option = [
I0214 03:44:34.552479 1521705 command_runner.go:130] > "overlay.mountopt=nodev,metacopy=on",
I0214 03:44:34.552582 1521705 command_runner.go:130] > ]
I0214 03:44:34.552594 1521705 command_runner.go:130] > # The default log directory where all logs will go unless directly specified by
I0214 03:44:34.552603 1521705 command_runner.go:130] > # the kubelet. The log directory specified must be an absolute directory.
I0214 03:44:34.553124 1521705 command_runner.go:130] > # log_dir = "/var/log/crio/pods"
I0214 03:44:34.553135 1521705 command_runner.go:130] > # Location for CRI-O to lay down the temporary version file.
I0214 03:44:34.553140 1521705 command_runner.go:130] > # It is used to check if crio wipe should wipe containers, which should
I0214 03:44:34.553145 1521705 command_runner.go:130] > # always happen on a node reboot
I0214 03:44:34.553548 1521705 command_runner.go:130] > # version_file = "/var/run/crio/version"
I0214 03:44:34.553560 1521705 command_runner.go:130] > # Location for CRI-O to lay down the persistent version file.
I0214 03:44:34.553570 1521705 command_runner.go:130] > # It is used to check if crio wipe should wipe images, which should
I0214 03:44:34.553587 1521705 command_runner.go:130] > # only happen when CRI-O has been upgraded
I0214 03:44:34.553879 1521705 command_runner.go:130] > # version_file_persist = "/var/lib/crio/version"
I0214 03:44:34.553889 1521705 command_runner.go:130] > # InternalWipe is whether CRI-O should wipe containers and images after a reboot when the server starts.
I0214 03:44:34.553900 1521705 command_runner.go:130] > # If set to false, one must use the external command 'crio wipe' to wipe the containers and images in these situations.
I0214 03:44:34.554207 1521705 command_runner.go:130] > # internal_wipe = true
I0214 03:44:34.554215 1521705 command_runner.go:130] > # Location for CRI-O to lay down the clean shutdown file.
I0214 03:44:34.554221 1521705 command_runner.go:130] > # It is used to check whether crio had time to sync before shutting down.
I0214 03:44:34.554230 1521705 command_runner.go:130] > # If not found, crio wipe will clear the storage directory.
I0214 03:44:34.554631 1521705 command_runner.go:130] > # clean_shutdown_file = "/var/lib/crio/clean.shutdown"
I0214 03:44:34.554640 1521705 command_runner.go:130] > # The crio.api table contains settings for the kubelet/gRPC interface.
I0214 03:44:34.554649 1521705 command_runner.go:130] > [crio.api]
I0214 03:44:34.554658 1521705 command_runner.go:130] > # Path to AF_LOCAL socket on which CRI-O will listen.
I0214 03:44:34.554930 1521705 command_runner.go:130] > # listen = "/var/run/crio/crio.sock"
I0214 03:44:34.554939 1521705 command_runner.go:130] > # IP address on which the stream server will listen.
I0214 03:44:34.555275 1521705 command_runner.go:130] > # stream_address = "127.0.0.1"
I0214 03:44:34.555286 1521705 command_runner.go:130] > # The port on which the stream server will listen. If the port is set to "0", then
I0214 03:44:34.555293 1521705 command_runner.go:130] > # CRI-O will allocate a random free port number.
I0214 03:44:34.555755 1521705 command_runner.go:130] > # stream_port = "0"
I0214 03:44:34.555764 1521705 command_runner.go:130] > # Enable encrypted TLS transport of the stream server.
I0214 03:44:34.555861 1521705 command_runner.go:130] > # stream_enable_tls = false
I0214 03:44:34.555879 1521705 command_runner.go:130] > # Length of time until open streams terminate due to lack of activity
I0214 03:44:34.555888 1521705 command_runner.go:130] > # stream_idle_timeout = ""
I0214 03:44:34.555900 1521705 command_runner.go:130] > # Path to the x509 certificate file used to serve the encrypted stream. This
I0214 03:44:34.555914 1521705 command_runner.go:130] > # file can change, and CRI-O will automatically pick up the changes within 5
I0214 03:44:34.555922 1521705 command_runner.go:130] > # minutes.
I0214 03:44:34.555933 1521705 command_runner.go:130] > # stream_tls_cert = ""
I0214 03:44:34.555944 1521705 command_runner.go:130] > # Path to the key file used to serve the encrypted stream. This file can
I0214 03:44:34.555964 1521705 command_runner.go:130] > # change and CRI-O will automatically pick up the changes within 5 minutes.
I0214 03:44:34.555996 1521705 command_runner.go:130] > # stream_tls_key = ""
I0214 03:44:34.556011 1521705 command_runner.go:130] > # Path to the x509 CA(s) file used to verify and authenticate client
I0214 03:44:34.556026 1521705 command_runner.go:130] > # communication with the encrypted stream. This file can change and CRI-O will
I0214 03:44:34.556039 1521705 command_runner.go:130] > # automatically pick up the changes within 5 minutes.
I0214 03:44:34.556051 1521705 command_runner.go:130] > # stream_tls_ca = ""
I0214 03:44:34.556068 1521705 command_runner.go:130] > # Maximum grpc send message size in bytes. If not set or <=0, then CRI-O will default to 16 * 1024 * 1024.
I0214 03:44:34.556079 1521705 command_runner.go:130] > grpc_max_send_msg_size = 16777216
I0214 03:44:34.556096 1521705 command_runner.go:130] > # Maximum grpc receive message size. If not set or <= 0, then CRI-O will default to 16 * 1024 * 1024.
I0214 03:44:34.556108 1521705 command_runner.go:130] > grpc_max_recv_msg_size = 16777216
I0214 03:44:34.556140 1521705 command_runner.go:130] > # The crio.runtime table contains settings pertaining to the OCI runtime used
I0214 03:44:34.556153 1521705 command_runner.go:130] > # and options for how to set up and manage the OCI runtime.
I0214 03:44:34.556164 1521705 command_runner.go:130] > [crio.runtime]
I0214 03:44:34.556178 1521705 command_runner.go:130] > # A list of ulimits to be set in containers by default, specified as
I0214 03:44:34.556191 1521705 command_runner.go:130] > # "<ulimit name>=<soft limit>:<hard limit>", for example:
I0214 03:44:34.556201 1521705 command_runner.go:130] > # "nofile=1024:2048"
I0214 03:44:34.556213 1521705 command_runner.go:130] > # If nothing is set here, settings will be inherited from the CRI-O daemon
I0214 03:44:34.556224 1521705 command_runner.go:130] > # default_ulimits = [
I0214 03:44:34.556233 1521705 command_runner.go:130] > # ]
I0214 03:44:34.556248 1521705 command_runner.go:130] > # If true, the runtime will not use pivot_root, but instead use MS_MOVE.
I0214 03:44:34.556260 1521705 command_runner.go:130] > # no_pivot = false
I0214 03:44:34.556273 1521705 command_runner.go:130] > # decryption_keys_path is the path where the keys required for
I0214 03:44:34.556285 1521705 command_runner.go:130] > # image decryption are stored. This option supports live configuration reload.
I0214 03:44:34.556297 1521705 command_runner.go:130] > # decryption_keys_path = "/etc/crio/keys/"
I0214 03:44:34.556311 1521705 command_runner.go:130] > # Path to the conmon binary, used for monitoring the OCI runtime.
I0214 03:44:34.556324 1521705 command_runner.go:130] > # Will be searched for using $PATH if empty.
I0214 03:44:34.556339 1521705 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorEnv.
I0214 03:44:34.556355 1521705 command_runner.go:130] > conmon = "/usr/libexec/crio/conmon"
I0214 03:44:34.556367 1521705 command_runner.go:130] > # Cgroup setting for conmon
I0214 03:44:34.556381 1521705 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorCgroup.
I0214 03:44:34.556392 1521705 command_runner.go:130] > conmon_cgroup = "pod"
I0214 03:44:34.556405 1521705 command_runner.go:130] > # Environment variable list for the conmon process, used for passing necessary
I0214 03:44:34.556417 1521705 command_runner.go:130] > # environment variables to conmon or the runtime.
I0214 03:44:34.556438 1521705 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorEnv.
I0214 03:44:34.556447 1521705 command_runner.go:130] > conmon_env = [
I0214 03:44:34.556459 1521705 command_runner.go:130] > "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
I0214 03:44:34.556467 1521705 command_runner.go:130] > ]
I0214 03:44:34.556489 1521705 command_runner.go:130] > # Additional environment variables to set for all the
I0214 03:44:34.556502 1521705 command_runner.go:130] > # containers. These are overridden if set in the
I0214 03:44:34.556515 1521705 command_runner.go:130] > # container image spec or in the container runtime configuration.
I0214 03:44:34.556526 1521705 command_runner.go:130] > # default_env = [
I0214 03:44:34.556535 1521705 command_runner.go:130] > # ]
I0214 03:44:34.556546 1521705 command_runner.go:130] > # If true, SELinux will be used for pod separation on the host.
I0214 03:44:34.556555 1521705 command_runner.go:130] > # selinux = false
I0214 03:44:34.556567 1521705 command_runner.go:130] > # Path to the seccomp.json profile which is used as the default seccomp profile
I0214 03:44:34.556582 1521705 command_runner.go:130] > # for the runtime. If not specified, then the internal default seccomp profile
I0214 03:44:34.556595 1521705 command_runner.go:130] > # will be used. This option supports live configuration reload.
I0214 03:44:34.556606 1521705 command_runner.go:130] > # seccomp_profile = ""
I0214 03:44:34.556618 1521705 command_runner.go:130] > # Changes the meaning of an empty seccomp profile. By default
I0214 03:44:34.556631 1521705 command_runner.go:130] > # (and according to CRI spec), an empty profile means unconfined.
I0214 03:44:34.556645 1521705 command_runner.go:130] > # This option tells CRI-O to treat an empty profile as the default profile,
I0214 03:44:34.556656 1521705 command_runner.go:130] > # which might increase security.
I0214 03:44:34.556668 1521705 command_runner.go:130] > seccomp_use_default_when_empty = false
I0214 03:44:34.556683 1521705 command_runner.go:130] > # Used to change the name of the default AppArmor profile of CRI-O. The default
I0214 03:44:34.556697 1521705 command_runner.go:130] > # profile name is "crio-default". This profile only takes effect if the user
I0214 03:44:34.556714 1521705 command_runner.go:130] > # does not specify a profile via the Kubernetes Pod's metadata annotation. If
I0214 03:44:34.556729 1521705 command_runner.go:130] > # the profile is set to "unconfined", then this equals to disabling AppArmor.
I0214 03:44:34.556740 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.556749 1521705 command_runner.go:130] > # apparmor_profile = "crio-default"
I0214 03:44:34.556763 1521705 command_runner.go:130] > # Path to the blockio class configuration file for configuring
I0214 03:44:34.556774 1521705 command_runner.go:130] > # the cgroup blockio controller.
I0214 03:44:34.556788 1521705 command_runner.go:130] > # blockio_config_file = ""
I0214 03:44:34.556803 1521705 command_runner.go:130] > # Used to change irqbalance service config file path which is used for configuring
I0214 03:44:34.556814 1521705 command_runner.go:130] > # irqbalance daemon.
I0214 03:44:34.556824 1521705 command_runner.go:130] > # irqbalance_config_file = "/etc/sysconfig/irqbalance"
I0214 03:44:34.556839 1521705 command_runner.go:130] > # Path to the RDT configuration file for configuring the resctrl pseudo-filesystem.
I0214 03:44:34.556851 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.556862 1521705 command_runner.go:130] > # rdt_config_file = ""
I0214 03:44:34.556873 1521705 command_runner.go:130] > # Cgroup management implementation used for the runtime.
I0214 03:44:34.556885 1521705 command_runner.go:130] > cgroup_manager = "cgroupfs"
I0214 03:44:34.556899 1521705 command_runner.go:130] > # Specify whether the image pull must be performed in a separate cgroup.
I0214 03:44:34.556910 1521705 command_runner.go:130] > # separate_pull_cgroup = ""
I0214 03:44:34.556922 1521705 command_runner.go:130] > # List of default capabilities for containers. If it is empty or commented out,
I0214 03:44:34.556940 1521705 command_runner.go:130] > # only the capabilities defined in the containers json file by the user/kube
I0214 03:44:34.556951 1521705 command_runner.go:130] > # will be added.
I0214 03:44:34.556961 1521705 command_runner.go:130] > # default_capabilities = [
I0214 03:44:34.556971 1521705 command_runner.go:130] > # "CHOWN",
I0214 03:44:34.556980 1521705 command_runner.go:130] > # "DAC_OVERRIDE",
I0214 03:44:34.556990 1521705 command_runner.go:130] > # "FSETID",
I0214 03:44:34.557000 1521705 command_runner.go:130] > # "FOWNER",
I0214 03:44:34.557007 1521705 command_runner.go:130] > # "SETGID",
I0214 03:44:34.557017 1521705 command_runner.go:130] > # "SETUID",
I0214 03:44:34.557026 1521705 command_runner.go:130] > # "SETPCAP",
I0214 03:44:34.557036 1521705 command_runner.go:130] > # "NET_BIND_SERVICE",
I0214 03:44:34.557043 1521705 command_runner.go:130] > # "KILL",
I0214 03:44:34.557050 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557063 1521705 command_runner.go:130] > # List of default sysctls. If it is empty or commented out, only the sysctls
I0214 03:44:34.557076 1521705 command_runner.go:130] > # defined in the container json file by the user/kube will be added.
I0214 03:44:34.557087 1521705 command_runner.go:130] > # default_sysctls = [
I0214 03:44:34.557096 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557105 1521705 command_runner.go:130] > # List of devices on the host that a
I0214 03:44:34.557126 1521705 command_runner.go:130] > # user can specify with the "io.kubernetes.cri-o.Devices" allowed annotation.
I0214 03:44:34.557136 1521705 command_runner.go:130] > # allowed_devices = [
I0214 03:44:34.557144 1521705 command_runner.go:130] > # "/dev/fuse",
I0214 03:44:34.557154 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557163 1521705 command_runner.go:130] > # List of additional devices. specified as
I0214 03:44:34.557180 1521705 command_runner.go:130] > # "<device-on-host>:<device-on-container>:<permissions>", for example: "--device=/dev/sdc:/dev/xvdc:rwm".
I0214 03:44:34.557193 1521705 command_runner.go:130] > # If it is empty or commented out, only the devices
I0214 03:44:34.557237 1521705 command_runner.go:130] > # defined in the container json file by the user/kube will be added.
I0214 03:44:34.557248 1521705 command_runner.go:130] > # additional_devices = [
I0214 03:44:34.557267 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557281 1521705 command_runner.go:130] > # List of directories to scan for CDI Spec files.
I0214 03:44:34.557291 1521705 command_runner.go:130] > # cdi_spec_dirs = [
I0214 03:44:34.557299 1521705 command_runner.go:130] > # "/etc/cdi",
I0214 03:44:34.557310 1521705 command_runner.go:130] > # "/var/run/cdi",
I0214 03:44:34.557319 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557331 1521705 command_runner.go:130] > # Change the default behavior of setting container devices uid/gid from CRI's
I0214 03:44:34.557345 1521705 command_runner.go:130] > # SecurityContext (RunAsUser/RunAsGroup) instead of taking host's uid/gid.
I0214 03:44:34.557355 1521705 command_runner.go:130] > # Defaults to false.
I0214 03:44:34.557370 1521705 command_runner.go:130] > # device_ownership_from_security_context = false
I0214 03:44:34.557384 1521705 command_runner.go:130] > # Path to OCI hooks directories for automatically executed hooks. If one of the
I0214 03:44:34.557398 1521705 command_runner.go:130] > # directories does not exist, then CRI-O will automatically skip them.
I0214 03:44:34.557408 1521705 command_runner.go:130] > # hooks_dir = [
I0214 03:44:34.557421 1521705 command_runner.go:130] > # "/usr/share/containers/oci/hooks.d",
I0214 03:44:34.557435 1521705 command_runner.go:130] > # ]
I0214 03:44:34.557449 1521705 command_runner.go:130] > # Path to the file specifying the defaults mounts for each container. The
I0214 03:44:34.557463 1521705 command_runner.go:130] > # format of the config is /SRC:/DST, one mount per line. Notice that CRI-O reads
I0214 03:44:34.557476 1521705 command_runner.go:130] > # its default mounts from the following two files:
I0214 03:44:34.557486 1521705 command_runner.go:130] > #
I0214 03:44:34.557498 1521705 command_runner.go:130] > # 1) /etc/containers/mounts.conf (i.e., default_mounts_file): This is the
I0214 03:44:34.557513 1521705 command_runner.go:130] > # override file, where users can either add in their own default mounts, or
I0214 03:44:34.557527 1521705 command_runner.go:130] > # override the default mounts shipped with the package.
I0214 03:44:34.557536 1521705 command_runner.go:130] > #
I0214 03:44:34.557548 1521705 command_runner.go:130] > # 2) /usr/share/containers/mounts.conf: This is the default file read for
I0214 03:44:34.557561 1521705 command_runner.go:130] > # mounts. If you want CRI-O to read from a different, specific mounts file,
I0214 03:44:34.557574 1521705 command_runner.go:130] > # you can change the default_mounts_file. Note, if this is done, CRI-O will
I0214 03:44:34.557586 1521705 command_runner.go:130] > # only add mounts it finds in this file.
I0214 03:44:34.557599 1521705 command_runner.go:130] > #
I0214 03:44:34.557610 1521705 command_runner.go:130] > # default_mounts_file = ""
I0214 03:44:34.557626 1521705 command_runner.go:130] > # Maximum number of processes allowed in a container.
I0214 03:44:34.557641 1521705 command_runner.go:130] > # This option is deprecated. The Kubelet flag '--pod-pids-limit' should be used instead.
I0214 03:44:34.557651 1521705 command_runner.go:130] > pids_limit = 1024
I0214 03:44:34.557666 1521705 command_runner.go:130] > # Maximum sized allowed for the container log file. Negative numbers indicate
I0214 03:44:34.557678 1521705 command_runner.go:130] > # that no size limit is imposed. If it is positive, it must be >= 8192 to
I0214 03:44:34.557693 1521705 command_runner.go:130] > # match/exceed conmon's read buffer. The file is truncated and re-opened so the
I0214 03:44:34.557710 1521705 command_runner.go:130] > # limit is never exceeded. This option is deprecated. The Kubelet flag '--container-log-max-size' should be used instead.
I0214 03:44:34.557720 1521705 command_runner.go:130] > # log_size_max = -1
I0214 03:44:34.557736 1521705 command_runner.go:130] > # Whether container output should be logged to journald in addition to the kuberentes log file
I0214 03:44:34.557746 1521705 command_runner.go:130] > # log_to_journald = false
I0214 03:44:34.557758 1521705 command_runner.go:130] > # Path to directory in which container exit files are written to by conmon.
I0214 03:44:34.557770 1521705 command_runner.go:130] > # container_exits_dir = "/var/run/crio/exits"
I0214 03:44:34.557783 1521705 command_runner.go:130] > # Path to directory for container attach sockets.
I0214 03:44:34.557796 1521705 command_runner.go:130] > # container_attach_socket_dir = "/var/run/crio"
I0214 03:44:34.557809 1521705 command_runner.go:130] > # The prefix to use for the source of the bind mounts.
I0214 03:44:34.557820 1521705 command_runner.go:130] > # bind_mount_prefix = ""
I0214 03:44:34.557835 1521705 command_runner.go:130] > # If set to true, all containers will run in read-only mode.
I0214 03:44:34.557845 1521705 command_runner.go:130] > # read_only = false
I0214 03:44:34.557857 1521705 command_runner.go:130] > # Changes the verbosity of the logs based on the level it is set to. Options
I0214 03:44:34.557871 1521705 command_runner.go:130] > # are fatal, panic, error, warn, info, debug and trace. This option supports
I0214 03:44:34.557882 1521705 command_runner.go:130] > # live configuration reload.
I0214 03:44:34.557891 1521705 command_runner.go:130] > # log_level = "info"
I0214 03:44:34.557904 1521705 command_runner.go:130] > # Filter the log messages by the provided regular expression.
I0214 03:44:34.557919 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.557929 1521705 command_runner.go:130] > # log_filter = ""
I0214 03:44:34.557940 1521705 command_runner.go:130] > # The UID mappings for the user namespace of each container. A range is
I0214 03:44:34.557954 1521705 command_runner.go:130] > # specified in the form containerUID:HostUID:Size. Multiple ranges must be
I0214 03:44:34.557963 1521705 command_runner.go:130] > # separated by comma.
I0214 03:44:34.557974 1521705 command_runner.go:130] > # uid_mappings = ""
I0214 03:44:34.557988 1521705 command_runner.go:130] > # The GID mappings for the user namespace of each container. A range is
I0214 03:44:34.558002 1521705 command_runner.go:130] > # specified in the form containerGID:HostGID:Size. Multiple ranges must be
I0214 03:44:34.558012 1521705 command_runner.go:130] > # separated by comma.
I0214 03:44:34.558022 1521705 command_runner.go:130] > # gid_mappings = ""
I0214 03:44:34.558035 1521705 command_runner.go:130] > # If set, CRI-O will reject any attempt to map host UIDs below this value
I0214 03:44:34.558052 1521705 command_runner.go:130] > # into user namespaces. A negative value indicates that no minimum is set,
I0214 03:44:34.558066 1521705 command_runner.go:130] > # so specifying mappings will only be allowed for pods that run as UID 0.
I0214 03:44:34.558082 1521705 command_runner.go:130] > # minimum_mappable_uid = -1
I0214 03:44:34.558096 1521705 command_runner.go:130] > # If set, CRI-O will reject any attempt to map host GIDs below this value
I0214 03:44:34.558110 1521705 command_runner.go:130] > # into user namespaces. A negative value indicates that no minimum is set,
I0214 03:44:34.558124 1521705 command_runner.go:130] > # so specifying mappings will only be allowed for pods that run as UID 0.
I0214 03:44:34.558135 1521705 command_runner.go:130] > # minimum_mappable_gid = -1
I0214 03:44:34.558149 1521705 command_runner.go:130] > # The minimal amount of time in seconds to wait before issuing a timeout
I0214 03:44:34.558163 1521705 command_runner.go:130] > # regarding the proper termination of the container. The lowest possible
I0214 03:44:34.558177 1521705 command_runner.go:130] > # value is 30s, whereas lower values are not considered by CRI-O.
I0214 03:44:34.558187 1521705 command_runner.go:130] > # ctr_stop_timeout = 30
I0214 03:44:34.558199 1521705 command_runner.go:130] > # drop_infra_ctr determines whether CRI-O drops the infra container
I0214 03:44:34.558212 1521705 command_runner.go:130] > # when a pod does not have a private PID namespace, and does not use
I0214 03:44:34.558224 1521705 command_runner.go:130] > # a kernel separating runtime (like kata).
I0214 03:44:34.558237 1521705 command_runner.go:130] > # It requires manage_ns_lifecycle to be true.
I0214 03:44:34.558247 1521705 command_runner.go:130] > drop_infra_ctr = false
I0214 03:44:34.558259 1521705 command_runner.go:130] > # infra_ctr_cpuset determines what CPUs will be used to run infra containers.
I0214 03:44:34.558272 1521705 command_runner.go:130] > # You can use linux CPU list format to specify desired CPUs.
I0214 03:44:34.558292 1521705 command_runner.go:130] > # To get better isolation for guaranteed pods, set this parameter to be equal to kubelet reserved-cpus.
I0214 03:44:34.558303 1521705 command_runner.go:130] > # infra_ctr_cpuset = ""
I0214 03:44:34.558317 1521705 command_runner.go:130] > # The directory where the state of the managed namespaces gets tracked.
I0214 03:44:34.558329 1521705 command_runner.go:130] > # Only used when manage_ns_lifecycle is true.
I0214 03:44:34.558339 1521705 command_runner.go:130] > # namespaces_dir = "/var/run"
I0214 03:44:34.558352 1521705 command_runner.go:130] > # pinns_path is the path to find the pinns binary, which is needed to manage namespace lifecycle
I0214 03:44:34.558363 1521705 command_runner.go:130] > pinns_path = "/usr/bin/pinns"
I0214 03:44:34.558375 1521705 command_runner.go:130] > # default_runtime is the _name_ of the OCI runtime to be used as the default.
I0214 03:44:34.558389 1521705 command_runner.go:130] > # The name is matched against the runtimes map below. If this value is changed,
I0214 03:44:34.558404 1521705 command_runner.go:130] > # the corresponding existing entry from the runtimes map below will be ignored.
I0214 03:44:34.558415 1521705 command_runner.go:130] > # default_runtime = "runc"
I0214 03:44:34.558432 1521705 command_runner.go:130] > # A list of paths that, when absent from the host,
I0214 03:44:34.558449 1521705 command_runner.go:130] > # will cause a container creation to fail (as opposed to the current behavior being created as a directory).
I0214 03:44:34.558468 1521705 command_runner.go:130] > # This option is to protect from source locations whose existence as a directory could jepordize the health of the node, and whose
I0214 03:44:34.558480 1521705 command_runner.go:130] > # creation as a file is not desired either.
I0214 03:44:34.558498 1521705 command_runner.go:130] > # An example is /etc/hostname, which will cause failures on reboot if it's created as a directory, but often doesn't exist because
I0214 03:44:34.558510 1521705 command_runner.go:130] > # the hostname is being managed dynamically.
I0214 03:44:34.558518 1521705 command_runner.go:130] > # absent_mount_sources_to_reject = [
I0214 03:44:34.558531 1521705 command_runner.go:130] > # ]
I0214 03:44:34.558545 1521705 command_runner.go:130] > # The "crio.runtime.runtimes" table defines a list of OCI compatible runtimes.
I0214 03:44:34.558560 1521705 command_runner.go:130] > # The runtime to use is picked based on the runtime handler provided by the CRI.
I0214 03:44:34.558575 1521705 command_runner.go:130] > # If no runtime handler is provided, the runtime will be picked based on the level
I0214 03:44:34.558589 1521705 command_runner.go:130] > # of trust of the workload. Each entry in the table should follow the format:
I0214 03:44:34.558597 1521705 command_runner.go:130] > #
I0214 03:44:34.558606 1521705 command_runner.go:130] > #[crio.runtime.runtimes.runtime-handler]
I0214 03:44:34.558618 1521705 command_runner.go:130] > # runtime_path = "/path/to/the/executable"
I0214 03:44:34.558629 1521705 command_runner.go:130] > # runtime_type = "oci"
I0214 03:44:34.558639 1521705 command_runner.go:130] > # runtime_root = "/path/to/the/root"
I0214 03:44:34.558651 1521705 command_runner.go:130] > # privileged_without_host_devices = false
I0214 03:44:34.558662 1521705 command_runner.go:130] > # allowed_annotations = []
I0214 03:44:34.558672 1521705 command_runner.go:130] > # Where:
I0214 03:44:34.558684 1521705 command_runner.go:130] > # - runtime-handler: name used to identify the runtime
I0214 03:44:34.558698 1521705 command_runner.go:130] > # - runtime_path (optional, string): absolute path to the runtime executable in
I0214 03:44:34.558712 1521705 command_runner.go:130] > # the host filesystem. If omitted, the runtime-handler identifier should match
I0214 03:44:34.558727 1521705 command_runner.go:130] > # the runtime executable name, and the runtime executable should be placed
I0214 03:44:34.558737 1521705 command_runner.go:130] > # in $PATH.
I0214 03:44:34.558755 1521705 command_runner.go:130] > # - runtime_type (optional, string): type of runtime, one of: "oci", "vm". If
I0214 03:44:34.558791 1521705 command_runner.go:130] > # omitted, an "oci" runtime is assumed.
I0214 03:44:34.558808 1521705 command_runner.go:130] > # - runtime_root (optional, string): root directory for storage of containers
I0214 03:44:34.558818 1521705 command_runner.go:130] > # state.
I0214 03:44:34.558833 1521705 command_runner.go:130] > # - runtime_config_path (optional, string): the path for the runtime configuration
I0214 03:44:34.558847 1521705 command_runner.go:130] > # file. This can only be used with when using the VM runtime_type.
I0214 03:44:34.558860 1521705 command_runner.go:130] > # - privileged_without_host_devices (optional, bool): an option for restricting
I0214 03:44:34.558875 1521705 command_runner.go:130] > # host devices from being passed to privileged containers.
I0214 03:44:34.558889 1521705 command_runner.go:130] > # - allowed_annotations (optional, array of strings): an option for specifying
I0214 03:44:34.558904 1521705 command_runner.go:130] > # a list of experimental annotations that this runtime handler is allowed to process.
I0214 03:44:34.558916 1521705 command_runner.go:130] > # The currently recognized values are:
I0214 03:44:34.558931 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.userns-mode" for configuring a user namespace for the pod.
I0214 03:44:34.558948 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.cgroup2-mount-hierarchy-rw" for mounting cgroups writably when set to "true".
I0214 03:44:34.558962 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.Devices" for configuring devices for the pod.
I0214 03:44:34.558976 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.ShmSize" for configuring the size of /dev/shm.
I0214 03:44:34.558992 1521705 command_runner.go:130] > # "io.kubernetes.cri-o.UnifiedCgroup.$CTR_NAME" for configuring the cgroup v2 unified block for a container.
I0214 03:44:34.559007 1521705 command_runner.go:130] > # "io.containers.trace-syscall" for tracing syscalls via the OCI seccomp BPF hook.
I0214 03:44:34.559027 1521705 command_runner.go:130] > # "io.kubernetes.cri.rdt-class" for setting the RDT class of a container
I0214 03:44:34.559045 1521705 command_runner.go:130] > # - monitor_exec_cgroup (optional, string): if set to "container", indicates exec probes
I0214 03:44:34.559057 1521705 command_runner.go:130] > # should be moved to the container's cgroup
I0214 03:44:34.559069 1521705 command_runner.go:130] > [crio.runtime.runtimes.runc]
I0214 03:44:34.559080 1521705 command_runner.go:130] > runtime_path = "/usr/bin/runc"
I0214 03:44:34.559088 1521705 command_runner.go:130] > runtime_type = "oci"
I0214 03:44:34.559099 1521705 command_runner.go:130] > runtime_root = "/run/runc"
I0214 03:44:34.559108 1521705 command_runner.go:130] > runtime_config_path = ""
I0214 03:44:34.559118 1521705 command_runner.go:130] > monitor_path = ""
I0214 03:44:34.559129 1521705 command_runner.go:130] > monitor_cgroup = ""
I0214 03:44:34.559139 1521705 command_runner.go:130] > monitor_exec_cgroup = ""
I0214 03:44:34.559153 1521705 command_runner.go:130] > # crun is a fast and lightweight fully featured OCI runtime and C library for
I0214 03:44:34.559164 1521705 command_runner.go:130] > # running containers
I0214 03:44:34.559173 1521705 command_runner.go:130] > #[crio.runtime.runtimes.crun]
I0214 03:44:34.559188 1521705 command_runner.go:130] > # Kata Containers is an OCI runtime, where containers are run inside lightweight
I0214 03:44:34.559269 1521705 command_runner.go:130] > # VMs. Kata provides additional isolation towards the host, minimizing the host attack
I0214 03:44:34.559283 1521705 command_runner.go:130] > # surface and mitigating the consequences of containers breakout.
I0214 03:44:34.559291 1521705 command_runner.go:130] > # Kata Containers with the default configured VMM
I0214 03:44:34.559300 1521705 command_runner.go:130] > #[crio.runtime.runtimes.kata-runtime]
I0214 03:44:34.559315 1521705 command_runner.go:130] > # Kata Containers with the QEMU VMM
I0214 03:44:34.559327 1521705 command_runner.go:130] > #[crio.runtime.runtimes.kata-qemu]
I0214 03:44:34.559340 1521705 command_runner.go:130] > # Kata Containers with the Firecracker VMM
I0214 03:44:34.559351 1521705 command_runner.go:130] > #[crio.runtime.runtimes.kata-fc]
I0214 03:44:34.559369 1521705 command_runner.go:130] > # The workloads table defines ways to customize containers with different resources
I0214 03:44:34.559382 1521705 command_runner.go:130] > # that work based on annotations, rather than the CRI.
I0214 03:44:34.559393 1521705 command_runner.go:130] > # Note, the behavior of this table is EXPERIMENTAL and may change at any time.
I0214 03:44:34.559410 1521705 command_runner.go:130] > # Each workload, has a name, activation_annotation, annotation_prefix and set of resources it supports mutating.
I0214 03:44:34.559431 1521705 command_runner.go:130] > # The currently supported resources are "cpu" (to configure the cpu shares) and "cpuset" to configure the cpuset.
I0214 03:44:34.559444 1521705 command_runner.go:130] > # Each resource can have a default value specified, or be empty.
I0214 03:44:34.559463 1521705 command_runner.go:130] > # For a container to opt-into this workload, the pod should be configured with the annotation $activation_annotation (key only, value is ignored).
I0214 03:44:34.559480 1521705 command_runner.go:130] > # To customize per-container, an annotation of the form $annotation_prefix.$resource/$ctrName = "value" can be specified
I0214 03:44:34.559494 1521705 command_runner.go:130] > # signifying for that resource type to override the default value.
I0214 03:44:34.559510 1521705 command_runner.go:130] > # If the annotation_prefix is not present, every container in the pod will be given the default values.
I0214 03:44:34.559521 1521705 command_runner.go:130] > # Example:
I0214 03:44:34.559532 1521705 command_runner.go:130] > # [crio.runtime.workloads.workload-type]
I0214 03:44:34.559545 1521705 command_runner.go:130] > # activation_annotation = "io.crio/workload"
I0214 03:44:34.559557 1521705 command_runner.go:130] > # annotation_prefix = "io.crio.workload-type"
I0214 03:44:34.559573 1521705 command_runner.go:130] > # [crio.runtime.workloads.workload-type.resources]
I0214 03:44:34.559584 1521705 command_runner.go:130] > # cpuset = 0
I0214 03:44:34.559594 1521705 command_runner.go:130] > # cpushares = "0-1"
I0214 03:44:34.559603 1521705 command_runner.go:130] > # Where:
I0214 03:44:34.559614 1521705 command_runner.go:130] > # The workload name is workload-type.
I0214 03:44:34.559630 1521705 command_runner.go:130] > # To specify, the pod must have the "io.crio.workload" annotation (this is a precise string match).
I0214 03:44:34.559644 1521705 command_runner.go:130] > # This workload supports setting cpuset and cpu resources.
I0214 03:44:34.559656 1521705 command_runner.go:130] > # annotation_prefix is used to customize the different resources.
I0214 03:44:34.559671 1521705 command_runner.go:130] > # To configure the cpu shares a container gets in the example above, the pod would have to have the following annotation:
I0214 03:44:34.559685 1521705 command_runner.go:130] > # "io.crio.workload-type/$container_name = {"cpushares": "value"}"
I0214 03:44:34.559694 1521705 command_runner.go:130] > #
I0214 03:44:34.559707 1521705 command_runner.go:130] > # The crio.image table contains settings pertaining to the management of OCI images.
I0214 03:44:34.559715 1521705 command_runner.go:130] > #
I0214 03:44:34.559727 1521705 command_runner.go:130] > # CRI-O reads its configured registries defaults from the system wide
I0214 03:44:34.559741 1521705 command_runner.go:130] > # containers-registries.conf(5) located in /etc/containers/registries.conf. If
I0214 03:44:34.559755 1521705 command_runner.go:130] > # you want to modify just CRI-O, you can change the registries configuration in
I0214 03:44:34.559770 1521705 command_runner.go:130] > # this file. Otherwise, leave insecure_registries and registries commented out to
I0214 03:44:34.559784 1521705 command_runner.go:130] > # use the system's defaults from /etc/containers/registries.conf.
I0214 03:44:34.559798 1521705 command_runner.go:130] > [crio.image]
I0214 03:44:34.559812 1521705 command_runner.go:130] > # Default transport for pulling images from a remote container storage.
I0214 03:44:34.559824 1521705 command_runner.go:130] > # default_transport = "docker://"
I0214 03:44:34.559841 1521705 command_runner.go:130] > # The path to a file containing credentials necessary for pulling images from
I0214 03:44:34.559860 1521705 command_runner.go:130] > # secure registries. The file is similar to that of /var/lib/kubelet/config.json
I0214 03:44:34.559870 1521705 command_runner.go:130] > # global_auth_file = ""
I0214 03:44:34.559879 1521705 command_runner.go:130] > # The image used to instantiate infra containers.
I0214 03:44:34.559892 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.559904 1521705 command_runner.go:130] > pause_image = "registry.k8s.io/pause:3.9"
I0214 03:44:34.559919 1521705 command_runner.go:130] > # The path to a file containing credentials specific for pulling the pause_image from
I0214 03:44:34.559933 1521705 command_runner.go:130] > # above. The file is similar to that of /var/lib/kubelet/config.json
I0214 03:44:34.559946 1521705 command_runner.go:130] > # This option supports live configuration reload.
I0214 03:44:34.559956 1521705 command_runner.go:130] > # pause_image_auth_file = ""
I0214 03:44:34.559968 1521705 command_runner.go:130] > # The command to run to have a container stay in the paused state.
I0214 03:44:34.559982 1521705 command_runner.go:130] > # When explicitly set to "", it will fallback to the entrypoint and command
I0214 03:44:34.559995 1521705 command_runner.go:130] > # specified in the pause image. When commented out, it will fallback to the
I0214 03:44:34.560009 1521705 command_runner.go:130] > # default: "/pause". This option supports live configuration reload.
I0214 03:44:34.560021 1521705 command_runner.go:130] > # pause_command = "/pause"
I0214 03:44:34.560038 1521705 command_runner.go:130] > # Path to the file which decides what sort of policy we use when deciding
I0214 03:44:34.560052 1521705 command_runner.go:130] > # whether or not to trust an image that we've pulled. It is not recommended that
I0214 03:44:34.560067 1521705 command_runner.go:130] > # this option be used, as the default behavior of using the system-wide default
I0214 03:44:34.560081 1521705 command_runner.go:130] > # policy (i.e., /etc/containers/policy.json) is most often preferred. Please
I0214 03:44:34.560094 1521705 command_runner.go:130] > # refer to containers-policy.json(5) for more details.
I0214 03:44:34.560105 1521705 command_runner.go:130] > # signature_policy = ""
I0214 03:44:34.560119 1521705 command_runner.go:130] > # List of registries to skip TLS verification for pulling images. Please
I0214 03:44:34.560133 1521705 command_runner.go:130] > # consider configuring the registries via /etc/containers/registries.conf before
I0214 03:44:34.560143 1521705 command_runner.go:130] > # changing them here.
I0214 03:44:34.560154 1521705 command_runner.go:130] > # insecure_registries = [
I0214 03:44:34.560162 1521705 command_runner.go:130] > # ]
I0214 03:44:34.560174 1521705 command_runner.go:130] > # Controls how image volumes are handled. The valid values are mkdir, bind and
I0214 03:44:34.560186 1521705 command_runner.go:130] > # ignore; the latter will ignore volumes entirely.
I0214 03:44:34.560197 1521705 command_runner.go:130] > # image_volumes = "mkdir"
I0214 03:44:34.560209 1521705 command_runner.go:130] > # Temporary directory to use for storing big files
I0214 03:44:34.560218 1521705 command_runner.go:130] > # big_files_temporary_dir = ""
I0214 03:44:34.560232 1521705 command_runner.go:130] > # The crio.network table containers settings pertaining to the management of
I0214 03:44:34.560243 1521705 command_runner.go:130] > # CNI plugins.
I0214 03:44:34.560259 1521705 command_runner.go:130] > [crio.network]
I0214 03:44:34.560273 1521705 command_runner.go:130] > # The default CNI network name to be selected. If not set or "", then
I0214 03:44:34.560286 1521705 command_runner.go:130] > # CRI-O will pick-up the first one found in network_dir.
I0214 03:44:34.560296 1521705 command_runner.go:130] > # cni_default_network = ""
I0214 03:44:34.560308 1521705 command_runner.go:130] > # Path to the directory where CNI configuration files are located.
I0214 03:44:34.560319 1521705 command_runner.go:130] > # network_dir = "/etc/cni/net.d/"
I0214 03:44:34.560332 1521705 command_runner.go:130] > # Paths to directories where CNI plugin binaries are located.
I0214 03:44:34.560342 1521705 command_runner.go:130] > # plugin_dirs = [
I0214 03:44:34.560353 1521705 command_runner.go:130] > # "/opt/cni/bin/",
I0214 03:44:34.560361 1521705 command_runner.go:130] > # ]
I0214 03:44:34.560375 1521705 command_runner.go:130] > # A necessary configuration for Prometheus based metrics retrieval
I0214 03:44:34.560384 1521705 command_runner.go:130] > [crio.metrics]
I0214 03:44:34.560394 1521705 command_runner.go:130] > # Globally enable or disable metrics support.
I0214 03:44:34.560404 1521705 command_runner.go:130] > enable_metrics = true
I0214 03:44:34.560416 1521705 command_runner.go:130] > # Specify enabled metrics collectors.
I0214 03:44:34.560432 1521705 command_runner.go:130] > # Per default all metrics are enabled.
I0214 03:44:34.560446 1521705 command_runner.go:130] > # It is possible, to prefix the metrics with "container_runtime_" and "crio_".
I0214 03:44:34.560461 1521705 command_runner.go:130] > # For example, the metrics collector "operations" would be treated in the same
I0214 03:44:34.560477 1521705 command_runner.go:130] > # way as "crio_operations" and "container_runtime_crio_operations".
I0214 03:44:34.560486 1521705 command_runner.go:130] > # metrics_collectors = [
I0214 03:44:34.560496 1521705 command_runner.go:130] > # "operations",
I0214 03:44:34.560509 1521705 command_runner.go:130] > # "operations_latency_microseconds_total",
I0214 03:44:34.560520 1521705 command_runner.go:130] > # "operations_latency_microseconds",
I0214 03:44:34.560531 1521705 command_runner.go:130] > # "operations_errors",
I0214 03:44:34.560540 1521705 command_runner.go:130] > # "image_pulls_by_digest",
I0214 03:44:34.560550 1521705 command_runner.go:130] > # "image_pulls_by_name",
I0214 03:44:34.560559 1521705 command_runner.go:130] > # "image_pulls_by_name_skipped",
I0214 03:44:34.560567 1521705 command_runner.go:130] > # "image_pulls_failures",
I0214 03:44:34.560578 1521705 command_runner.go:130] > # "image_pulls_successes",
I0214 03:44:34.560590 1521705 command_runner.go:130] > # "image_pulls_layer_size",
I0214 03:44:34.560601 1521705 command_runner.go:130] > # "image_layer_reuse",
I0214 03:44:34.560609 1521705 command_runner.go:130] > # "containers_oom_total",
I0214 03:44:34.560620 1521705 command_runner.go:130] > # "containers_oom",
I0214 03:44:34.560631 1521705 command_runner.go:130] > # "processes_defunct",
I0214 03:44:34.560641 1521705 command_runner.go:130] > # "operations_total",
I0214 03:44:34.560650 1521705 command_runner.go:130] > # "operations_latency_seconds",
I0214 03:44:34.560665 1521705 command_runner.go:130] > # "operations_latency_seconds_total",
I0214 03:44:34.560677 1521705 command_runner.go:130] > # "operations_errors_total",
I0214 03:44:34.560688 1521705 command_runner.go:130] > # "image_pulls_bytes_total",
I0214 03:44:34.560701 1521705 command_runner.go:130] > # "image_pulls_skipped_bytes_total",
I0214 03:44:34.560712 1521705 command_runner.go:130] > # "image_pulls_failure_total",
I0214 03:44:34.560723 1521705 command_runner.go:130] > # "image_pulls_success_total",
I0214 03:44:34.560734 1521705 command_runner.go:130] > # "image_layer_reuse_total",
I0214 03:44:34.560743 1521705 command_runner.go:130] > # "containers_oom_count_total",
I0214 03:44:34.560752 1521705 command_runner.go:130] > # ]
I0214 03:44:34.560762 1521705 command_runner.go:130] > # The port on which the metrics server will listen.
I0214 03:44:34.560773 1521705 command_runner.go:130] > # metrics_port = 9090
I0214 03:44:34.560785 1521705 command_runner.go:130] > # Local socket path to bind the metrics server to
I0214 03:44:34.560796 1521705 command_runner.go:130] > # metrics_socket = ""
I0214 03:44:34.560806 1521705 command_runner.go:130] > # The certificate for the secure metrics server.
I0214 03:44:34.560817 1521705 command_runner.go:130] > # If the certificate is not available on disk, then CRI-O will generate a
I0214 03:44:34.560832 1521705 command_runner.go:130] > # self-signed one. CRI-O also watches for changes of this path and reloads the
I0214 03:44:34.560843 1521705 command_runner.go:130] > # certificate on any modification event.
I0214 03:44:34.560853 1521705 command_runner.go:130] > # metrics_cert = ""
I0214 03:44:34.560870 1521705 command_runner.go:130] > # The certificate key for the secure metrics server.
I0214 03:44:34.560882 1521705 command_runner.go:130] > # Behaves in the same way as the metrics_cert.
I0214 03:44:34.560892 1521705 command_runner.go:130] > # metrics_key = ""
I0214 03:44:34.560903 1521705 command_runner.go:130] > # A necessary configuration for OpenTelemetry trace data exporting
I0214 03:44:34.560913 1521705 command_runner.go:130] > [crio.tracing]
I0214 03:44:34.560925 1521705 command_runner.go:130] > # Globally enable or disable exporting OpenTelemetry traces.
I0214 03:44:34.560940 1521705 command_runner.go:130] > # enable_tracing = false
I0214 03:44:34.560954 1521705 command_runner.go:130] > # Address on which the gRPC trace collector listens on.
I0214 03:44:34.560966 1521705 command_runner.go:130] > # tracing_endpoint = "0.0.0.0:4317"
I0214 03:44:34.560978 1521705 command_runner.go:130] > # Number of samples to collect per million spans.
I0214 03:44:34.560989 1521705 command_runner.go:130] > # tracing_sampling_rate_per_million = 0
I0214 03:44:34.560997 1521705 command_runner.go:130] > # Necessary information pertaining to container and pod stats reporting.
I0214 03:44:34.561002 1521705 command_runner.go:130] > [crio.stats]
I0214 03:44:34.561010 1521705 command_runner.go:130] > # The number of seconds between collecting pod and container stats.
I0214 03:44:34.561018 1521705 command_runner.go:130] > # If set to 0, the stats are collected on-demand instead.
I0214 03:44:34.561024 1521705 command_runner.go:130] > # stats_collection_period = 0
I0214 03:44:34.561107 1521705 command_runner.go:130] ! time="2024-02-14 03:44:34.536905526Z" level=info msg="Starting CRI-O, version: 1.24.1, git: a3bbde8a77c323aa6a485da9a9046299155c6016(dirty)"
I0214 03:44:34.561128 1521705 command_runner.go:130] ! level=info msg="Using default capabilities: CAP_CHOWN, CAP_DAC_OVERRIDE, CAP_FSETID, CAP_FOWNER, CAP_SETGID, CAP_SETUID, CAP_SETPCAP, CAP_NET_BIND_SERVICE, CAP_KILL"
I0214 03:44:34.561312 1521705 cni.go:84] Creating CNI manager for ""
I0214 03:44:34.561331 1521705 cni.go:136] multinode detected (3 nodes found), recommending kindnet
I0214 03:44:34.561347 1521705 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 03:44:34.561390 1521705 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.169 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-920904 NodeName:multinode-920904 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.169"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.169 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:
/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 03:44:34.561564 1521705 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.169
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "multinode-920904"
kubeletExtraArgs:
node-ip: 192.168.39.169
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.169"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 03:44:34.561656 1521705 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 03:44:34.570457 1521705 command_runner.go:130] > kubeadm
I0214 03:44:34.570473 1521705 command_runner.go:130] > kubectl
I0214 03:44:34.570480 1521705 command_runner.go:130] > kubelet
I0214 03:44:34.570744 1521705 binaries.go:44] Found k8s binaries, skipping transfer
I0214 03:44:34.570810 1521705 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 03:44:34.579053 1521705 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (316 bytes)
I0214 03:44:34.595962 1521705 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 03:44:34.612258 1521705 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2160 bytes)
I0214 03:44:34.628600 1521705 ssh_runner.go:195] Run: grep 192.168.39.169 control-plane.minikube.internal$ /etc/hosts
I0214 03:44:34.632320 1521705 command_runner.go:130] > 192.168.39.169 control-plane.minikube.internal
I0214 03:44:34.632371 1521705 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 03:44:34.788381 1521705 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 03:44:34.802441 1521705 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904 for IP: 192.168.39.169
I0214 03:44:34.802463 1521705 certs.go:194] generating shared ca certs ...
I0214 03:44:34.802484 1521705 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 03:44:34.802693 1521705 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 03:44:34.802766 1521705 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 03:44:34.802791 1521705 certs.go:256] generating profile certs ...
I0214 03:44:34.802905 1521705 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/client.key
I0214 03:44:34.802998 1521705 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.key.0118bbc7
I0214 03:44:34.803059 1521705 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.key
I0214 03:44:34.803074 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0214 03:44:34.803094 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0214 03:44:34.803111 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0214 03:44:34.803127 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0214 03:44:34.803143 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0214 03:44:34.803159 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0214 03:44:34.803186 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0214 03:44:34.803203 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0214 03:44:34.803263 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 03:44:34.803306 1521705 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 03:44:34.803320 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 03:44:34.803355 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 03:44:34.803391 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 03:44:34.803432 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 03:44:34.803488 1521705 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 03:44:34.803525 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> /usr/share/ca-certificates/14946922.pem
I0214 03:44:34.803545 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:34.803563 1521705 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem -> /usr/share/ca-certificates/1494692.pem
I0214 03:44:34.804220 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 03:44:34.827065 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 03:44:34.850477 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 03:44:34.872255 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 03:44:34.893746 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 03:44:34.914905 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 03:44:34.935835 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 03:44:34.956911 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/multinode-920904/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 03:44:34.978134 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 03:44:34.999476 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 03:44:35.020841 1521705 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 03:44:35.041881 1521705 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 03:44:35.060060 1521705 ssh_runner.go:195] Run: openssl version
I0214 03:44:35.065164 1521705 command_runner.go:130] > OpenSSL 1.1.1n 15 Mar 2022
I0214 03:44:35.065462 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 03:44:35.075425 1521705 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 03:44:35.079860 1521705 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:44:35.079920 1521705 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 03:44:35.079965 1521705 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 03:44:35.085040 1521705 command_runner.go:130] > 51391683
I0214 03:44:35.085247 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 03:44:35.093781 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 03:44:35.103984 1521705 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 03:44:35.108116 1521705 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:44:35.108279 1521705 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 03:44:35.108397 1521705 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 03:44:35.113957 1521705 command_runner.go:130] > 3ec20f2e
I0214 03:44:35.114031 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 03:44:35.122648 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 03:44:35.133370 1521705 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:35.137806 1521705 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:35.138037 1521705 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:35.138094 1521705 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 03:44:35.143350 1521705 command_runner.go:130] > b5213941
I0214 03:44:35.143415 1521705 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 03:44:35.153019 1521705 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:44:35.157426 1521705 command_runner.go:130] > File: /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 03:44:35.157443 1521705 command_runner.go:130] > Size: 1164 Blocks: 8 IO Block: 4096 regular file
I0214 03:44:35.157449 1521705 command_runner.go:130] > Device: fd01h/64769d Inode: 532797 Links: 1
I0214 03:44:35.157456 1521705 command_runner.go:130] > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root)
I0214 03:44:35.157461 1521705 command_runner.go:130] > Access: 2024-02-14 03:38:07.755157448 +0000
I0214 03:44:35.157466 1521705 command_runner.go:130] > Modify: 2024-02-14 03:38:07.755157448 +0000
I0214 03:44:35.157471 1521705 command_runner.go:130] > Change: 2024-02-14 03:38:07.755157448 +0000
I0214 03:44:35.157480 1521705 command_runner.go:130] > Birth: 2024-02-14 03:38:07.755157448 +0000
I0214 03:44:35.157529 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 03:44:35.162543 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.162813 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 03:44:35.167903 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.168150 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 03:44:35.173273 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.173342 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 03:44:35.178314 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.178551 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 03:44:35.183790 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.183843 1521705 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 03:44:35.188908 1521705 command_runner.go:130] > Certificate will not expire
I0214 03:44:35.189070 1521705 kubeadm.go:391] StartCluster: {Name:multinode-920904 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.
4 ClusterName:multinode-920904 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.169 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.100 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true} {Name:m03 IP:192.168.39.48 Port:0 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false
inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:f
alse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:44:35.189210 1521705 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 03:44:35.189291 1521705 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 03:44:35.232480 1521705 command_runner.go:130] > 3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986
I0214 03:44:35.232524 1521705 command_runner.go:130] > 5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9
I0214 03:44:35.232531 1521705 command_runner.go:130] > 27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c
I0214 03:44:35.232537 1521705 command_runner.go:130] > 16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8
I0214 03:44:35.232543 1521705 command_runner.go:130] > 718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf
I0214 03:44:35.232551 1521705 command_runner.go:130] > 554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547
I0214 03:44:35.232570 1521705 command_runner.go:130] > ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72
I0214 03:44:35.232585 1521705 command_runner.go:130] > e4741d213bd818d97421b82b9b141f40379e0ed9b967da233ad26dba6ccded3f
I0214 03:44:35.234101 1521705 cri.go:89] found id: "3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986"
I0214 03:44:35.234121 1521705 cri.go:89] found id: "5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9"
I0214 03:44:35.234142 1521705 cri.go:89] found id: "27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c"
I0214 03:44:35.234147 1521705 cri.go:89] found id: "16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8"
I0214 03:44:35.234152 1521705 cri.go:89] found id: "718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf"
I0214 03:44:35.234162 1521705 cri.go:89] found id: "554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547"
I0214 03:44:35.234175 1521705 cri.go:89] found id: "ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72"
I0214 03:44:35.234182 1521705 cri.go:89] found id: "e4741d213bd818d97421b82b9b141f40379e0ed9b967da233ad26dba6ccded3f"
I0214 03:44:35.234189 1521705 cri.go:89] found id: ""
I0214 03:44:35.234236 1521705 ssh_runner.go:195] Run: sudo runc list -f json
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 03:37:45 UTC, ends at Wed 2024-02-14 03:48:32 UTC. --
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.458033004Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=809feb5c-3a1a-4ff4-8f03-1265407e1bb6 name=/runtime.v1.RuntimeService/Version
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.459416167Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=8e12d531-95a9-4c3d-818a-0b1ebc394ee2 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.459901542Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707882512459882800,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125543,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=8e12d531-95a9-4c3d-818a-0b1ebc394ee2 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.460881825Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=85ac0637-40e2-453c-b4db-0b80ff10af89 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.460963033Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=85ac0637-40e2-453c-b4db-0b80ff10af89 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.464395340Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:0f3566216aa1257a74b709833810d52a856b587e47fd8ac6d97770661b5a43a9,PodSandboxId:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707882322395267160,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6,PodSandboxId:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:1,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707882286834675197,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern
etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4,PodSandboxId:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707882285986838652,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol
\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:17df1e9f2c31572f561f74ff9a1dfa3420d1f51b639e4a472eac377710a3becf,PodSandboxId:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707882285359886533,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e
9c8b435,},Annotations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475,PodSandboxId:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707882285271700480,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]st
ring{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7,PodSandboxId:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707882278505325412,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kube
rnetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3,PodSandboxId:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707882278345898440,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.contai
ner.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe,PodSandboxId:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707882278001333172,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartC
ount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89,PodSandboxId:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707882277968425103,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f5e2e82998e84a400f5668ccea34368ed24a3c7598a70f47406e0eb33164e87e,PodSandboxId:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707881967969420711,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 0,io.ku
bernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986,PodSandboxId:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707881917032754683,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9,PodSandboxId:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1707881916682538980,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annot
ations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c,PodSandboxId:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,State:CONTAINER_EXITED,CreatedAt:1707881914349117123,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kube
rnetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8,PodSandboxId:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707881912567200070,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]string{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMe
ssagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf,PodSandboxId:353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707881891926165223,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547,PodSandboxId:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707881891742857592,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,
},},&Container{Id:ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72,PodSandboxId:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707881891530400166,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e4741d213bd818d97421b82b9b141f403
79e0ed9b967da233ad26dba6ccded3f,PodSandboxId:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707881891463750831,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=85ac0637-40e2-453c-b4db-0
b80ff10af89 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.525184482Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=2840c7d8-3343-4f73-8c96-014fd2227eb3 name=/runtime.v1.RuntimeService/Version
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.525246686Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=2840c7d8-3343-4f73-8c96-014fd2227eb3 name=/runtime.v1.RuntimeService/Version
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.527123290Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=6f8e2d57-46a2-4c20-905b-60435d7e1bb4 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.527649734Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707882512527634704,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125543,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=6f8e2d57-46a2-4c20-905b-60435d7e1bb4 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.528962085Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=78fdbfac-30c3-4000-bd7c-2bbb7c9f2328 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.529017881Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=78fdbfac-30c3-4000-bd7c-2bbb7c9f2328 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.529336766Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:0f3566216aa1257a74b709833810d52a856b587e47fd8ac6d97770661b5a43a9,PodSandboxId:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707882322395267160,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6,PodSandboxId:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:1,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707882286834675197,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern
etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4,PodSandboxId:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707882285986838652,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol
\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:17df1e9f2c31572f561f74ff9a1dfa3420d1f51b639e4a472eac377710a3becf,PodSandboxId:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707882285359886533,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e
9c8b435,},Annotations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475,PodSandboxId:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707882285271700480,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]st
ring{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7,PodSandboxId:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707882278505325412,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kube
rnetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3,PodSandboxId:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707882278345898440,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.contai
ner.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe,PodSandboxId:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707882278001333172,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartC
ount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89,PodSandboxId:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707882277968425103,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f5e2e82998e84a400f5668ccea34368ed24a3c7598a70f47406e0eb33164e87e,PodSandboxId:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707881967969420711,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 0,io.ku
bernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986,PodSandboxId:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707881917032754683,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9,PodSandboxId:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1707881916682538980,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annot
ations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c,PodSandboxId:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,State:CONTAINER_EXITED,CreatedAt:1707881914349117123,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kube
rnetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8,PodSandboxId:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707881912567200070,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]string{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMe
ssagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf,PodSandboxId:353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707881891926165223,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547,PodSandboxId:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707881891742857592,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,
},},&Container{Id:ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72,PodSandboxId:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707881891530400166,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e4741d213bd818d97421b82b9b141f403
79e0ed9b967da233ad26dba6ccded3f,PodSandboxId:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707881891463750831,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=78fdbfac-30c3-4000-bd7c-2
bbb7c9f2328 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.567564348Z" level=debug msg="Request: &ListPodSandboxRequest{Filter:nil,}" file="go-grpc-middleware/chain.go:25" id=98cc1915-96d2-49ae-b661-1faf85f8d9f6 name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.567905691Z" level=debug msg="Response: &ListPodSandboxResponse{Items:[]*PodSandbox{&PodSandbox{Id:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&PodSandboxMetadata{Name:busybox-5b5d89c9d6-vfm4b,Uid:ada46005-8413-4ffa-9e70-b2a0cb3c7941,Namespace:default,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707882321721098365,Labels:map[string]string{app: busybox,io.kubernetes.container.name: POD,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,pod-template-hash: 5b5d89c9d6,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:44:43.722160736Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-pdpj9,Uid:a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,Namespace:kube-system,Attempt:
1,},State:SANDBOX_READY,CreatedAt:1707882284164461354,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:44:43.722152134Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&PodSandboxMetadata{Name:storage-provisioner,Uid:7b3e114a-bf3d-4001-8f21-6be4e9c8b435,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707882284109778859,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,integration-test: storage-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annotations:map[string]s
tring{kubectl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n,kubernetes.io/config.seen: 2024-02-14T03:44:43.722159676Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&PodSandboxMetadata{Name:kindnet-z6pzc,Uid:57e775c4-dfa0-409a-a6c1-81c354ae5205,Namespace:kube-system,Atte
mpt:1,},State:SANDBOX_READY,CreatedAt:1707882284098017470,Labels:map[string]string{app: kindnet,controller-revision-hash: 5666b6c4d,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,k8s-app: kindnet,pod-template-generation: 1,tier: node,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:44:43.722163040Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&PodSandboxMetadata{Name:kube-proxy-tqs9l,Uid:7baac180-46a6-4d2f-a403-8eff3369f7c0,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707882284062957534,Labels:map[string]string{controller-revision-hash: 8486c7d9cd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,k8s-app: kube-proxy,pod-tem
plate-generation: 1,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:44:43.722158294Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&PodSandboxMetadata{Name:kube-scheduler-multinode-920904,Uid:e6f8f927d6b3cc2b372a318a8e285f39,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707882277429900985,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: e6f8f927d6b3cc2b372a318a8e285f39,kubernetes.io/config.seen: 2024-02-14T03:44:36.719833909Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&PodSandboxMetadata{Name:kube-controller-ma
nager-multinode-920904,Uid:48a5a80865aadc8364cca137e04141ac,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707882277424792270,Labels:map[string]string{component: kube-controller-manager,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 48a5a80865aadc8364cca137e04141ac,kubernetes.io/config.seen: 2024-02-14T03:44:36.719833068Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&PodSandboxMetadata{Name:kube-apiserver-multinode-920904,Uid:3be77efdd656fce83a1ee57d47f0da56,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707882277417620378,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-multinode
-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.39.169:8443,kubernetes.io/config.hash: 3be77efdd656fce83a1ee57d47f0da56,kubernetes.io/config.seen: 2024-02-14T03:44:36.719832108Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&PodSandboxMetadata{Name:etcd-multinode-920904,Uid:b97b3113c9ba0043ea50e1edc3226133,Namespace:kube-system,Attempt:1,},State:SANDBOX_READY,CreatedAt:1707882277381677061,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/etcd.advertise-client-urls: https://192.168.39.169:2379,kuber
netes.io/config.hash: b97b3113c9ba0043ea50e1edc3226133,kubernetes.io/config.seen: 2024-02-14T03:44:36.719828755Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&PodSandboxMetadata{Name:busybox-5b5d89c9d6-vfm4b,Uid:ada46005-8413-4ffa-9e70-b2a0cb3c7941,Namespace:default,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881966612304033,Labels:map[string]string{app: busybox,io.kubernetes.container.name: POD,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,pod-template-hash: 5b5d89c9d6,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:39:26.272293573Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&PodSandboxMetadata{Name:storage-provisioner,Uid:7b3e114a-bf3d-4001-8f21-6be4e9c8b435,Namespace:kube-system,Attemp
t:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881916249303266,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,integration-test: storage-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\
"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n,kubernetes.io/config.seen: 2024-02-14T03:38:35.909364263Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-pdpj9,Uid:a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881916244586323,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:38:35.898156968Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&PodSandboxMetadata{Name:kindnet-z6pzc,Uid:57e775c4-dfa0-409a-a6c1-81c354ae5205,Namespace:kub
e-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881911464880162,Labels:map[string]string{app: kindnet,controller-revision-hash: 5666b6c4d,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,k8s-app: kindnet,pod-template-generation: 1,tier: node,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:38:31.118876417Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&PodSandboxMetadata{Name:kube-proxy-tqs9l,Uid:7baac180-46a6-4d2f-a403-8eff3369f7c0,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881911457597881,Labels:map[string]string{controller-revision-hash: 8486c7d9cd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,k8s-app:
kube-proxy,pod-template-generation: 1,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T03:38:31.102250541Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&PodSandboxMetadata{Name:kube-apiserver-multinode-920904,Uid:3be77efdd656fce83a1ee57d47f0da56,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881890882776043,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.39.169:8443,kubernetes.io/config.hash: 3be77efdd656fce83a1ee57d47f0da56,kubernetes.io/config.seen: 2024-02-14T03:38:10.336795648Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:353a50f5ab
aa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&PodSandboxMetadata{Name:kube-scheduler-multinode-920904,Uid:e6f8f927d6b3cc2b372a318a8e285f39,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881890877731600,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: e6f8f927d6b3cc2b372a318a8e285f39,kubernetes.io/config.seen: 2024-02-14T03:38:10.336797581Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&PodSandboxMetadata{Name:kube-controller-manager-multinode-920904,Uid:48a5a80865aadc8364cca137e04141ac,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881890862711319,Labels:map[string]string{component: ku
be-controller-manager,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 48a5a80865aadc8364cca137e04141ac,kubernetes.io/config.seen: 2024-02-14T03:38:10.336796779Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&PodSandboxMetadata{Name:etcd-multinode-920904,Uid:b97b3113c9ba0043ea50e1edc3226133,Namespace:kube-system,Attempt:0,},State:SANDBOX_NOTREADY,CreatedAt:1707881890839036077,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/etcd.advertise-client-urls: ht
tps://192.168.39.169:2379,kubernetes.io/config.hash: b97b3113c9ba0043ea50e1edc3226133,kubernetes.io/config.seen: 2024-02-14T03:38:10.336792014Z,kubernetes.io/config.source: file,},RuntimeHandler:,},},}" file="go-grpc-middleware/chain.go:25" id=98cc1915-96d2-49ae-b661-1faf85f8d9f6 name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.569741199Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=8aaed63c-0c59-4fb0-8b04-e4010d08f59e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.569847962Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=8aaed63c-0c59-4fb0-8b04-e4010d08f59e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.571350638Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:0f3566216aa1257a74b709833810d52a856b587e47fd8ac6d97770661b5a43a9,PodSandboxId:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707882322395267160,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6,PodSandboxId:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:1,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707882286834675197,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern
etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4,PodSandboxId:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707882285986838652,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol
\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:17df1e9f2c31572f561f74ff9a1dfa3420d1f51b639e4a472eac377710a3becf,PodSandboxId:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707882285359886533,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e
9c8b435,},Annotations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475,PodSandboxId:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707882285271700480,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]st
ring{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7,PodSandboxId:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707882278505325412,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kube
rnetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3,PodSandboxId:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707882278345898440,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.contai
ner.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe,PodSandboxId:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707882278001333172,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartC
ount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89,PodSandboxId:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707882277968425103,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f5e2e82998e84a400f5668ccea34368ed24a3c7598a70f47406e0eb33164e87e,PodSandboxId:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707881967969420711,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 0,io.ku
bernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986,PodSandboxId:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707881917032754683,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9,PodSandboxId:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1707881916682538980,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annot
ations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c,PodSandboxId:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,State:CONTAINER_EXITED,CreatedAt:1707881914349117123,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kube
rnetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8,PodSandboxId:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707881912567200070,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]string{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMe
ssagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf,PodSandboxId:353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707881891926165223,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547,PodSandboxId:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707881891742857592,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,
},},&Container{Id:ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72,PodSandboxId:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707881891530400166,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e4741d213bd818d97421b82b9b141f403
79e0ed9b967da233ad26dba6ccded3f,PodSandboxId:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707881891463750831,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=8aaed63c-0c59-4fb0-8b04-e
4010d08f59e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.578084270Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=b6918161-f0e7-4c0c-b846-aee32cfc612c name=/runtime.v1.RuntimeService/Version
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.578128542Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=b6918161-f0e7-4c0c-b846-aee32cfc612c name=/runtime.v1.RuntimeService/Version
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.580710836Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=c80f0c6c-704e-4552-9b51-83a08a6203cf name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.581079638Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707882512581066620,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125543,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=c80f0c6c-704e-4552-9b51-83a08a6203cf name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.581600839Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=5a856874-59f4-43d7-96c6-19d00a98b83e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.581688266Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=5a856874-59f4-43d7-96c6-19d00a98b83e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 03:48:32 multinode-920904 crio[2888]: time="2024-02-14 03:48:32.581998967Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:0f3566216aa1257a74b709833810d52a856b587e47fd8ac6d97770661b5a43a9,PodSandboxId:2c77162a27641325b9e9c5b596f8ac6c05889e9745f0a39a97919310af4a9c1c,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,State:CONTAINER_RUNNING,CreatedAt:1707882322395267160,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6,PodSandboxId:93233e00e5db79c369895e70416d3f49b590a5781ec4195dacea80b45c98df00,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:1,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052,State:CONTAINER_RUNNING,CreatedAt:1707882286834675197,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubern
etes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4,PodSandboxId:b89bd686af502de977c14a5de506cd8d125237bef55a89450255fc0b64248d5c,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707882285986838652,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol
\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:17df1e9f2c31572f561f74ff9a1dfa3420d1f51b639e4a472eac377710a3becf,PodSandboxId:1c65195deedc01996a326299520c0429f5273dd216415f36d279a0e770fce5bf,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:1,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707882285359886533,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e
9c8b435,},Annotations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475,PodSandboxId:7ba4a85a0adbc22a7a73803a2211f4c5a247d18409afd3c557e85cc40366a695,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707882285271700480,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]st
ring{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7,PodSandboxId:0a4149b0dc6b3c256b0d04838d9db54fcb165e2dccf0c7b0d675625c8861fd90,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707882278505325412,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kube
rnetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3,PodSandboxId:a549b707a1f44395554891a998fbe451f03d76264f429482fd53e4d20471fb0d,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707882278345898440,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.contai
ner.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe,PodSandboxId:539b2a75bf3dc08bb97aed16922af2b1370c377c7dbbe13fb23129e8a0967b39,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707882278001333172,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartC
ount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89,PodSandboxId:30f6d1d1b65cd275f6eb133cfdaf96f67b02cfcce0bac456a8860ab9d395ffa7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707882277968425103,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kuber
netes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f5e2e82998e84a400f5668ccea34368ed24a3c7598a70f47406e0eb33164e87e,PodSandboxId:8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_EXITED,CreatedAt:1707881967969420711,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-5b5d89c9d6-vfm4b,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: ada46005-8413-4ffa-9e70-b2a0cb3c7941,},Annotations:map[string]string{io.kubernetes.container.hash: 4a986a9f,io.kubernetes.container.restartCount: 0,io.ku
bernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986,PodSandboxId:d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707881917032754683,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-pdpj9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5,},Annotations:map[string]string{io.kubernetes.container.hash: c16f5645,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5a23ae349dd428d46d987daae07d3c1961567c08a9d264e68d788a525d3833c9,PodSandboxId:9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_EXITED,CreatedAt:1707881916682538980,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b3e114a-bf3d-4001-8f21-6be4e9c8b435,},Annot
ations:map[string]string{io.kubernetes.container.hash: 14998478,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c,PodSandboxId:9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,Annotations:map[string]string{},},ImageRef:c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc,State:CONTAINER_EXITED,CreatedAt:1707881914349117123,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-z6pzc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 57e775c4-dfa0-409a-a6c1-81c354ae5205,},Annotations:map[string]string{io.kubernetes.container.hash: 31ad4edd,io.kube
rnetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8,PodSandboxId:04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707881912567200070,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tqs9l,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7baac180-46a6-4d2f-a403-8eff3369f7c0,},Annotations:map[string]string{io.kubernetes.container.hash: ec2c428f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMe
ssagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf,PodSandboxId:353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707881891926165223,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e6f8f927d6b3cc2b372a318a8e285f39,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.conta
iner.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547,PodSandboxId:0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707881891742857592,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b97b3113c9ba0043ea50e1edc3226133,},Annotations:map[string]string{io.kubernetes.container.hash: ad3a96a5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,
},},&Container{Id:ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72,PodSandboxId:f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707881891530400166,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 3be77efdd656fce83a1ee57d47f0da56,},Annotations:map[string]string{io.kubernetes.container.hash: 5da981ee,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e4741d213bd818d97421b82b9b141f403
79e0ed9b967da233ad26dba6ccded3f,PodSandboxId:7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707881891463750831,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-multinode-920904,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 48a5a80865aadc8364cca137e04141ac,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=5a856874-59f4-43d7-96c6-1
9d00a98b83e name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
0f3566216aa12 8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a 3 minutes ago Running busybox 1 2c77162a27641 busybox-5b5d89c9d6-vfm4b
756cb939eedab c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc 3 minutes ago Running kindnet-cni 1 93233e00e5db7 kindnet-z6pzc
c68148b204af4 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 3 minutes ago Running coredns 1 b89bd686af502 coredns-5dd5756b68-pdpj9
17df1e9f2c315 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 3 minutes ago Running storage-provisioner 1 1c65195deedc0 storage-provisioner
31097f7bbab9d 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 3 minutes ago Running kube-proxy 1 7ba4a85a0adbc kube-proxy-tqs9l
9b760e70fa057 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 3 minutes ago Running kube-scheduler 1 0a4149b0dc6b3 kube-scheduler-multinode-920904
cbee2963809e1 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 3 minutes ago Running etcd 1 a549b707a1f44 etcd-multinode-920904
2d22ba7cad9b5 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 3 minutes ago Running kube-apiserver 1 539b2a75bf3dc kube-apiserver-multinode-920904
dd468dc00b761 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 3 minutes ago Running kube-controller-manager 1 30f6d1d1b65cd kube-controller-manager-multinode-920904
f5e2e82998e84 gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 9 minutes ago Exited busybox 0 8f69e6bc15e36 busybox-5b5d89c9d6-vfm4b
3c895812a4edb ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 9 minutes ago Exited coredns 0 d7d9ca749ff58 coredns-5dd5756b68-pdpj9
5a23ae349dd42 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 9 minutes ago Exited storage-provisioner 0 9f1e2ecab08f6 storage-provisioner
27fc4fd406688 c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc 9 minutes ago Exited kindnet-cni 0 9320dd54abfbf kindnet-z6pzc
16cf4f0e3c363 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 10 minutes ago Exited kube-proxy 0 04d7a5fd34112 kube-proxy-tqs9l
718f1ba82ee49 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 10 minutes ago Exited kube-scheduler 0 353a50f5abaa2 kube-scheduler-multinode-920904
554d78e9f4988 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 10 minutes ago Exited etcd 0 0fd91233e1946 etcd-multinode-920904
ba1cab6d5491a 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 10 minutes ago Exited kube-apiserver 0 f98b361622007 kube-apiserver-multinode-920904
e4741d213bd81 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 10 minutes ago Exited kube-controller-manager 0 7d9ffb468d165 kube-controller-manager-multinode-920904
==> coredns [3c895812a4edba7c48664a663b5a202bd129462c4f504d11e339b3a4f5f07986] <==
[INFO] 10.244.1.2:39455 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001970411s
[INFO] 10.244.1.2:47611 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000221389s
[INFO] 10.244.1.2:39773 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000100421s
[INFO] 10.244.1.2:56317 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001220097s
[INFO] 10.244.1.2:53097 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000200154s
[INFO] 10.244.1.2:53427 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000076069s
[INFO] 10.244.1.2:41972 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000184662s
[INFO] 10.244.0.3:39821 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000105964s
[INFO] 10.244.0.3:50909 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000112587s
[INFO] 10.244.0.3:59089 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000080452s
[INFO] 10.244.0.3:46772 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000102313s
[INFO] 10.244.1.2:36231 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000254136s
[INFO] 10.244.1.2:38831 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000228594s
[INFO] 10.244.1.2:52834 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000141666s
[INFO] 10.244.1.2:59346 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000247719s
[INFO] 10.244.0.3:38783 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000132293s
[INFO] 10.244.0.3:56592 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000161711s
[INFO] 10.244.0.3:41824 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000105703s
[INFO] 10.244.0.3:37372 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000090808s
[INFO] 10.244.1.2:51249 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000107574s
[INFO] 10.244.1.2:39473 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000254537s
[INFO] 10.244.1.2:59674 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000076546s
[INFO] 10.244.1.2:39285 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000079207s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> coredns [c68148b204af4bb16407c376df812fdd7b6f7cf8ffa0c2911070867004cc48a4] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:36829 - 63389 "HINFO IN 3521760805028779142.724315420791163652. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.028859784s
==> describe nodes <==
Name: multinode-920904
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-920904
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=multinode-920904
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T03_38_19_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:38:15 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-920904
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:48:27 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 03:44:42 +0000 Wed, 14 Feb 2024 03:38:13 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 03:44:42 +0000 Wed, 14 Feb 2024 03:38:13 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 03:44:42 +0000 Wed, 14 Feb 2024 03:38:13 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 03:44:42 +0000 Wed, 14 Feb 2024 03:38:35 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.169
Hostname: multinode-920904
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 8ace496719884738923672e00b4b674a
System UUID: 8ace4967-1988-4738-9236-72e00b4b674a
Boot ID: 16abca97-55c7-4bcb-92f4-3d588d85e570
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-vfm4b 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m6s
kube-system coredns-5dd5756b68-pdpj9 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 10m
kube-system etcd-multinode-920904 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 10m
kube-system kindnet-z6pzc 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 10m
kube-system kube-apiserver-multinode-920904 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 10m
kube-system kube-controller-manager-multinode-920904 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 10m
kube-system kube-proxy-tqs9l 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 10m
kube-system kube-scheduler-multinode-920904 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 10m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 10m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 100m (5%!)(MISSING)
memory 220Mi (10%!)(MISSING) 220Mi (10%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 10m kube-proxy
Normal Starting 3m46s kube-proxy
Normal NodeAllocatableEnforced 10m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 10m kubelet Node multinode-920904 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 10m kubelet Node multinode-920904 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 10m kubelet Node multinode-920904 status is now: NodeHasSufficientPID
Normal Starting 10m kubelet Starting kubelet.
Normal RegisteredNode 10m node-controller Node multinode-920904 event: Registered Node multinode-920904 in Controller
Normal NodeReady 9m57s kubelet Node multinode-920904 status is now: NodeReady
Normal Starting 3m56s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 3m56s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 3m55s (x8 over 3m56s) kubelet Node multinode-920904 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 3m55s (x8 over 3m56s) kubelet Node multinode-920904 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 3m55s (x7 over 3m56s) kubelet Node multinode-920904 status is now: NodeHasSufficientPID
Normal RegisteredNode 3m36s node-controller Node multinode-920904 event: Registered Node multinode-920904 in Controller
Name: multinode-920904-m02
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-920904-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=multinode-920904
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_02_14T03_45_25_0700
minikube.k8s.io/version=v1.32.0
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 03:45:24 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: multinode-920904-m02
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 03:46:05 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Wed, 14 Feb 2024 03:45:54 +0000 Wed, 14 Feb 2024 03:46:46 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Wed, 14 Feb 2024 03:45:54 +0000 Wed, 14 Feb 2024 03:46:46 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Wed, 14 Feb 2024 03:45:54 +0000 Wed, 14 Feb 2024 03:46:46 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Wed, 14 Feb 2024 03:45:54 +0000 Wed, 14 Feb 2024 03:46:46 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.168.39.100
Hostname: multinode-920904-m02
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 9cf8fd3abeeb435084990fad447a659c
System UUID: 9cf8fd3a-beeb-4350-8499-0fad447a659c
Boot ID: 23f20c33-560b-4832-b349-b5a1b3ec6ac3
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-5b5d89c9d6-6jnl5 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m14s
kube-system kindnet-2x6cd 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 9m19s
kube-system kube-proxy-txk85 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m19s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 9m13s kube-proxy
Normal Starting 3m5s kube-proxy
Normal NodeHasSufficientMemory 9m19s (x5 over 9m21s) kubelet Node multinode-920904-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m19s (x5 over 9m21s) kubelet Node multinode-920904-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m19s (x5 over 9m21s) kubelet Node multinode-920904-m02 status is now: NodeHasSufficientPID
Normal NodeReady 9m9s kubelet Node multinode-920904-m02 status is now: NodeReady
Normal NodeHasSufficientMemory 3m8s (x5 over 3m10s) kubelet Node multinode-920904-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 3m8s (x5 over 3m10s) kubelet Node multinode-920904-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 3m8s (x5 over 3m10s) kubelet Node multinode-920904-m02 status is now: NodeHasSufficientPID
Normal NodeReady 3m kubelet Node multinode-920904-m02 status is now: NodeReady
Normal NodeNotReady 106s node-controller Node multinode-920904-m02 status is now: NodeNotReady
==> dmesg <==
[ +4.343119] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.483474] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.134520] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +4.981392] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +10.195124] systemd-fstab-generator[642]: Ignoring "noauto" for root device
[ +0.096857] systemd-fstab-generator[653]: Ignoring "noauto" for root device
[ +0.141067] systemd-fstab-generator[666]: Ignoring "noauto" for root device
[ +0.102826] systemd-fstab-generator[677]: Ignoring "noauto" for root device
[ +0.199286] systemd-fstab-generator[701]: Ignoring "noauto" for root device
[Feb14 03:38] systemd-fstab-generator[802]: Ignoring "noauto" for root device
[ +3.781343] systemd-fstab-generator[981]: Ignoring "noauto" for root device
[ +8.761063] systemd-fstab-generator[1317]: Ignoring "noauto" for root device
[ +12.862802] systemd-fstab-generator[1502]: Ignoring "noauto" for root device
[ +6.685330] kauditd_printk_skb: 18 callbacks suppressed
[Feb14 03:44] systemd-fstab-generator[2815]: Ignoring "noauto" for root device
[ +0.151579] systemd-fstab-generator[2826]: Ignoring "noauto" for root device
[ +0.167971] systemd-fstab-generator[2839]: Ignoring "noauto" for root device
[ +0.140528] systemd-fstab-generator[2850]: Ignoring "noauto" for root device
[ +0.242186] systemd-fstab-generator[2873]: Ignoring "noauto" for root device
[ +0.861190] systemd-fstab-generator[2982]: Ignoring "noauto" for root device
[ +1.791248] systemd-fstab-generator[3105]: Ignoring "noauto" for root device
[ +19.743566] systemd-fstab-generator[3917]: Ignoring "noauto" for root device
==> etcd [554d78e9f4988f9221731b0f10932471d5579ecbf6b5b0270143f8a93fc5f547] <==
{"level":"info","ts":"2024-02-14T03:38:13.606681Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"88d17c48ad0ae483","local-member-attributes":"{Name:multinode-920904 ClientURLs:[https://192.168.39.169:2379]}","request-path":"/0/members/88d17c48ad0ae483/attributes","cluster-id":"dd1030519101f266","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T03:38:13.606837Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T03:38:13.6097Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T03:38:13.610989Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T03:38:13.611902Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.169:2379"}
{"level":"info","ts":"2024-02-14T03:38:13.611995Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T03:38:13.612022Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-02-14T03:38:13.612223Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"dd1030519101f266","local-member-id":"88d17c48ad0ae483","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:38:13.612308Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:38:13.612343Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:39:12.009151Z","caller":"traceutil/trace.go:171","msg":"trace[1811816891] transaction","detail":"{read_only:false; response_revision:446; number_of_response:1; }","duration":"201.493192ms","start":"2024-02-14T03:39:11.807619Z","end":"2024-02-14T03:39:12.009112Z","steps":["trace[1811816891] 'process raft request' (duration: 117.52979ms)","trace[1811816891] 'compare' (duration: 83.587032ms)"],"step_count":2}
{"level":"info","ts":"2024-02-14T03:39:12.272245Z","caller":"traceutil/trace.go:171","msg":"trace[1495052735] transaction","detail":"{read_only:false; response_revision:447; number_of_response:1; }","duration":"253.307554ms","start":"2024-02-14T03:39:12.018922Z","end":"2024-02-14T03:39:12.27223Z","steps":["trace[1495052735] 'process raft request' (duration: 188.005246ms)","trace[1495052735] 'compare' (duration: 65.199162ms)"],"step_count":2}
{"level":"warn","ts":"2024-02-14T03:40:01.335451Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"193.269217ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/\" range_end:\"/registry/services/endpoints0\" count_only:true ","response":"range_response_count:0 size:7"}
{"level":"info","ts":"2024-02-14T03:40:01.33586Z","caller":"traceutil/trace.go:171","msg":"trace[1409512178] range","detail":"{range_begin:/registry/services/endpoints/; range_end:/registry/services/endpoints0; response_count:0; response_revision:571; }","duration":"193.763023ms","start":"2024-02-14T03:40:01.142064Z","end":"2024-02-14T03:40:01.335827Z","steps":["trace[1409512178] 'count revisions from in-memory index tree' (duration: 193.169491ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T03:43:01.735307Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}
{"level":"info","ts":"2024-02-14T03:43:01.735417Z","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"multinode-920904","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.169:2380"],"advertise-client-urls":["https://192.168.39.169:2379"]}
{"level":"warn","ts":"2024-02-14T03:43:01.736879Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
{"level":"warn","ts":"2024-02-14T03:43:01.737096Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
WARNING: 2024/02/14 03:43:01 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"
{"level":"warn","ts":"2024-02-14T03:43:01.838459Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.39.169:2379: use of closed network connection"}
{"level":"warn","ts":"2024-02-14T03:43:01.838601Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.39.169:2379: use of closed network connection"}
{"level":"info","ts":"2024-02-14T03:43:01.838705Z","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"88d17c48ad0ae483","current-leader-member-id":"88d17c48ad0ae483"}
{"level":"info","ts":"2024-02-14T03:43:01.841691Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.39.169:2380"}
{"level":"info","ts":"2024-02-14T03:43:01.841873Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.39.169:2380"}
{"level":"info","ts":"2024-02-14T03:43:01.841909Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"multinode-920904","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.169:2380"],"advertise-client-urls":["https://192.168.39.169:2379"]}
==> etcd [cbee2963809e147f368062a3f735af228a2dec7fc18050de843b19338b5264e3] <==
{"level":"info","ts":"2024-02-14T03:44:40.204585Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"88d17c48ad0ae483","initial-advertise-peer-urls":["https://192.168.39.169:2380"],"listen-peer-urls":["https://192.168.39.169:2380"],"advertise-client-urls":["https://192.168.39.169:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.39.169:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-02-14T03:44:40.204687Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-02-14T03:44:40.20482Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.39.169:2380"}
{"level":"info","ts":"2024-02-14T03:44:40.204851Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.39.169:2380"}
{"level":"info","ts":"2024-02-14T03:44:40.204114Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T03:44:40.204866Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T03:44:40.204874Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T03:44:40.205687Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 switched to configuration voters=(9858797710873388163)"}
{"level":"info","ts":"2024-02-14T03:44:40.206071Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"dd1030519101f266","local-member-id":"88d17c48ad0ae483","added-peer-id":"88d17c48ad0ae483","added-peer-peer-urls":["https://192.168.39.169:2380"]}
{"level":"info","ts":"2024-02-14T03:44:40.206446Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"dd1030519101f266","local-member-id":"88d17c48ad0ae483","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:44:40.20661Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T03:44:41.357591Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 is starting a new election at term 2"}
{"level":"info","ts":"2024-02-14T03:44:41.357683Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 became pre-candidate at term 2"}
{"level":"info","ts":"2024-02-14T03:44:41.3577Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 received MsgPreVoteResp from 88d17c48ad0ae483 at term 2"}
{"level":"info","ts":"2024-02-14T03:44:41.357712Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 became candidate at term 3"}
{"level":"info","ts":"2024-02-14T03:44:41.357717Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 received MsgVoteResp from 88d17c48ad0ae483 at term 3"}
{"level":"info","ts":"2024-02-14T03:44:41.357726Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"88d17c48ad0ae483 became leader at term 3"}
{"level":"info","ts":"2024-02-14T03:44:41.357733Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 88d17c48ad0ae483 elected leader 88d17c48ad0ae483 at term 3"}
{"level":"info","ts":"2024-02-14T03:44:41.360659Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"88d17c48ad0ae483","local-member-attributes":"{Name:multinode-920904 ClientURLs:[https://192.168.39.169:2379]}","request-path":"/0/members/88d17c48ad0ae483/attributes","cluster-id":"dd1030519101f266","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T03:44:41.360828Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T03:44:41.360954Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T03:44:41.361009Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-02-14T03:44:41.361119Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T03:44:41.362152Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T03:44:41.362281Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.169:2379"}
==> kernel <==
03:48:33 up 10 min, 0 users, load average: 0.44, 0.50, 0.30
Linux multinode-920904 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kindnet [27fc4fd406688483ec84b70a13cd25bcc3996bcdacad2ac71bbd527f16a2ea2c] <==
I0214 03:42:15.928931 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:42:25.934047 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:42:25.934097 1 main.go:227] handling current node
I0214 03:42:25.934108 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:42:25.934114 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:42:25.934609 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:42:25.934693 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:42:35.947058 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:42:35.947114 1 main.go:227] handling current node
I0214 03:42:35.947136 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:42:35.947142 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:42:35.947298 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:42:35.947336 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:42:45.959065 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:42:45.959378 1 main.go:227] handling current node
I0214 03:42:45.959421 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:42:45.959559 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:42:45.959725 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:42:45.959753 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
I0214 03:42:55.972756 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:42:55.972808 1 main.go:227] handling current node
I0214 03:42:55.972824 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:42:55.972829 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:42:55.972962 1 main.go:223] Handling node with IPs: map[192.168.39.48:{}]
I0214 03:42:55.972967 1 main.go:250] Node multinode-920904-m03 has CIDR [10.244.3.0/24]
==> kindnet [756cb939eedaba509e20bce15cf7cbbf5f629e40c7aa153f7660b93f209f52c6] <==
I0214 03:47:28.364296 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:47:38.371087 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:47:38.371424 1 main.go:227] handling current node
I0214 03:47:38.371604 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:47:38.371725 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:47:48.380402 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:47:48.380670 1 main.go:227] handling current node
I0214 03:47:48.380712 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:47:48.380745 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:47:58.394856 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:47:58.394957 1 main.go:227] handling current node
I0214 03:47:58.394990 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:47:58.395007 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:48:08.401877 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:48:08.402093 1 main.go:227] handling current node
I0214 03:48:08.402144 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:48:08.402174 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:48:18.412125 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:48:18.412228 1 main.go:227] handling current node
I0214 03:48:18.412266 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:48:18.412284 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
I0214 03:48:28.417961 1 main.go:223] Handling node with IPs: map[192.168.39.169:{}]
I0214 03:48:28.418073 1 main.go:227] handling current node
I0214 03:48:28.418103 1 main.go:223] Handling node with IPs: map[192.168.39.100:{}]
I0214 03:48:28.418121 1 main.go:250] Node multinode-920904-m02 has CIDR [10.244.1.0/24]
==> kube-apiserver [2d22ba7cad9b59831b522606ab0c65b4c72cd28fefba1aa3e6f0f2b38978d1fe] <==
I0214 03:44:42.787390 1 establishing_controller.go:76] Starting EstablishingController
I0214 03:44:42.787449 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0214 03:44:42.788062 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0214 03:44:42.788109 1 crd_finalizer.go:266] Starting CRDFinalizer
I0214 03:44:42.883312 1 shared_informer.go:318] Caches are synced for crd-autoregister
I0214 03:44:42.884660 1 aggregator.go:166] initial CRD sync complete...
I0214 03:44:42.884709 1 autoregister_controller.go:141] Starting autoregister controller
I0214 03:44:42.884716 1 cache.go:32] Waiting for caches to sync for autoregister controller
I0214 03:44:42.920078 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0214 03:44:42.943281 1 shared_informer.go:318] Caches are synced for node_authorizer
I0214 03:44:42.967400 1 apf_controller.go:377] Running API Priority and Fairness config worker
I0214 03:44:42.967685 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I0214 03:44:42.968808 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0214 03:44:42.975642 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0214 03:44:42.976207 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0214 03:44:42.976842 1 shared_informer.go:318] Caches are synced for configmaps
I0214 03:44:42.986856 1 cache.go:39] Caches are synced for autoregister controller
I0214 03:44:43.781831 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0214 03:44:45.965077 1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0214 03:44:46.236014 1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0214 03:44:46.246754 1 controller.go:624] quota admission added evaluator for: deployments.apps
I0214 03:44:46.347135 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0214 03:44:46.362701 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0214 03:44:56.180084 1 controller.go:624] quota admission added evaluator for: endpoints
I0214 03:44:56.220717 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
==> kube-apiserver [ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72] <==
I0214 03:43:01.753892 1 autoregister_controller.go:165] Shutting down autoregister controller
I0214 03:43:01.753935 1 crdregistration_controller.go:142] Shutting down crd-autoregister controller
I0214 03:43:01.753962 1 apiapproval_controller.go:198] Shutting down KubernetesAPIApprovalPolicyConformantConditionController
I0214 03:43:01.754000 1 nonstructuralschema_controller.go:204] Shutting down NonStructuralSchemaConditionController
I0214 03:43:01.754015 1 establishing_controller.go:87] Shutting down EstablishingController
I0214 03:43:01.754039 1 naming_controller.go:302] Shutting down NamingConditionController
I0214 03:43:01.754056 1 controller.go:115] Shutting down OpenAPI V3 controller
I0214 03:43:01.754075 1 controller.go:162] Shutting down OpenAPI controller
I0214 03:43:01.754093 1 customresource_discovery_controller.go:325] Shutting down DiscoveryController
I0214 03:43:01.754153 1 gc_controller.go:91] Shutting down apiserver lease garbage collector
I0214 03:43:01.754172 1 available_controller.go:439] Shutting down AvailableConditionController
I0214 03:43:01.754200 1 apf_controller.go:384] Shutting down API Priority and Fairness config worker
I0214 03:43:01.754216 1 gc_controller.go:91] Shutting down apiserver lease garbage collector
I0214 03:43:01.754223 1 crd_finalizer.go:278] Shutting down CRDFinalizer
I0214 03:43:01.754349 1 controller.go:129] Ending legacy_token_tracking_controller
I0214 03:43:01.754360 1 controller.go:130] Shutting down legacy_token_tracking_controller
I0214 03:43:01.758007 1 dynamic_cafile_content.go:171] "Shutting down controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I0214 03:43:01.758615 1 dynamic_cafile_content.go:171] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I0214 03:43:01.758801 1 dynamic_serving_content.go:146] "Shutting down controller" name="aggregator-proxy-cert::/var/lib/minikube/certs/front-proxy-client.crt::/var/lib/minikube/certs/front-proxy-client.key"
I0214 03:43:01.758838 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting"
I0214 03:43:01.758851 1 controller.go:86] Shutting down OpenAPI V3 AggregationController
I0214 03:43:01.758911 1 controller.go:84] Shutting down OpenAPI AggregationController
I0214 03:43:01.759009 1 secure_serving.go:258] Stopped listening on [::]:8443
I0214 03:43:01.759025 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
I0214 03:43:01.768086 1 dynamic_serving_content.go:146] "Shutting down controller" name="serving-cert::/var/lib/minikube/certs/apiserver.crt::/var/lib/minikube/certs/apiserver.key"
==> kube-controller-manager [dd468dc00b761d04da7bb10b774d4709d28121bdc1bcf73228b7593053f03c89] <==
I0214 03:45:24.852907 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="51.307µs"
I0214 03:45:26.719732 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="53.833µs"
I0214 03:45:32.329671 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:45:32.350599 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="141.261µs"
I0214 03:45:32.370081 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="49.788µs"
I0214 03:45:34.872711 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="12.794836ms"
I0214 03:45:34.873086 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="109.021µs"
I0214 03:45:36.215681 1 event.go:307] "Event occurred" object="default/busybox-5b5d89c9d6-6jnl5" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-5b5d89c9d6-6jnl5"
I0214 03:45:52.907668 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:45:55.387110 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-920904-m03\" does not exist"
I0214 03:45:55.387692 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:45:55.402106 1 range_allocator.go:380] "Set node PodCIDR" node="multinode-920904-m03" podCIDRs=["10.244.2.0/24"]
I0214 03:46:05.698442 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m03"
I0214 03:46:11.325916 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:46:16.234171 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RemovingNode" message="Node multinode-920904-m03 event: Removing Node multinode-920904-m03 from Controller"
I0214 03:46:46.252888 1 event.go:307] "Event occurred" object="multinode-920904-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-920904-m02 status is now: NodeNotReady"
I0214 03:46:46.264412 1 event.go:307] "Event occurred" object="default/busybox-5b5d89c9d6-6jnl5" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:46:46.279298 1 event.go:307] "Event occurred" object="kube-system/kindnet-2x6cd" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:46:46.293222 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="28.378336ms"
I0214 03:46:46.293307 1 event.go:307] "Event occurred" object="kube-system/kube-proxy-txk85" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:46:46.294849 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="1.232813ms"
I0214 03:47:15.981949 1 gc_controller.go:344] "PodGC is force deleting Pod" pod="kube-system/kindnet-69j24"
I0214 03:47:16.010300 1 gc_controller.go:260] "Forced deletion of orphaned Pod succeeded" pod="kube-system/kindnet-69j24"
I0214 03:47:16.010453 1 gc_controller.go:344] "PodGC is force deleting Pod" pod="kube-system/kube-proxy-ftb7r"
I0214 03:47:16.042212 1 gc_controller.go:260] "Forced deletion of orphaned Pod succeeded" pod="kube-system/kube-proxy-ftb7r"
==> kube-controller-manager [e4741d213bd818d97421b82b9b141f40379e0ed9b967da233ad26dba6ccded3f] <==
I0214 03:40:02.548844 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-920904-m03\" does not exist"
I0214 03:40:02.552305 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:40:02.569599 1 range_allocator.go:380] "Set node PodCIDR" node="multinode-920904-m03" podCIDRs=["10.244.2.0/24"]
I0214 03:40:02.589150 1 event.go:307] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-69j24"
I0214 03:40:02.595616 1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-ftb7r"
I0214 03:40:05.188294 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="multinode-920904-m03"
I0214 03:40:05.188425 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node multinode-920904-m03 event: Registered Node multinode-920904-m03 in Controller"
I0214 03:40:11.946628 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:40:43.959758 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:40:45.212056 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RemovingNode" message="Node multinode-920904-m03 event: Removing Node multinode-920904-m03 from Controller"
I0214 03:40:46.643232 1 actual_state_of_world.go:547] "Failed to update statusUpdateNeeded field in actual state of world" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-920904-m03\" does not exist"
I0214 03:40:46.647068 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:40:46.661929 1 range_allocator.go:380] "Set node PodCIDR" node="multinode-920904-m03" podCIDRs=["10.244.3.0/24"]
I0214 03:40:50.213043 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node multinode-920904-m03 event: Registered Node multinode-920904-m03 in Controller"
I0214 03:40:55.256681 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m02"
I0214 03:41:35.246929 1 topologycache.go:237] "Can't get CPU or zone information for node" node="multinode-920904-m03"
I0214 03:41:35.247521 1 event.go:307] "Event occurred" object="multinode-920904-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-920904-m02 status is now: NodeNotReady"
I0214 03:41:35.261571 1 event.go:307] "Event occurred" object="default/busybox-5b5d89c9d6-xqpsh" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:41:35.277876 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="15.961469ms"
I0214 03:41:35.278785 1 event.go:307] "Event occurred" object="kube-system/kube-proxy-txk85" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:41:35.283053 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/busybox-5b5d89c9d6" duration="79.772µs"
I0214 03:41:35.296115 1 event.go:307] "Event occurred" object="kube-system/kindnet-2x6cd" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:41:40.308402 1 event.go:307] "Event occurred" object="multinode-920904-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-920904-m03 status is now: NodeNotReady"
I0214 03:41:40.322984 1 event.go:307] "Event occurred" object="kube-system/kindnet-69j24" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0214 03:41:40.344792 1 event.go:307] "Event occurred" object="kube-system/kube-proxy-ftb7r" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
==> kube-proxy [16cf4f0e3c3637432d824ffffa535312bc609f675be432e5d646ca6e14a441f8] <==
I0214 03:38:32.757346 1 server_others.go:69] "Using iptables proxy"
I0214 03:38:32.768901 1 node.go:141] Successfully retrieved node IP: 192.168.39.169
I0214 03:38:32.825225 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 03:38:32.825321 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 03:38:32.828160 1 server_others.go:152] "Using iptables Proxier"
I0214 03:38:32.828222 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 03:38:32.828590 1 server.go:846] "Version info" version="v1.28.4"
I0214 03:38:32.828625 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:38:32.829293 1 config.go:188] "Starting service config controller"
I0214 03:38:32.829345 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 03:38:32.829366 1 config.go:97] "Starting endpoint slice config controller"
I0214 03:38:32.829370 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 03:38:32.831732 1 config.go:315] "Starting node config controller"
I0214 03:38:32.831768 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 03:38:32.930374 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 03:38:32.930651 1 shared_informer.go:318] Caches are synced for service config
I0214 03:38:32.933249 1 shared_informer.go:318] Caches are synced for node config
==> kube-proxy [31097f7bbab9de0b2be8352153ac0ebc03e422c4b51d3c1444d6a64014a54475] <==
I0214 03:44:45.885253 1 server_others.go:69] "Using iptables proxy"
I0214 03:44:45.907456 1 node.go:141] Successfully retrieved node IP: 192.168.39.169
I0214 03:44:46.046300 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 03:44:46.046356 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 03:44:46.068988 1 server_others.go:152] "Using iptables Proxier"
I0214 03:44:46.069974 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 03:44:46.071952 1 server.go:846] "Version info" version="v1.28.4"
I0214 03:44:46.072003 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:44:46.073147 1 config.go:188] "Starting service config controller"
I0214 03:44:46.073219 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 03:44:46.073260 1 config.go:97] "Starting endpoint slice config controller"
I0214 03:44:46.073277 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 03:44:46.073896 1 config.go:315] "Starting node config controller"
I0214 03:44:46.073939 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 03:44:46.174085 1 shared_informer.go:318] Caches are synced for node config
I0214 03:44:46.174165 1 shared_informer.go:318] Caches are synced for service config
I0214 03:44:46.174185 1 shared_informer.go:318] Caches are synced for endpoint slice config
==> kube-scheduler [718f1ba82ee496fdb2a14edc694d60fa287c582cdd889241b3ad4daea7d1eebf] <==
E0214 03:38:15.372932 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:38:15.373463 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:38:15.373690 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 03:38:16.221279 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 03:38:16.221331 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 03:38:16.244695 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 03:38:16.244745 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 03:38:16.268713 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 03:38:16.268764 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 03:38:16.270022 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 03:38:16.270063 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 03:38:16.395772 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 03:38:16.395854 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 03:38:16.434250 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 03:38:16.434407 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0214 03:38:16.454427 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 03:38:16.454526 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 03:38:16.514633 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 03:38:16.514713 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0214 03:38:16.563539 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 03:38:16.563676 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0214 03:38:16.852757 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 03:38:16.852809 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0214 03:38:19.544820 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0214 03:43:01.734666 1 run.go:74] "command failed" err="finished without leader elect"
==> kube-scheduler [9b760e70fa057fdca422ac0961ce2f105ecc2081f48b108a01a94cc3d6d723c7] <==
I0214 03:44:40.514750 1 serving.go:348] Generated self-signed cert in-memory
W0214 03:44:42.829202 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0214 03:44:42.829381 1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0214 03:44:42.829542 1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
W0214 03:44:42.830167 1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0214 03:44:42.895443 1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"
I0214 03:44:42.895606 1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 03:44:42.903380 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0214 03:44:42.903453 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 03:44:42.907283 1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
I0214 03:44:42.907383 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0214 03:44:43.004132 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 03:37:45 UTC, ends at Wed 2024-02-14 03:48:33 UTC. --
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.863809 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/poda9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5/crio-d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c: Error finding container d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c: Status 404 returned error can't find the container with id d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.864206 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/podb97b3113c9ba0043ea50e1edc3226133/crio-0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6: Error finding container 0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6: Status 404 returned error can't find the container with id 0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.864611 3111 manager.go:1106] Failed to create existing container: /kubepods/pod57e775c4-dfa0-409a-a6c1-81c354ae5205/crio-9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a: Error finding container 9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a: Status 404 returned error can't find the container with id 9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.864977 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/pod7baac180-46a6-4d2f-a403-8eff3369f7c0/crio-04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7: Error finding container 04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7: Status 404 returned error can't find the container with id 04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.865647 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/podada46005-8413-4ffa-9e70-b2a0cb3c7941/crio-8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd: Error finding container 8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd: Status 404 returned error can't find the container with id 8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.866250 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/pod3be77efdd656fce83a1ee57d47f0da56/crio-f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d: Error finding container f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d: Status 404 returned error can't find the container with id f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.866608 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/pod48a5a80865aadc8364cca137e04141ac/crio-7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636: Error finding container 7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636: Status 404 returned error can't find the container with id 7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.866990 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/pod7b3e114a-bf3d-4001-8f21-6be4e9c8b435/crio-9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4: Error finding container 9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4: Status 404 returned error can't find the container with id 9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4
Feb 14 03:46:36 multinode-920904 kubelet[3111]: E0214 03:46:36.919706 3111 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:46:36 multinode-920904 kubelet[3111]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:46:36 multinode-920904 kubelet[3111]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:46:36 multinode-920904 kubelet[3111]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.862835 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/pod48a5a80865aadc8364cca137e04141ac/crio-7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636: Error finding container 7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636: Status 404 returned error can't find the container with id 7d9ffb468d165c864caad5f4710c4794ac49dbe048bc38591164ddb5a21a5636
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.863742 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/podada46005-8413-4ffa-9e70-b2a0cb3c7941/crio-8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd: Error finding container 8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd: Status 404 returned error can't find the container with id 8f69e6bc15e36140c7b92612facb2934563814e75a37afb4353a9905be35b7fd
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.864177 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/pod7b3e114a-bf3d-4001-8f21-6be4e9c8b435/crio-9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4: Error finding container 9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4: Status 404 returned error can't find the container with id 9f1e2ecab08f68baf640e5257852da89cfa0d7bfdff46a1b8bb2a016fbce70e4
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.864571 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/pode6f8f927d6b3cc2b372a318a8e285f39/crio-353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3: Error finding container 353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3: Status 404 returned error can't find the container with id 353a50f5abaa2b956b7ae2a706f6d68bc9839ba87dda9c915276de2ae48747b3
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.864789 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/podb97b3113c9ba0043ea50e1edc3226133/crio-0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6: Error finding container 0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6: Status 404 returned error can't find the container with id 0fd91233e19467a13c2a3dd8e6385457938433001b486ddc8527ac8c05debad6
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.864918 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/poda9459a1d-ea3b-4054-a2f5-a6b3c8ad25c5/crio-d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c: Error finding container d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c: Status 404 returned error can't find the container with id d7d9ca749ff58f3974dc67b995db807923f31d74fee81cb00dfa9f9b659f995c
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.865009 3111 manager.go:1106] Failed to create existing container: /kubepods/besteffort/pod7baac180-46a6-4d2f-a403-8eff3369f7c0/crio-04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7: Error finding container 04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7: Status 404 returned error can't find the container with id 04d7a5fd341125daaa9179d2163505d57c3c4468a43010e7a3727d06b90b79a7
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.866107 3111 manager.go:1106] Failed to create existing container: /kubepods/pod57e775c4-dfa0-409a-a6c1-81c354ae5205/crio-9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a: Error finding container 9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a: Status 404 returned error can't find the container with id 9320dd54abfbf0432eda2794a1a3e0376917ecf5e9e8a13253fe6d502aacc77a
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.867131 3111 manager.go:1106] Failed to create existing container: /kubepods/burstable/pod3be77efdd656fce83a1ee57d47f0da56/crio-f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d: Error finding container f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d: Status 404 returned error can't find the container with id f98b361622007e8a1657f415b6ae49999ef67c1a048d76b1fce069fbf932a24d
Feb 14 03:47:36 multinode-920904 kubelet[3111]: E0214 03:47:36.924350 3111 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 03:47:36 multinode-920904 kubelet[3111]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 03:47:36 multinode-920904 kubelet[3111]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 03:47:36 multinode-920904 kubelet[3111]: > table="nat" chain="KUBE-KUBELET-CANARY"
-- /stdout --
** stderr **
E0214 03:48:32.097596 1523191 logs.go:258] failed to output last start logs: failed to read file /home/jenkins/minikube-integration/17909-1487441/.minikube/logs/lastStart.txt: bufio.Scanner: token too long
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p multinode-920904 -n multinode-920904
helpers_test.go:261: (dbg) Run: kubectl --context multinode-920904 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestMultiNode/serial/StopMultiNode FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiNode/serial/StopMultiNode (141.38s)
=== RUN TestPreload
preload_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p test-preload-774565 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-774565 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.24.4: (2m11.804180138s)
preload_test.go:52: (dbg) Run: out/minikube-linux-amd64 -p test-preload-774565 image pull gcr.io/k8s-minikube/busybox
preload_test.go:58: (dbg) Run: out/minikube-linux-amd64 stop -p test-preload-774565
E0214 03:54:58.298420 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:55:56.224885 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:55:56.659620 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:56:13.611633 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
preload_test.go:58: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p test-preload-774565: exit status 82 (2m0.415749413s)
-- stdout --
* Stopping node "test-preload-774565" ...
-- /stdout --
** stderr **
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
preload_test.go:60: out/minikube-linux-amd64 stop -p test-preload-774565 failed: exit status 82
panic.go:523: *** TestPreload FAILED at 2024-02-14 03:56:40.259371756 +0000 UTC m=+4117.223989353
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p test-preload-774565 -n test-preload-774565
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p test-preload-774565 -n test-preload-774565: exit status 3 (18.591627438s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 03:56:58.845663 1525523 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.76:22: connect: no route to host
E0214 03:56:58.845683 1525523 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.39.76:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "test-preload-774565" host is not running, skipping log retrieval (state="Error")
helpers_test.go:175: Cleaning up "test-preload-774565" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p test-preload-774565
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-774565: (1.157207633s)
--- FAIL: TestPreload (272.96s)
=== RUN TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run: out/minikube-linux-amd64 start -p pause-951466 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio
pause_test.go:92: (dbg) Done: out/minikube-linux-amd64 start -p pause-951466 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio: (42.767213334s)
pause_test.go:100: expected the second start log output to include "The running cluster does not require reconfiguration" but got:
-- stdout --
* [pause-951466] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17909
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on existing profile
* Starting "pause-951466" primary control-plane node in "pause-951466" cluster
* Updating the running kvm2 "pause-951466" VM ...
* Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
* Configuring bridge CNI (Container Networking Interface) ...
* Verifying Kubernetes components...
* Enabled addons:
* Done! kubectl is now configured to use "pause-951466" cluster and "default" namespace by default
-- /stdout --
** stderr **
I0214 04:06:20.330928 1534061 out.go:291] Setting OutFile to fd 1 ...
I0214 04:06:20.331121 1534061 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:06:20.331133 1534061 out.go:304] Setting ErrFile to fd 2...
I0214 04:06:20.331141 1534061 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:06:20.331376 1534061 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:06:20.332001 1534061 out.go:298] Setting JSON to false
I0214 04:06:20.333136 1534061 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":24528,"bootTime":1707859053,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:06:20.333207 1534061 start.go:138] virtualization: kvm guest
I0214 04:06:20.336257 1534061 out.go:177] * [pause-951466] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:06:20.338709 1534061 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:06:20.340556 1534061 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:06:20.338777 1534061 notify.go:220] Checking for updates...
I0214 04:06:20.342742 1534061 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:06:20.344624 1534061 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:06:20.346217 1534061 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:06:20.347884 1534061 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:06:20.349987 1534061 config.go:182] Loaded profile config "pause-951466": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:20.350430 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:20.350480 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:20.366550 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37031
I0214 04:06:20.367007 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:20.367698 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:20.367741 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:20.368149 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:20.368447 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:20.368743 1534061 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:06:20.369125 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:20.369165 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:20.386115 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39873
I0214 04:06:20.386586 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:20.387065 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:20.387089 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:20.387561 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:20.387817 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:20.427116 1534061 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:06:20.428965 1534061 start.go:296] selected driver: kvm2
I0214 04:06:20.428987 1534061 start.go:900] validating driver "kvm2" against &{Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernetes
Version:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-devi
ce-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:20.429122 1534061 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:06:20.429579 1534061 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:06:20.429673 1534061 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:06:20.446377 1534061 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:06:20.447383 1534061 cni.go:84] Creating CNI manager for ""
I0214 04:06:20.447406 1534061 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:06:20.447466 1534061 start.go:339] cluster config:
{Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:f
alse registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:20.447594 1534061 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:06:20.450645 1534061 out.go:177] * Starting "pause-951466" primary control-plane node in "pause-951466" cluster
I0214 04:06:20.452279 1534061 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:06:20.452324 1534061 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 04:06:20.452333 1534061 cache.go:56] Caching tarball of preloaded images
I0214 04:06:20.452419 1534061 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:06:20.452431 1534061 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 04:06:20.452550 1534061 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/config.json ...
I0214 04:06:20.452782 1534061 start.go:360] acquireMachinesLock for pause-951466: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:06:24.431367 1534061 start.go:364] duration metric: took 3.97853049s to acquireMachinesLock for "pause-951466"
I0214 04:06:24.431425 1534061 start.go:96] Skipping create...Using existing machine configuration
I0214 04:06:24.431436 1534061 fix.go:54] fixHost starting:
I0214 04:06:24.431861 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:24.431926 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:24.451671 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37513
I0214 04:06:24.452324 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:24.452961 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:24.453007 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:24.453445 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:24.453664 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:24.453857 1534061 main.go:141] libmachine: (pause-951466) Calling .GetState
I0214 04:06:24.456099 1534061 fix.go:112] recreateIfNeeded on pause-951466: state=Running err=<nil>
W0214 04:06:24.456121 1534061 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:06:24.458443 1534061 out.go:177] * Updating the running kvm2 "pause-951466" VM ...
I0214 04:06:24.459949 1534061 machine.go:94] provisionDockerMachine start ...
I0214 04:06:24.459977 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:24.460199 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.463941 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.464427 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.464452 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.464630 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.464836 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.465023 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.465145 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.465384 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.465818 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.465830 1534061 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:06:24.622572 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: pause-951466
I0214 04:06:24.622610 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.622913 1534061 buildroot.go:166] provisioning hostname "pause-951466"
I0214 04:06:24.622935 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.623172 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.626341 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.626777 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.626812 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.627148 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.627345 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.627539 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.627726 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.627916 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.628325 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.628343 1534061 main.go:141] libmachine: About to run SSH command:
sudo hostname pause-951466 && echo "pause-951466" | sudo tee /etc/hostname
I0214 04:06:24.781533 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: pause-951466
I0214 04:06:24.781562 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.784672 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.785015 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.785046 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.785293 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.785506 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.785698 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.785936 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.786120 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.786439 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.786456 1534061 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\spause-951466' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 pause-951466/g' /etc/hosts;
else
echo '127.0.1.1 pause-951466' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:06:24.934977 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:06:24.935015 1534061 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:06:24.935039 1534061 buildroot.go:174] setting up certificates
I0214 04:06:24.935059 1534061 provision.go:84] configureAuth start
I0214 04:06:24.935077 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.935450 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:24.939113 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.939629 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.939674 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.939787 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.942868 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.943235 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.943265 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.943391 1534061 provision.go:143] copyHostCerts
I0214 04:06:24.943462 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:06:24.943477 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:06:24.943548 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:06:24.943691 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:06:24.943705 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:06:24.943741 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:06:24.943856 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:06:24.943870 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:06:24.943901 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:06:24.943974 1534061 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.pause-951466 san=[127.0.0.1 192.168.61.64 localhost minikube pause-951466]
I0214 04:06:25.302868 1534061 provision.go:177] copyRemoteCerts
I0214 04:06:25.302952 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:06:25.302984 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:25.306056 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.306463 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:25.306509 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.306627 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:25.306865 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.307076 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:25.307250 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:25.405339 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1204 bytes)
I0214 04:06:25.433511 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:06:25.461693 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:06:25.493110 1534061 provision.go:87] duration metric: took 558.034007ms to configureAuth
I0214 04:06:25.493137 1534061 buildroot.go:189] setting minikube options for container-runtime
I0214 04:06:25.493373 1534061 config.go:182] Loaded profile config "pause-951466": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:25.493451 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:25.496797 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.497375 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:25.497407 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.497653 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:25.497927 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.498130 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.498333 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:25.498576 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:25.499104 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:25.499131 1534061 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:06:33.677212 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:06:33.677245 1534061 machine.go:97] duration metric: took 9.217278338s to provisionDockerMachine
I0214 04:06:33.677285 1534061 start.go:293] postStartSetup for "pause-951466" (driver="kvm2")
I0214 04:06:33.677301 1534061 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:06:33.677337 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:33.677841 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:06:33.677875 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:33.681031 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.681474 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:33.681496 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.681701 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:33.681919 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.682089 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:33.682240 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:33.793747 1534061 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:06:33.800325 1534061 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:06:33.800365 1534061 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:06:33.800456 1534061 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:06:33.800568 1534061 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:06:33.800703 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:06:33.811682 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:33.843858 1534061 start.go:296] duration metric: took 166.55133ms for postStartSetup
I0214 04:06:33.843943 1534061 fix.go:56] duration metric: took 9.412506338s for fixHost
I0214 04:06:33.843979 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:33.847119 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.847464 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:33.847492 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.847737 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:33.848010 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.848232 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.848410 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:33.848668 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:33.849078 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:33.849092 1534061 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0214 04:06:34.064366 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707883594.058978164
I0214 04:06:34.064394 1534061 fix.go:216] guest clock: 1707883594.058978164
I0214 04:06:34.064405 1534061 fix.go:229] Guest: 2024-02-14 04:06:34.058978164 +0000 UTC Remote: 2024-02-14 04:06:33.843953524 +0000 UTC m=+13.569509178 (delta=215.02464ms)
I0214 04:06:34.064451 1534061 fix.go:200] guest clock delta is within tolerance: 215.02464ms
I0214 04:06:34.064458 1534061 start.go:83] releasing machines lock for "pause-951466", held for 9.633059332s
I0214 04:06:34.064493 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.065564 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:34.068871 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.069637 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.069684 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.069713 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.077958 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.078230 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.078337 1534061 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:06:34.078380 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:34.078943 1534061 ssh_runner.go:195] Run: cat /version.json
I0214 04:06:34.078973 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:34.082130 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.082908 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.082941 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.083366 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:34.083579 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:34.083645 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.083916 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:34.084082 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:34.084386 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:34.084202 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.084578 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.084620 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:34.084764 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:34.084995 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:34.547561 1534061 ssh_runner.go:195] Run: systemctl --version
I0214 04:06:34.571488 1534061 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:06:34.795873 1534061 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:06:34.811478 1534061 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:06:34.811567 1534061 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:06:34.828664 1534061 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0214 04:06:34.828712 1534061 start.go:494] detecting cgroup driver to use...
I0214 04:06:34.828791 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:06:34.855603 1534061 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:06:34.877058 1534061 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:06:34.877139 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:06:34.900372 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:06:34.933782 1534061 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:06:35.378508 1534061 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:06:35.702727 1534061 docker.go:233] disabling docker service ...
I0214 04:06:35.702821 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:06:35.762944 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:06:35.805557 1534061 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:06:36.152685 1534061 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:06:36.459334 1534061 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:06:36.486614 1534061 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:06:36.538266 1534061 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:06:36.538353 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.560216 1534061 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:06:36.560356 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.608844 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.652421 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.675973 1534061 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:06:36.701752 1534061 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:06:36.723934 1534061 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:06:36.760530 1534061 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:37.142372 1534061 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:06:38.583626 1534061 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1.441206411s)
I0214 04:06:38.583665 1534061 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:06:38.583728 1534061 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:06:38.589300 1534061 start.go:562] Will wait 60s for crictl version
I0214 04:06:38.589374 1534061 ssh_runner.go:195] Run: which crictl
I0214 04:06:38.593346 1534061 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:06:38.636742 1534061 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:06:38.636864 1534061 ssh_runner.go:195] Run: crio --version
I0214 04:06:38.696074 1534061 ssh_runner.go:195] Run: crio --version
I0214 04:06:38.747754 1534061 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:06:38.749416 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:38.752813 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:38.753183 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:38.753208 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:38.753470 1534061 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0214 04:06:38.759411 1534061 kubeadm.go:877] updating cluster {Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4
ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false
olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:06:38.759577 1534061 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:06:38.759646 1534061 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:38.821329 1534061 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:06:38.821375 1534061 crio.go:415] Images already preloaded, skipping extraction
I0214 04:06:38.821442 1534061 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:38.862076 1534061 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:06:38.862112 1534061 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:06:38.862128 1534061 kubeadm.go:928] updating node { 192.168.61.64 8443 v1.28.4 crio true true} ...
I0214 04:06:38.862277 1534061 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=pause-951466 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.64
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:06:38.862365 1534061 ssh_runner.go:195] Run: crio config
I0214 04:06:38.934373 1534061 cni.go:84] Creating CNI manager for ""
I0214 04:06:38.934408 1534061 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:06:38.934426 1534061 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:06:38.934465 1534061 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.64 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-951466 NodeName:pause-951466 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.64"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.64 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubern
etes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:06:38.934663 1534061 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.64
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "pause-951466"
kubeletExtraArgs:
node-ip: 192.168.61.64
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.64"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:06:38.934746 1534061 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:06:38.945954 1534061 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:06:38.946030 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:06:38.957200 1534061 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (311 bytes)
I0214 04:06:38.977693 1534061 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:06:38.995710 1534061 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)
I0214 04:06:39.016901 1534061 ssh_runner.go:195] Run: grep 192.168.61.64 control-plane.minikube.internal$ /etc/hosts
I0214 04:06:39.022519 1534061 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:39.500604 1534061 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:06:39.639408 1534061 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466 for IP: 192.168.61.64
I0214 04:06:39.639441 1534061 certs.go:194] generating shared ca certs ...
I0214 04:06:39.639475 1534061 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:39.639676 1534061 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:06:39.639749 1534061 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:06:39.639763 1534061 certs.go:256] generating profile certs ...
I0214 04:06:39.639895 1534061 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/client.key
I0214 04:06:39.639983 1534061 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.key.9654be93
I0214 04:06:39.640064 1534061 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.key
I0214 04:06:39.640224 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:06:39.640266 1534061 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:06:39.640279 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:06:39.640314 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:06:39.640346 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:06:39.640392 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:06:39.640455 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:39.641377 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:06:39.696825 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:06:39.746233 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:06:39.785132 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:06:39.827358 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0214 04:06:39.880076 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 04:06:39.920074 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:06:39.944377 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:06:39.972007 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:06:40.062131 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:06:40.125888 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:06:40.205494 1534061 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:06:40.237725 1534061 ssh_runner.go:195] Run: openssl version
I0214 04:06:40.257410 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:06:40.277411 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.285844 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.285927 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.297791 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:06:40.317947 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:06:40.339071 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.349634 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.349713 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.360896 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:06:40.378400 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:06:40.401064 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.410181 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.410258 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.421748 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:06:40.435327 1534061 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:06:40.451007 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:06:40.461126 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:06:40.472196 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:06:40.486842 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:06:40.499789 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:06:40.512866 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:06:40.527853 1534061 kubeadm.go:391] StartCluster: {Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cl
usterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false ol
m:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:40.528067 1534061 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:06:40.528148 1534061 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:06:40.604639 1534061 cri.go:89] found id: "ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7"
I0214 04:06:40.604671 1534061 cri.go:89] found id: "1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7"
I0214 04:06:40.604678 1534061 cri.go:89] found id: "cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b"
I0214 04:06:40.604685 1534061 cri.go:89] found id: "0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189"
I0214 04:06:40.604691 1534061 cri.go:89] found id: "3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5"
I0214 04:06:40.604697 1534061 cri.go:89] found id: "a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5"
I0214 04:06:40.604703 1534061 cri.go:89] found id: ""
I0214 04:06:40.604760 1534061 ssh_runner.go:195] Run: sudo runc list -f json
** /stderr **
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p pause-951466 -n pause-951466
helpers_test.go:244: <<< TestPause/serial/SecondStartNoReconfiguration FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestPause/serial/SecondStartNoReconfiguration]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p pause-951466 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p pause-951466 logs -n 25: (1.6939812s)
helpers_test.go:252: TestPause/serial/SecondStartNoReconfiguration logs:
-- stdout --
==> Audit <==
|---------|----------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|----------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-528898 sudo | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | systemctl cat containerd | | | | | |
| | --no-pager | | | | | |
| ssh | -p cilium-528898 sudo cat | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | /lib/systemd/system/containerd.service | | | | | |
| ssh | -p cilium-528898 sudo cat | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p cilium-528898 sudo | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | containerd config dump | | | | | |
| ssh | -p cilium-528898 sudo | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p cilium-528898 sudo | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p cilium-528898 sudo find | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-528898 sudo crio | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | config | | | | | |
| delete | -p cilium-528898 | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:03 UTC |
| start | -p force-systemd-flag-681097 | force-systemd-flag-681097 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:04 UTC |
| | --memory=2048 --force-systemd | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p stopped-upgrade-581303 | stopped-upgrade-581303 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:03 UTC |
| start | -p cert-options-608119 | cert-options-608119 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:05 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | -p NoKubernetes-841938 sudo | NoKubernetes-841938 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | systemctl is-active --quiet | | | | | |
| | service kubelet | | | | | |
| delete | -p NoKubernetes-841938 | NoKubernetes-841938 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:03 UTC |
| start | -p pause-951466 --memory=2048 | pause-951466 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:06 UTC |
| | --install-addons=false | | | | | |
| | --wait=all --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p force-systemd-env-059598 | force-systemd-env-059598 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:03 UTC |
| start | -p cert-expiration-239926 | cert-expiration-239926 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:05 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | force-systemd-flag-681097 ssh cat | force-systemd-flag-681097 | jenkins | v1.32.0 | 14 Feb 24 04:04 UTC | 14 Feb 24 04:04 UTC |
| | /etc/crio/crio.conf.d/02-crio.conf | | | | | |
| delete | -p force-systemd-flag-681097 | force-systemd-flag-681097 | jenkins | v1.32.0 | 14 Feb 24 04:04 UTC | 14 Feb 24 04:04 UTC |
| start | -p auto-528898 --memory=3072 | auto-528898 | jenkins | v1.32.0 | 14 Feb 24 04:04 UTC | |
| | --alsologtostderr --wait=true | | | | | |
| | --wait-timeout=15m | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | cert-options-608119 ssh | cert-options-608119 | jenkins | v1.32.0 | 14 Feb 24 04:05 UTC | 14 Feb 24 04:05 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-608119 -- sudo | cert-options-608119 | jenkins | v1.32.0 | 14 Feb 24 04:05 UTC | 14 Feb 24 04:05 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-608119 | cert-options-608119 | jenkins | v1.32.0 | 14 Feb 24 04:05 UTC | 14 Feb 24 04:05 UTC |
| start | -p kindnet-528898 | kindnet-528898 | jenkins | v1.32.0 | 14 Feb 24 04:05 UTC | |
| | --memory=3072 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --wait-timeout=15m | | | | | |
| | --cni=kindnet --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| start | -p pause-951466 | pause-951466 | jenkins | v1.32.0 | 14 Feb 24 04:06 UTC | 14 Feb 24 04:07 UTC |
| | --alsologtostderr | | | | | |
| | -v=1 --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
|---------|----------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:06:20
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:06:20.330928 1534061 out.go:291] Setting OutFile to fd 1 ...
I0214 04:06:20.331121 1534061 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:06:20.331133 1534061 out.go:304] Setting ErrFile to fd 2...
I0214 04:06:20.331141 1534061 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:06:20.331376 1534061 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:06:20.332001 1534061 out.go:298] Setting JSON to false
I0214 04:06:20.333136 1534061 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":24528,"bootTime":1707859053,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:06:20.333207 1534061 start.go:138] virtualization: kvm guest
I0214 04:06:20.336257 1534061 out.go:177] * [pause-951466] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:06:20.338709 1534061 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:06:20.340556 1534061 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:06:20.338777 1534061 notify.go:220] Checking for updates...
I0214 04:06:20.342742 1534061 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:06:20.344624 1534061 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:06:20.346217 1534061 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:06:20.347884 1534061 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:06:20.349987 1534061 config.go:182] Loaded profile config "pause-951466": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:20.350430 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:20.350480 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:20.366550 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37031
I0214 04:06:20.367007 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:20.367698 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:20.367741 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:20.368149 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:20.368447 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:20.368743 1534061 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:06:20.369125 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:20.369165 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:20.386115 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39873
I0214 04:06:20.386586 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:20.387065 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:20.387089 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:20.387561 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:20.387817 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:20.427116 1534061 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:06:20.428965 1534061 start.go:296] selected driver: kvm2
I0214 04:06:20.428987 1534061 start.go:900] validating driver "kvm2" against &{Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernetes
Version:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-devi
ce-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:20.429122 1534061 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:06:20.429579 1534061 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:06:20.429673 1534061 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:06:20.446377 1534061 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:06:20.447383 1534061 cni.go:84] Creating CNI manager for ""
I0214 04:06:20.447406 1534061 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:06:20.447466 1534061 start.go:339] cluster config:
{Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:f
alse registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:20.447594 1534061 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:06:20.450645 1534061 out.go:177] * Starting "pause-951466" primary control-plane node in "pause-951466" cluster
I0214 04:06:21.485191 1532906 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:06:21.485277 1532906 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:06:21.485374 1532906 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:06:21.485502 1532906 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:06:21.485656 1532906 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:06:21.485743 1532906 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:06:21.488264 1532906 out.go:204] - Generating certificates and keys ...
I0214 04:06:21.488354 1532906 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:06:21.488414 1532906 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:06:21.488501 1532906 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 04:06:21.488572 1532906 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 04:06:21.488632 1532906 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 04:06:21.488677 1532906 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 04:06:21.488728 1532906 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 04:06:21.488901 1532906 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [auto-528898 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]
I0214 04:06:21.488983 1532906 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 04:06:21.489145 1532906 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [auto-528898 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]
I0214 04:06:21.489245 1532906 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 04:06:21.489350 1532906 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 04:06:21.489413 1532906 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 04:06:21.489486 1532906 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:06:21.489568 1532906 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:06:21.489633 1532906 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:06:21.489720 1532906 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:06:21.489788 1532906 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:06:21.489937 1532906 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:06:21.490039 1532906 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:06:21.492317 1532906 out.go:204] - Booting up control plane ...
I0214 04:06:21.492468 1532906 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:06:21.492571 1532906 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:06:21.492661 1532906 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:06:21.492786 1532906 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:06:21.492891 1532906 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:06:21.492953 1532906 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:06:21.493123 1532906 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:06:21.493224 1532906 kubeadm.go:309] [apiclient] All control plane components are healthy after 9.003624 seconds
I0214 04:06:21.493446 1532906 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:06:21.493602 1532906 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:06:21.493684 1532906 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:06:21.493896 1532906 kubeadm.go:309] [mark-control-plane] Marking the node auto-528898 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:06:21.493974 1532906 kubeadm.go:309] [bootstrap-token] Using token: s01oco.kf9k0ytczi4mlk4k
I0214 04:06:21.496104 1532906 out.go:204] - Configuring RBAC rules ...
I0214 04:06:21.496256 1532906 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:06:21.496332 1532906 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:06:21.496463 1532906 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:06:21.496574 1532906 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:06:21.496702 1532906 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:06:21.496822 1532906 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:06:21.496958 1532906 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:06:21.497002 1532906 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:06:21.497040 1532906 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:06:21.497050 1532906 kubeadm.go:309]
I0214 04:06:21.497106 1532906 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:06:21.497112 1532906 kubeadm.go:309]
I0214 04:06:21.497172 1532906 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:06:21.497177 1532906 kubeadm.go:309]
I0214 04:06:21.497203 1532906 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:06:21.497272 1532906 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:06:21.497338 1532906 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:06:21.497347 1532906 kubeadm.go:309]
I0214 04:06:21.497433 1532906 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:06:21.497458 1532906 kubeadm.go:309]
I0214 04:06:21.497524 1532906 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:06:21.497533 1532906 kubeadm.go:309]
I0214 04:06:21.497584 1532906 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:06:21.497707 1532906 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:06:21.497818 1532906 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:06:21.497832 1532906 kubeadm.go:309]
I0214 04:06:21.497919 1532906 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:06:21.498034 1532906 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:06:21.498046 1532906 kubeadm.go:309]
I0214 04:06:21.498173 1532906 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token s01oco.kf9k0ytczi4mlk4k \
I0214 04:06:21.498318 1532906 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:06:21.498348 1532906 kubeadm.go:309] --control-plane
I0214 04:06:21.498353 1532906 kubeadm.go:309]
I0214 04:06:21.498485 1532906 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:06:21.498509 1532906 kubeadm.go:309]
I0214 04:06:21.498608 1532906 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token s01oco.kf9k0ytczi4mlk4k \
I0214 04:06:21.498740 1532906 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:06:21.498771 1532906 cni.go:84] Creating CNI manager for ""
I0214 04:06:21.498781 1532906 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:06:21.500726 1532906 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:06:17.382309 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:17.382926 1533329 main.go:141] libmachine: (kindnet-528898) DBG | unable to find current IP address of domain kindnet-528898 in network mk-kindnet-528898
I0214 04:06:17.382962 1533329 main.go:141] libmachine: (kindnet-528898) DBG | I0214 04:06:17.382860 1533864 retry.go:31] will retry after 4.954861712s: waiting for machine to come up
I0214 04:06:20.452279 1534061 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:06:20.452324 1534061 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 04:06:20.452333 1534061 cache.go:56] Caching tarball of preloaded images
I0214 04:06:20.452419 1534061 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:06:20.452431 1534061 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 04:06:20.452550 1534061 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/config.json ...
I0214 04:06:20.452782 1534061 start.go:360] acquireMachinesLock for pause-951466: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:06:24.431367 1534061 start.go:364] duration metric: took 3.97853049s to acquireMachinesLock for "pause-951466"
I0214 04:06:24.431425 1534061 start.go:96] Skipping create...Using existing machine configuration
I0214 04:06:24.431436 1534061 fix.go:54] fixHost starting:
I0214 04:06:24.431861 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:24.431926 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:24.451671 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37513
I0214 04:06:24.452324 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:24.452961 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:24.453007 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:24.453445 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:24.453664 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:24.453857 1534061 main.go:141] libmachine: (pause-951466) Calling .GetState
I0214 04:06:24.456099 1534061 fix.go:112] recreateIfNeeded on pause-951466: state=Running err=<nil>
W0214 04:06:24.456121 1534061 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:06:24.458443 1534061 out.go:177] * Updating the running kvm2 "pause-951466" VM ...
I0214 04:06:24.459949 1534061 machine.go:94] provisionDockerMachine start ...
I0214 04:06:24.459977 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:24.460199 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.463941 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.464427 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.464452 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.464630 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.464836 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.465023 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.465145 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.465384 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.465818 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.465830 1534061 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:06:24.622572 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: pause-951466
I0214 04:06:24.622610 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.622913 1534061 buildroot.go:166] provisioning hostname "pause-951466"
I0214 04:06:24.622935 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.623172 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.626341 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.626777 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.626812 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.627148 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.627345 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.627539 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.627726 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.627916 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.628325 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.628343 1534061 main.go:141] libmachine: About to run SSH command:
sudo hostname pause-951466 && echo "pause-951466" | sudo tee /etc/hostname
I0214 04:06:24.781533 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: pause-951466
I0214 04:06:24.781562 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.784672 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.785015 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.785046 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.785293 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.785506 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.785698 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.785936 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.786120 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.786439 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.786456 1534061 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\spause-951466' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 pause-951466/g' /etc/hosts;
else
echo '127.0.1.1 pause-951466' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:06:24.934977 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:06:24.935015 1534061 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:06:24.935039 1534061 buildroot.go:174] setting up certificates
I0214 04:06:24.935059 1534061 provision.go:84] configureAuth start
I0214 04:06:24.935077 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.935450 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:24.939113 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.939629 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.939674 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.939787 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.942868 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.943235 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.943265 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.943391 1534061 provision.go:143] copyHostCerts
I0214 04:06:24.943462 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:06:24.943477 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:06:24.943548 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:06:24.943691 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:06:24.943705 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:06:24.943741 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:06:24.943856 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:06:24.943870 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:06:24.943901 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:06:24.943974 1534061 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.pause-951466 san=[127.0.0.1 192.168.61.64 localhost minikube pause-951466]
I0214 04:06:25.302868 1534061 provision.go:177] copyRemoteCerts
I0214 04:06:25.302952 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:06:25.302984 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:25.306056 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.306463 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:25.306509 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.306627 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:25.306865 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.307076 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:25.307250 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:21.502499 1532906 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:06:21.534870 1532906 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:06:21.574171 1532906 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:06:21.574283 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:21.574303 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes auto-528898 minikube.k8s.io/updated_at=2024_02_14T04_06_21_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=auto-528898 minikube.k8s.io/primary=true
I0214 04:06:21.856318 1532906 ops.go:34] apiserver oom_adj: -16
I0214 04:06:21.856401 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:22.356817 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:22.857400 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:23.356397 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:23.857419 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:24.356856 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:24.856668 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:25.357312 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:22.339421 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.339970 1533329 main.go:141] libmachine: (kindnet-528898) Found IP for machine: 192.168.72.93
I0214 04:06:22.339993 1533329 main.go:141] libmachine: (kindnet-528898) Reserving static IP address...
I0214 04:06:22.340004 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has current primary IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.340430 1533329 main.go:141] libmachine: (kindnet-528898) DBG | unable to find host DHCP lease matching {name: "kindnet-528898", mac: "52:54:00:f3:57:4d", ip: "192.168.72.93"} in network mk-kindnet-528898
I0214 04:06:22.430708 1533329 main.go:141] libmachine: (kindnet-528898) Reserved static IP address: 192.168.72.93
I0214 04:06:22.430747 1533329 main.go:141] libmachine: (kindnet-528898) Waiting for SSH to be available...
I0214 04:06:22.430757 1533329 main.go:141] libmachine: (kindnet-528898) DBG | Getting to WaitForSSH function...
I0214 04:06:22.434242 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.434740 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:minikube Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.434777 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.434988 1533329 main.go:141] libmachine: (kindnet-528898) DBG | Using SSH client type: external
I0214 04:06:22.435020 1533329 main.go:141] libmachine: (kindnet-528898) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa (-rw-------)
I0214 04:06:22.435069 1533329 main.go:141] libmachine: (kindnet-528898) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.93 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:06:22.435093 1533329 main.go:141] libmachine: (kindnet-528898) DBG | About to run SSH command:
I0214 04:06:22.435107 1533329 main.go:141] libmachine: (kindnet-528898) DBG | exit 0
I0214 04:06:22.541853 1533329 main.go:141] libmachine: (kindnet-528898) DBG | SSH cmd err, output: <nil>:
I0214 04:06:22.542229 1533329 main.go:141] libmachine: (kindnet-528898) KVM machine creation complete!
I0214 04:06:22.542582 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetConfigRaw
I0214 04:06:22.543269 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:22.543507 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:22.543805 1533329 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 04:06:22.543824 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetState
I0214 04:06:22.545572 1533329 main.go:141] libmachine: Detecting operating system of created instance...
I0214 04:06:22.545604 1533329 main.go:141] libmachine: Waiting for SSH to be available...
I0214 04:06:22.545624 1533329 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 04:06:22.545639 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:22.548276 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.548722 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.548756 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.548987 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:22.549293 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.549538 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.549758 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:22.550001 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:22.550495 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:22.550513 1533329 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 04:06:22.689636 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:06:22.689677 1533329 main.go:141] libmachine: Detecting the provisioner...
I0214 04:06:22.689688 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:22.693624 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.694211 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.694252 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.694436 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:22.694723 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.695045 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.695252 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:22.695559 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:22.696061 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:22.696085 1533329 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 04:06:22.835117 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 04:06:22.835238 1533329 main.go:141] libmachine: found compatible host: buildroot
I0214 04:06:22.835251 1533329 main.go:141] libmachine: Provisioning with buildroot...
I0214 04:06:22.835260 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetMachineName
I0214 04:06:22.835610 1533329 buildroot.go:166] provisioning hostname "kindnet-528898"
I0214 04:06:22.835647 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetMachineName
I0214 04:06:22.835893 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:22.839446 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.839910 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.839969 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.840148 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:22.840403 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.840650 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.840837 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:22.841040 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:22.841459 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:22.841486 1533329 main.go:141] libmachine: About to run SSH command:
sudo hostname kindnet-528898 && echo "kindnet-528898" | sudo tee /etc/hostname
I0214 04:06:22.992095 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>: kindnet-528898
I0214 04:06:22.992138 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:22.995113 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.995474 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.995508 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.995643 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:22.995841 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.996045 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.996216 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:22.996434 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:22.996752 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:22.996775 1533329 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\skindnet-528898' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kindnet-528898/g' /etc/hosts;
else
echo '127.0.1.1 kindnet-528898' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:06:23.143023 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:06:23.143055 1533329 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:06:23.143099 1533329 buildroot.go:174] setting up certificates
I0214 04:06:23.143118 1533329 provision.go:84] configureAuth start
I0214 04:06:23.143137 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetMachineName
I0214 04:06:23.143442 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetIP
I0214 04:06:23.146449 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.146817 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:23.146837 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.147083 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:23.149775 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.150184 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:23.150224 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.150386 1533329 provision.go:143] copyHostCerts
I0214 04:06:23.150474 1533329 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:06:23.150486 1533329 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:06:23.150539 1533329 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:06:23.150674 1533329 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:06:23.150684 1533329 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:06:23.150706 1533329 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:06:23.150759 1533329 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:06:23.150766 1533329 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:06:23.150782 1533329 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:06:23.150830 1533329 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.kindnet-528898 san=[127.0.0.1 192.168.72.93 kindnet-528898 localhost minikube]
I0214 04:06:23.618253 1533329 provision.go:177] copyRemoteCerts
I0214 04:06:23.618352 1533329 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:06:23.618443 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:23.621899 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.622334 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:23.622376 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.622647 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:23.622932 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:23.623140 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:23.623301 1533329 sshutil.go:53] new ssh client: &{IP:192.168.72.93 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa Username:docker}
I0214 04:06:23.719156 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:06:23.745600 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:06:23.770852 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1212 bytes)
I0214 04:06:23.795721 1533329 provision.go:87] duration metric: took 652.580449ms to configureAuth
I0214 04:06:23.795757 1533329 buildroot.go:189] setting minikube options for container-runtime
I0214 04:06:23.795958 1533329 config.go:182] Loaded profile config "kindnet-528898": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:23.796104 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:23.799434 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.799870 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:23.799904 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.800070 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:23.800299 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:23.800527 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:23.800665 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:23.800864 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:23.801207 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:23.801222 1533329 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:06:24.142015 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:06:24.142054 1533329 main.go:141] libmachine: Checking connection to Docker...
I0214 04:06:24.142067 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetURL
I0214 04:06:24.143648 1533329 main.go:141] libmachine: (kindnet-528898) DBG | Using libvirt version 6000000
I0214 04:06:24.146154 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.146564 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.146595 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.146777 1533329 main.go:141] libmachine: Docker is up and running!
I0214 04:06:24.146860 1533329 main.go:141] libmachine: Reticulating splines...
I0214 04:06:24.146872 1533329 client.go:171] duration metric: took 25.59036891s to LocalClient.Create
I0214 04:06:24.146902 1533329 start.go:167] duration metric: took 25.590464973s to libmachine.API.Create "kindnet-528898"
I0214 04:06:24.146914 1533329 start.go:293] postStartSetup for "kindnet-528898" (driver="kvm2")
I0214 04:06:24.146930 1533329 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:06:24.146955 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.147217 1533329 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:06:24.147246 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:24.150202 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.150731 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.150764 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.150946 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:24.151149 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.151334 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:24.151513 1533329 sshutil.go:53] new ssh client: &{IP:192.168.72.93 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa Username:docker}
I0214 04:06:24.247458 1533329 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:06:24.251943 1533329 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:06:24.251976 1533329 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:06:24.252055 1533329 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:06:24.252150 1533329 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:06:24.252282 1533329 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:06:24.262141 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:24.286703 1533329 start.go:296] duration metric: took 139.770959ms for postStartSetup
I0214 04:06:24.286780 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetConfigRaw
I0214 04:06:24.287480 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetIP
I0214 04:06:24.290700 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.291237 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.291273 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.291558 1533329 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/config.json ...
I0214 04:06:24.291960 1533329 start.go:128] duration metric: took 25.761131671s to createHost
I0214 04:06:24.292001 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:24.294402 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.294727 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.294749 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.294919 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:24.295137 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.295319 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.295495 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:24.295690 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.296035 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:24.296048 1533329 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:06:24.431171 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707883584.405554710
I0214 04:06:24.431198 1533329 fix.go:216] guest clock: 1707883584.405554710
I0214 04:06:24.431205 1533329 fix.go:229] Guest: 2024-02-14 04:06:24.40555471 +0000 UTC Remote: 2024-02-14 04:06:24.291979137 +0000 UTC m=+82.243775021 (delta=113.575573ms)
I0214 04:06:24.431231 1533329 fix.go:200] guest clock delta is within tolerance: 113.575573ms
I0214 04:06:24.431240 1533329 start.go:83] releasing machines lock for "kindnet-528898", held for 25.900642372s
I0214 04:06:24.431271 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.431602 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetIP
I0214 04:06:24.435080 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.435569 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.435607 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.435753 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.436481 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.436773 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.436877 1533329 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:06:24.436924 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:24.437049 1533329 ssh_runner.go:195] Run: cat /version.json
I0214 04:06:24.437078 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:24.440281 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.440319 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.440803 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.440870 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.440939 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.440963 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.441133 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:24.441244 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:24.441340 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.441398 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.441573 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:24.441586 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:24.441764 1533329 sshutil.go:53] new ssh client: &{IP:192.168.72.93 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa Username:docker}
I0214 04:06:24.441767 1533329 sshutil.go:53] new ssh client: &{IP:192.168.72.93 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa Username:docker}
I0214 04:06:24.565575 1533329 ssh_runner.go:195] Run: systemctl --version
I0214 04:06:24.572252 1533329 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:06:24.737547 1533329 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:06:24.744857 1533329 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:06:24.744963 1533329 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:06:24.761114 1533329 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:06:24.761147 1533329 start.go:494] detecting cgroup driver to use...
I0214 04:06:24.761228 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:06:24.777398 1533329 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:06:24.793731 1533329 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:06:24.793802 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:06:24.810242 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:06:24.827190 1533329 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:06:24.954044 1533329 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:06:25.092865 1533329 docker.go:233] disabling docker service ...
I0214 04:06:25.092954 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:06:25.106637 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:06:25.119104 1533329 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:06:25.241493 1533329 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:06:25.364208 1533329 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:06:25.379722 1533329 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:06:25.401299 1533329 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:06:25.401403 1533329 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:25.415183 1533329 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:06:25.415265 1533329 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:25.429390 1533329 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:25.443668 1533329 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:25.458139 1533329 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:06:25.471497 1533329 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:06:25.481903 1533329 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:06:25.481975 1533329 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:06:25.500396 1533329 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:06:25.512516 1533329 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:25.641000 1533329 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:06:25.843029 1533329 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:06:25.843109 1533329 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:06:25.848353 1533329 start.go:562] Will wait 60s for crictl version
I0214 04:06:25.848428 1533329 ssh_runner.go:195] Run: which crictl
I0214 04:06:25.854048 1533329 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:06:25.895221 1533329 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:06:25.895339 1533329 ssh_runner.go:195] Run: crio --version
I0214 04:06:25.948807 1533329 ssh_runner.go:195] Run: crio --version
I0214 04:06:26.008393 1533329 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:06:26.009943 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetIP
I0214 04:06:26.012704 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:26.013036 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:26.013106 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:26.013308 1533329 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:06:26.017686 1533329 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:06:26.031065 1533329 kubeadm.go:877] updating cluster {Name:kindnet-528898 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:kindnet-528898 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.72.93 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort
:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:06:26.031181 1533329 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:06:26.031226 1533329 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:26.066172 1533329 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:06:26.066246 1533329 ssh_runner.go:195] Run: which lz4
I0214 04:06:26.070545 1533329 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:06:26.075017 1533329 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:06:26.075060 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:06:25.405339 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1204 bytes)
I0214 04:06:25.433511 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:06:25.461693 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:06:25.493110 1534061 provision.go:87] duration metric: took 558.034007ms to configureAuth
I0214 04:06:25.493137 1534061 buildroot.go:189] setting minikube options for container-runtime
I0214 04:06:25.493373 1534061 config.go:182] Loaded profile config "pause-951466": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:25.493451 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:25.496797 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.497375 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:25.497407 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.497653 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:25.497927 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.498130 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.498333 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:25.498576 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:25.499104 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:25.499131 1534061 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:06:25.857138 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:26.356520 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:26.857325 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:27.356889 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:27.856677 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:28.357411 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:28.856618 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:29.356437 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:29.856925 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:30.356619 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:28.055413 1533329 crio.go:444] duration metric: took 1.98490759s to copy over tarball
I0214 04:06:28.055525 1533329 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:06:31.656499 1533329 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.60092179s)
I0214 04:06:31.656548 1533329 crio.go:451] duration metric: took 3.601098567s to extract the tarball
I0214 04:06:31.656568 1533329 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:06:31.700806 1533329 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:31.780332 1533329 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:06:31.780364 1533329 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:06:31.780376 1533329 kubeadm.go:928] updating node { 192.168.72.93 8443 v1.28.4 crio true true} ...
I0214 04:06:31.780509 1533329 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=kindnet-528898 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.72.93
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:kindnet-528898 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet}
I0214 04:06:31.780582 1533329 ssh_runner.go:195] Run: crio config
I0214 04:06:31.844395 1533329 cni.go:84] Creating CNI manager for "kindnet"
I0214 04:06:31.844440 1533329 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:06:31.844464 1533329 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.93 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kindnet-528898 NodeName:kindnet-528898 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.93"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.93 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku
bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:06:31.844633 1533329 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.93
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "kindnet-528898"
kubeletExtraArgs:
node-ip: 192.168.72.93
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.93"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:06:31.844720 1533329 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:06:31.854342 1533329 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:06:31.854435 1533329 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:06:31.863616 1533329 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)
I0214 04:06:31.883185 1533329 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:06:31.899933 1533329 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2155 bytes)
I0214 04:06:31.916821 1533329 ssh_runner.go:195] Run: grep 192.168.72.93 control-plane.minikube.internal$ /etc/hosts
I0214 04:06:31.921887 1533329 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.93 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:06:31.935493 1533329 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:32.041903 1533329 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:06:32.058238 1533329 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898 for IP: 192.168.72.93
I0214 04:06:32.058271 1533329 certs.go:194] generating shared ca certs ...
I0214 04:06:32.058294 1533329 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.058520 1533329 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:06:32.058585 1533329 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:06:32.058600 1533329 certs.go:256] generating profile certs ...
I0214 04:06:32.058678 1533329 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.key
I0214 04:06:32.058711 1533329 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt with IP's: []
I0214 04:06:32.483554 1533329 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt ...
I0214 04:06:32.483597 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: {Name:mkf53b2185a8d5121331af016cdb5f39c378a011 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.483810 1533329 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.key ...
I0214 04:06:32.483845 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.key: {Name:mka2e54089d3d71a6962795ae919d43ae34b658b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.483988 1533329 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key.1b800f55
I0214 04:06:32.484011 1533329 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt.1b800f55 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.93]
I0214 04:06:32.613618 1533329 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt.1b800f55 ...
I0214 04:06:32.613664 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt.1b800f55: {Name:mk328710241c94e67af0973b62221efd52805739 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.613911 1533329 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key.1b800f55 ...
I0214 04:06:32.613942 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key.1b800f55: {Name:mk7be1f5648188f4cafbf35491bf27fd8dc94ce9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.614087 1533329 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt.1b800f55 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt
I0214 04:06:32.614217 1533329 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key.1b800f55 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key
I0214 04:06:32.614314 1533329 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.key
I0214 04:06:32.614340 1533329 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.crt with IP's: []
I0214 04:06:32.772862 1533329 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.crt ...
I0214 04:06:32.772906 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.crt: {Name:mkb2eea88cd2510cf54af217ebf0d07e0167a618 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.773082 1533329 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.key ...
I0214 04:06:32.773095 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.key: {Name:mkc1d314795c1d5dfdcb592ae9736aa69a3d8a0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.773293 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:06:32.773345 1533329 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:06:32.773356 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:06:32.773384 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:06:32.773407 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:06:32.773430 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:06:32.773468 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:32.774199 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:06:32.804374 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:06:32.830523 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:06:32.855621 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:06:32.883437 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0214 04:06:32.923244 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:06:32.946981 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:06:32.972836 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:06:32.996639 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:06:33.019273 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:06:33.045545 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:06:33.070754 1533329 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:06:33.087306 1533329 ssh_runner.go:195] Run: openssl version
I0214 04:06:33.093785 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:06:33.104120 1533329 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:33.109612 1533329 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:33.109690 1533329 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:33.116962 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:06:33.127325 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:06:33.137862 1533329 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:06:33.143172 1533329 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:06:33.143249 1533329 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:06:33.149608 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:06:33.163734 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:06:33.177962 1533329 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:06:33.184559 1533329 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:06:33.184652 1533329 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:06:33.191261 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:06:33.202675 1533329 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:06:33.207338 1533329 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 04:06:33.207426 1533329 kubeadm.go:391] StartCluster: {Name:kindnet-528898 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4
ClusterName:kindnet-528898 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.72.93 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:33.207510 1533329 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:06:33.207563 1533329 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:06:33.252827 1533329 cri.go:89] found id: ""
I0214 04:06:33.252917 1533329 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0214 04:06:33.263638 1533329 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:06:33.273835 1533329 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:06:33.284143 1533329 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:06:33.284175 1533329 kubeadm.go:156] found existing configuration files:
I0214 04:06:33.284234 1533329 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:06:33.293087 1533329 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:06:33.293170 1533329 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:06:33.303595 1533329 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:06:33.312568 1533329 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:06:33.312639 1533329 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:06:33.322401 1533329 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:06:33.331506 1533329 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:06:33.331568 1533329 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:06:33.340740 1533329 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:06:33.349379 1533329 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:06:33.349457 1533329 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:06:33.358825 1533329 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:06:33.424899 1533329 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:06:33.425150 1533329 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:06:33.593958 1533329 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:06:33.594107 1533329 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:06:33.594239 1533329 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:06:33.948455 1533329 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:06:30.857329 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:31.356992 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:31.857071 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:32.357172 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:32.856868 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:33.356862 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:33.857436 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:33.982321 1532906 kubeadm.go:1106] duration metric: took 12.408120233s to wait for elevateKubeSystemPrivileges
W0214 04:06:33.982377 1532906 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:06:33.982386 1532906 kubeadm.go:393] duration metric: took 26.281511703s to StartCluster
I0214 04:06:33.982411 1532906 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:33.982525 1532906 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:06:33.984331 1532906 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:33.984621 1532906 start.go:234] Will wait 15m0s for node &{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:06:33.986659 1532906 out.go:177] * Verifying Kubernetes components...
I0214 04:06:33.984771 1532906 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0214 04:06:33.984791 1532906 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:06:33.984979 1532906 config.go:182] Loaded profile config "auto-528898": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:33.988430 1532906 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:33.988455 1532906 addons.go:69] Setting storage-provisioner=true in profile "auto-528898"
I0214 04:06:33.988481 1532906 addons.go:69] Setting default-storageclass=true in profile "auto-528898"
I0214 04:06:33.988491 1532906 addons.go:234] Setting addon storage-provisioner=true in "auto-528898"
I0214 04:06:33.988529 1532906 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "auto-528898"
I0214 04:06:33.988532 1532906 host.go:66] Checking if "auto-528898" exists ...
I0214 04:06:33.989009 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:33.989070 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:33.989009 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:33.989136 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:34.009394 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42191
I0214 04:06:34.010113 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.010824 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.010860 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.011285 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.011996 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:34.012028 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:34.019526 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45777
I0214 04:06:34.021643 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.022173 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.022195 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.022591 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.022754 1532906 main.go:141] libmachine: (auto-528898) Calling .GetState
I0214 04:06:34.027112 1532906 addons.go:234] Setting addon default-storageclass=true in "auto-528898"
I0214 04:06:34.027161 1532906 host.go:66] Checking if "auto-528898" exists ...
I0214 04:06:34.027543 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:34.027581 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:34.032943 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35053
I0214 04:06:34.033454 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.033921 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.033941 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.034283 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.034521 1532906 main.go:141] libmachine: (auto-528898) Calling .GetState
I0214 04:06:34.036889 1532906 main.go:141] libmachine: (auto-528898) Calling .DriverName
I0214 04:06:34.038733 1532906 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:06:33.677212 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:06:33.677245 1534061 machine.go:97] duration metric: took 9.217278338s to provisionDockerMachine
I0214 04:06:33.677285 1534061 start.go:293] postStartSetup for "pause-951466" (driver="kvm2")
I0214 04:06:33.677301 1534061 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:06:33.677337 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:33.677841 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:06:33.677875 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:33.681031 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.681474 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:33.681496 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.681701 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:33.681919 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.682089 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:33.682240 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:33.793747 1534061 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:06:33.800325 1534061 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:06:33.800365 1534061 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:06:33.800456 1534061 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:06:33.800568 1534061 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:06:33.800703 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:06:33.811682 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:33.843858 1534061 start.go:296] duration metric: took 166.55133ms for postStartSetup
I0214 04:06:33.843943 1534061 fix.go:56] duration metric: took 9.412506338s for fixHost
I0214 04:06:33.843979 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:33.847119 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.847464 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:33.847492 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.847737 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:33.848010 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.848232 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.848410 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:33.848668 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:33.849078 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:33.849092 1534061 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:06:34.064366 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707883594.058978164
I0214 04:06:34.064394 1534061 fix.go:216] guest clock: 1707883594.058978164
I0214 04:06:34.064405 1534061 fix.go:229] Guest: 2024-02-14 04:06:34.058978164 +0000 UTC Remote: 2024-02-14 04:06:33.843953524 +0000 UTC m=+13.569509178 (delta=215.02464ms)
I0214 04:06:34.064451 1534061 fix.go:200] guest clock delta is within tolerance: 215.02464ms
I0214 04:06:34.064458 1534061 start.go:83] releasing machines lock for "pause-951466", held for 9.633059332s
I0214 04:06:34.064493 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.065564 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:34.068871 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.069637 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.069684 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.069713 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.077958 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.078230 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.078337 1534061 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:06:34.078380 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:34.078943 1534061 ssh_runner.go:195] Run: cat /version.json
I0214 04:06:34.078973 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:34.082130 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.082908 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.082941 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.083366 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:34.083579 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:34.083645 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.083916 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:34.084082 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:34.084386 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:34.084202 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.084578 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.084620 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:34.084764 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:34.084995 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:34.547561 1534061 ssh_runner.go:195] Run: systemctl --version
I0214 04:06:34.571488 1534061 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:06:34.795873 1534061 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:06:34.811478 1534061 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:06:34.811567 1534061 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:06:34.828664 1534061 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0214 04:06:34.828712 1534061 start.go:494] detecting cgroup driver to use...
I0214 04:06:34.828791 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:06:34.855603 1534061 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:06:34.877058 1534061 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:06:34.877139 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:06:34.900372 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:06:34.933782 1534061 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:06:34.040538 1532906 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:06:34.040558 1532906 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:06:34.040578 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHHostname
I0214 04:06:34.045561 1532906 main.go:141] libmachine: (auto-528898) DBG | domain auto-528898 has defined MAC address 52:54:00:5a:79:cd in network mk-auto-528898
I0214 04:06:34.046095 1532906 main.go:141] libmachine: (auto-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:79:cd", ip: ""} in network mk-auto-528898: {Iface:virbr3 ExpiryTime:2024-02-14 05:05:45 +0000 UTC Type:0 Mac:52:54:00:5a:79:cd Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:auto-528898 Clientid:01:52:54:00:5a:79:cd}
I0214 04:06:34.046115 1532906 main.go:141] libmachine: (auto-528898) DBG | domain auto-528898 has defined IP address 192.168.39.198 and MAC address 52:54:00:5a:79:cd in network mk-auto-528898
I0214 04:06:34.046281 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHPort
I0214 04:06:34.049455 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHKeyPath
I0214 04:06:34.049639 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHUsername
I0214 04:06:34.049788 1532906 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/auto-528898/id_rsa Username:docker}
I0214 04:06:34.051705 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36995
I0214 04:06:34.052140 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.052770 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.052792 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.053189 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.053800 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:34.053831 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:34.074280 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40821
I0214 04:06:34.074738 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.075335 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.075364 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.075763 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.075977 1532906 main.go:141] libmachine: (auto-528898) Calling .GetState
I0214 04:06:34.077911 1532906 main.go:141] libmachine: (auto-528898) Calling .DriverName
I0214 04:06:34.078194 1532906 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:06:34.078210 1532906 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:06:34.078227 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHHostname
I0214 04:06:34.084002 1532906 main.go:141] libmachine: (auto-528898) DBG | domain auto-528898 has defined MAC address 52:54:00:5a:79:cd in network mk-auto-528898
I0214 04:06:34.084915 1532906 main.go:141] libmachine: (auto-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:79:cd", ip: ""} in network mk-auto-528898: {Iface:virbr3 ExpiryTime:2024-02-14 05:05:45 +0000 UTC Type:0 Mac:52:54:00:5a:79:cd Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:auto-528898 Clientid:01:52:54:00:5a:79:cd}
I0214 04:06:34.084941 1532906 main.go:141] libmachine: (auto-528898) DBG | domain auto-528898 has defined IP address 192.168.39.198 and MAC address 52:54:00:5a:79:cd in network mk-auto-528898
I0214 04:06:34.084988 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHPort
I0214 04:06:34.085209 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHKeyPath
I0214 04:06:34.085431 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHUsername
I0214 04:06:34.085655 1532906 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/auto-528898/id_rsa Username:docker}
I0214 04:06:34.383372 1532906 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:06:34.383675 1532906 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0214 04:06:34.396840 1532906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:06:34.536178 1532906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:06:36.580011 1532906 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.19629818s)
I0214 04:06:36.580057 1532906 start.go:948] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I0214 04:06:36.581884 1532906 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.198470993s)
I0214 04:06:36.583157 1532906 node_ready.go:35] waiting up to 15m0s for node "auto-528898" to be "Ready" ...
I0214 04:06:36.583387 1532906 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.186508399s)
I0214 04:06:36.583430 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.583445 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.583902 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.583922 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.583933 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.583943 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.584211 1532906 main.go:141] libmachine: (auto-528898) DBG | Closing plugin on server side
I0214 04:06:36.584251 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.584268 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.625425 1532906 node_ready.go:49] node "auto-528898" has status "Ready":"True"
I0214 04:06:36.625477 1532906 node_ready.go:38] duration metric: took 42.2894ms for node "auto-528898" to be "Ready" ...
I0214 04:06:36.625493 1532906 pod_ready.go:35] extra waiting up to 15m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:06:36.645816 1532906 pod_ready.go:78] waiting up to 15m0s for pod "coredns-5dd5756b68-64mjb" in "kube-system" namespace to be "Ready" ...
I0214 04:06:36.646401 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.646449 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.646965 1532906 main.go:141] libmachine: (auto-528898) DBG | Closing plugin on server side
I0214 04:06:36.647010 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.647025 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.846539 1532906 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.310304622s)
I0214 04:06:36.846692 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.846753 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.847141 1532906 main.go:141] libmachine: (auto-528898) DBG | Closing plugin on server side
I0214 04:06:36.847188 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.847218 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.847233 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.847247 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.847538 1532906 main.go:141] libmachine: (auto-528898) DBG | Closing plugin on server side
I0214 04:06:36.847577 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.847588 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.850571 1532906 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I0214 04:06:33.952080 1533329 out.go:204] - Generating certificates and keys ...
I0214 04:06:33.952263 1533329 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:06:33.952362 1533329 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:06:34.047593 1533329 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 04:06:34.572559 1533329 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 04:06:34.708612 1533329 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 04:06:34.944353 1533329 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 04:06:35.290599 1533329 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 04:06:35.290997 1533329 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [kindnet-528898 localhost] and IPs [192.168.72.93 127.0.0.1 ::1]
I0214 04:06:35.369151 1533329 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 04:06:35.369471 1533329 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [kindnet-528898 localhost] and IPs [192.168.72.93 127.0.0.1 ::1]
I0214 04:06:35.513544 1533329 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 04:06:35.628451 1533329 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 04:06:35.818260 1533329 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 04:06:35.818575 1533329 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:06:36.007391 1533329 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:06:36.734485 1533329 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:06:36.881469 1533329 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:06:37.028140 1533329 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:06:37.028965 1533329 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:06:37.031784 1533329 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:06:37.033723 1533329 out.go:204] - Booting up control plane ...
I0214 04:06:37.033855 1533329 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:06:37.035511 1533329 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:06:37.036675 1533329 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:06:37.056578 1533329 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:06:37.056735 1533329 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:06:37.056820 1533329 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:06:35.378508 1534061 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:06:35.702727 1534061 docker.go:233] disabling docker service ...
I0214 04:06:35.702821 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:06:35.762944 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:06:35.805557 1534061 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:06:36.152685 1534061 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:06:36.459334 1534061 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:06:36.486614 1534061 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:06:36.538266 1534061 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:06:36.538353 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.560216 1534061 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:06:36.560356 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.608844 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.652421 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.675973 1534061 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:06:36.701752 1534061 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:06:36.723934 1534061 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:06:36.760530 1534061 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:37.142372 1534061 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:06:38.583626 1534061 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1.441206411s)
I0214 04:06:38.583665 1534061 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:06:38.583728 1534061 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:06:38.589300 1534061 start.go:562] Will wait 60s for crictl version
I0214 04:06:38.589374 1534061 ssh_runner.go:195] Run: which crictl
I0214 04:06:38.593346 1534061 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:06:38.636742 1534061 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:06:38.636864 1534061 ssh_runner.go:195] Run: crio --version
I0214 04:06:38.696074 1534061 ssh_runner.go:195] Run: crio --version
I0214 04:06:38.747754 1534061 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:06:38.749416 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:38.752813 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:38.753183 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:38.753208 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:38.753470 1534061 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0214 04:06:38.759411 1534061 kubeadm.go:877] updating cluster {Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4
ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false
olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:06:38.759577 1534061 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:06:38.759646 1534061 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:38.821329 1534061 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:06:38.821375 1534061 crio.go:415] Images already preloaded, skipping extraction
I0214 04:06:38.821442 1534061 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:38.862076 1534061 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:06:38.862112 1534061 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:06:38.862128 1534061 kubeadm.go:928] updating node { 192.168.61.64 8443 v1.28.4 crio true true} ...
I0214 04:06:38.862277 1534061 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=pause-951466 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.64
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:06:38.862365 1534061 ssh_runner.go:195] Run: crio config
I0214 04:06:38.934373 1534061 cni.go:84] Creating CNI manager for ""
I0214 04:06:38.934408 1534061 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:06:38.934426 1534061 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:06:38.934465 1534061 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.64 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-951466 NodeName:pause-951466 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.64"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.64 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubern
etes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:06:38.934663 1534061 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.64
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "pause-951466"
kubeletExtraArgs:
node-ip: 192.168.61.64
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.64"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:06:38.934746 1534061 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:06:38.945954 1534061 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:06:38.946030 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:06:38.957200 1534061 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (311 bytes)
I0214 04:06:38.977693 1534061 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:06:38.995710 1534061 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)
I0214 04:06:39.016901 1534061 ssh_runner.go:195] Run: grep 192.168.61.64 control-plane.minikube.internal$ /etc/hosts
I0214 04:06:39.022519 1534061 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:39.500604 1534061 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:06:39.639408 1534061 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466 for IP: 192.168.61.64
I0214 04:06:39.639441 1534061 certs.go:194] generating shared ca certs ...
I0214 04:06:39.639475 1534061 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:39.639676 1534061 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:06:39.639749 1534061 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:06:39.639763 1534061 certs.go:256] generating profile certs ...
I0214 04:06:39.639895 1534061 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/client.key
I0214 04:06:39.639983 1534061 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.key.9654be93
I0214 04:06:39.640064 1534061 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.key
I0214 04:06:39.640224 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:06:39.640266 1534061 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:06:39.640279 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:06:39.640314 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:06:39.640346 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:06:39.640392 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:06:39.640455 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:39.641377 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:06:39.696825 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:06:39.746233 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:06:39.785132 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:06:39.827358 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0214 04:06:39.880076 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 04:06:39.920074 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:06:39.944377 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:06:39.972007 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:06:40.062131 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:06:40.125888 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:06:40.205494 1534061 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:06:40.237725 1534061 ssh_runner.go:195] Run: openssl version
I0214 04:06:40.257410 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:06:40.277411 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.285844 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.285927 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.297791 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:06:40.317947 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:06:36.852296 1532906 addons.go:505] duration metric: took 2.867518272s for enable addons: enabled=[default-storageclass storage-provisioner]
I0214 04:06:37.092267 1532906 kapi.go:248] "coredns" deployment in "kube-system" namespace and "auto-528898" context rescaled to 1 replicas
I0214 04:06:38.656383 1532906 pod_ready.go:102] pod "coredns-5dd5756b68-64mjb" in "kube-system" namespace has status "Ready":"False"
I0214 04:06:39.155202 1532906 pod_ready.go:92] pod "coredns-5dd5756b68-64mjb" in "kube-system" namespace has status "Ready":"True"
I0214 04:06:39.155234 1532906 pod_ready.go:81] duration metric: took 2.509321619s for pod "coredns-5dd5756b68-64mjb" in "kube-system" namespace to be "Ready" ...
I0214 04:06:39.155248 1532906 pod_ready.go:78] waiting up to 15m0s for pod "coredns-5dd5756b68-9jtk9" in "kube-system" namespace to be "Ready" ...
I0214 04:06:37.249804 1533329 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:06:40.339071 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.349634 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.349713 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.360896 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:06:40.378400 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:06:40.401064 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.410181 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.410258 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.421748 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:06:40.435327 1534061 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:06:40.451007 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:06:40.461126 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:06:40.472196 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:06:40.486842 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:06:40.499789 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:06:40.512866 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:06:40.527853 1534061 kubeadm.go:391] StartCluster: {Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cl
usterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false ol
m:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:40.528067 1534061 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:06:40.528148 1534061 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:06:40.604639 1534061 cri.go:89] found id: "ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7"
I0214 04:06:40.604671 1534061 cri.go:89] found id: "1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7"
I0214 04:06:40.604678 1534061 cri.go:89] found id: "cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b"
I0214 04:06:40.604685 1534061 cri.go:89] found id: "0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189"
I0214 04:06:40.604691 1534061 cri.go:89] found id: "3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5"
I0214 04:06:40.604697 1534061 cri.go:89] found id: "a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5"
I0214 04:06:40.604703 1534061 cri.go:89] found id: ""
I0214 04:06:40.604760 1534061 ssh_runner.go:195] Run: sudo runc list -f json
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:04:49 UTC, ends at Wed 2024-02-14 04:07:04 UTC. --
Feb 14 04:07:03 pause-951466 crio[2767]: time="2024-02-14 04:07:03.997199381Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707883623997185917,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},}" file="go-grpc-middleware/chain.go:25" id=ac46cc66-4fc3-42ef-8316-f6935295ec94 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:03 pause-951466 crio[2767]: time="2024-02-14 04:07:03.997906289Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=fe277b0d-9cc6-4642-861e-2bab7dd57a3c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:03 pause-951466 crio[2767]: time="2024-02-14 04:07:03.998004047Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=fe277b0d-9cc6-4642-861e-2bab7dd57a3c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.002871680Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba,PodSandboxId:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707883609604748053,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePat
h: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014,PodSandboxId:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707883609580089528,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28,PodSandboxId:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707883603073325379,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:
map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724,PodSandboxId:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707883603061394627,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf184
6b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254,PodSandboxId:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb7530c3,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707883603012090131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotati
ons:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d,PodSandboxId:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707883600772799614,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]s
tring{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7,PodSandboxId:dd467bf0567b71627d2dc460f3b7f12f8a7d1c04b20d0dbd0fc81168941147c6,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707883596599341815,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 1,
io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7,PodSandboxId:770fbdf632a1d6c1a73c24acb0c61fc5c6c583371dbfdbad3438bf53bf49de51,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707883595761831063,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf1846b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.term
inationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b,PodSandboxId:55a06fc16b903b9f295e66491cbb864d43a7885b816aea2c7e571b816cd26775,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707883595547868840,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotations:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.
container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189,PodSandboxId:2b0e3228392a59920963e9f065ab2c7c14ebcb06fb6631f0bf9dbbdfc5f50021,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707883540682109734,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.termination
GracePeriod: 30,},},&Container{Id:3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5,PodSandboxId:32bbb4ebf19a698d3f9eae6d2c23b1b90a41b69f7dbbda731a861bc951b59a96,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707883540555644362,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCoun
t: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5,PodSandboxId:8c5ac1cacda530e913fcfdf329cc72f5fb7310d1059d262e9808a451a4b75d72,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707883516284052861,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=fe277b0d-9cc6-4642-861e-2bab7dd57a3c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.052631291Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=bd129db4-2fa2-44a6-8337-011e679fab6f name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.052692666Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=bd129db4-2fa2-44a6-8337-011e679fab6f name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.054471690Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=154addc0-88a0-4f40-9f90-271df6bd73c1 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.054922639Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707883624054906759,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},}" file="go-grpc-middleware/chain.go:25" id=154addc0-88a0-4f40-9f90-271df6bd73c1 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.055704785Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=98f3160e-854f-4720-a3cc-fdaa124337f0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.055791166Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=98f3160e-854f-4720-a3cc-fdaa124337f0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.056050276Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba,PodSandboxId:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707883609604748053,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePat
h: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014,PodSandboxId:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707883609580089528,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28,PodSandboxId:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707883603073325379,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:
map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724,PodSandboxId:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707883603061394627,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf184
6b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254,PodSandboxId:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb7530c3,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707883603012090131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotati
ons:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d,PodSandboxId:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707883600772799614,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]s
tring{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7,PodSandboxId:dd467bf0567b71627d2dc460f3b7f12f8a7d1c04b20d0dbd0fc81168941147c6,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707883596599341815,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 1,
io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7,PodSandboxId:770fbdf632a1d6c1a73c24acb0c61fc5c6c583371dbfdbad3438bf53bf49de51,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707883595761831063,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf1846b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.term
inationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b,PodSandboxId:55a06fc16b903b9f295e66491cbb864d43a7885b816aea2c7e571b816cd26775,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707883595547868840,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotations:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.
container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189,PodSandboxId:2b0e3228392a59920963e9f065ab2c7c14ebcb06fb6631f0bf9dbbdfc5f50021,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707883540682109734,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.termination
GracePeriod: 30,},},&Container{Id:3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5,PodSandboxId:32bbb4ebf19a698d3f9eae6d2c23b1b90a41b69f7dbbda731a861bc951b59a96,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707883540555644362,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCoun
t: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5,PodSandboxId:8c5ac1cacda530e913fcfdf329cc72f5fb7310d1059d262e9808a451a4b75d72,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707883516284052861,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=98f3160e-854f-4720-a3cc-fdaa124337f0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.103935610Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=af2819b4-be33-45fb-9687-29f22de98700 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.104021369Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=af2819b4-be33-45fb-9687-29f22de98700 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.105314148Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=5f49f2b8-9519-44c5-ad53-e9e028084e18 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.105856709Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707883624105838279,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},}" file="go-grpc-middleware/chain.go:25" id=5f49f2b8-9519-44c5-ad53-e9e028084e18 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.106316708Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=5723f2af-6756-410f-a762-7c93ffceb776 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.106390437Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=5723f2af-6756-410f-a762-7c93ffceb776 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.106670206Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba,PodSandboxId:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707883609604748053,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePat
h: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014,PodSandboxId:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707883609580089528,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28,PodSandboxId:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707883603073325379,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:
map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724,PodSandboxId:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707883603061394627,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf184
6b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254,PodSandboxId:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb7530c3,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707883603012090131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotati
ons:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d,PodSandboxId:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707883600772799614,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]s
tring{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7,PodSandboxId:dd467bf0567b71627d2dc460f3b7f12f8a7d1c04b20d0dbd0fc81168941147c6,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707883596599341815,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 1,
io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7,PodSandboxId:770fbdf632a1d6c1a73c24acb0c61fc5c6c583371dbfdbad3438bf53bf49de51,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707883595761831063,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf1846b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.term
inationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b,PodSandboxId:55a06fc16b903b9f295e66491cbb864d43a7885b816aea2c7e571b816cd26775,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707883595547868840,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotations:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.
container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189,PodSandboxId:2b0e3228392a59920963e9f065ab2c7c14ebcb06fb6631f0bf9dbbdfc5f50021,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707883540682109734,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.termination
GracePeriod: 30,},},&Container{Id:3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5,PodSandboxId:32bbb4ebf19a698d3f9eae6d2c23b1b90a41b69f7dbbda731a861bc951b59a96,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707883540555644362,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCoun
t: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5,PodSandboxId:8c5ac1cacda530e913fcfdf329cc72f5fb7310d1059d262e9808a451a4b75d72,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707883516284052861,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=5723f2af-6756-410f-a762-7c93ffceb776 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.159744933Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=e8fcddf8-3847-4386-90b2-4a5ddd135ea2 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.159852155Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=e8fcddf8-3847-4386-90b2-4a5ddd135ea2 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.161077991Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=7f89210f-053f-449d-93d9-db459b8be2d5 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.161627588Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707883624161603438,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},}" file="go-grpc-middleware/chain.go:25" id=7f89210f-053f-449d-93d9-db459b8be2d5 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.162305654Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=f26907fb-d1ce-4807-af39-f823bf7ce2bf name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.162378151Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=f26907fb-d1ce-4807-af39-f823bf7ce2bf name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:04 pause-951466 crio[2767]: time="2024-02-14 04:07:04.162836810Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba,PodSandboxId:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707883609604748053,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePat
h: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014,PodSandboxId:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707883609580089528,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28,PodSandboxId:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707883603073325379,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:
map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724,PodSandboxId:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707883603061394627,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf184
6b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254,PodSandboxId:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb7530c3,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707883603012090131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotati
ons:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d,PodSandboxId:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707883600772799614,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]s
tring{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7,PodSandboxId:dd467bf0567b71627d2dc460f3b7f12f8a7d1c04b20d0dbd0fc81168941147c6,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707883596599341815,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 1,
io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7,PodSandboxId:770fbdf632a1d6c1a73c24acb0c61fc5c6c583371dbfdbad3438bf53bf49de51,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707883595761831063,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf1846b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.term
inationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b,PodSandboxId:55a06fc16b903b9f295e66491cbb864d43a7885b816aea2c7e571b816cd26775,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707883595547868840,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotations:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.
container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189,PodSandboxId:2b0e3228392a59920963e9f065ab2c7c14ebcb06fb6631f0bf9dbbdfc5f50021,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707883540682109734,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.termination
GracePeriod: 30,},},&Container{Id:3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5,PodSandboxId:32bbb4ebf19a698d3f9eae6d2c23b1b90a41b69f7dbbda731a861bc951b59a96,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707883540555644362,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCoun
t: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5,PodSandboxId:8c5ac1cacda530e913fcfdf329cc72f5fb7310d1059d262e9808a451a4b75d72,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707883516284052861,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=f26907fb-d1ce-4807-af39-f823bf7ce2bf name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
ee51192443906 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 14 seconds ago Running kube-proxy 1 56f8fa60100f4 kube-proxy-lrmhp
f50776e8acf9a ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 14 seconds ago Running coredns 1 f66b83c6da2bd coredns-5dd5756b68-rsn2w
a656f4676ec8e 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 21 seconds ago Running etcd 2 0be2dc2612651 etcd-pause-951466
a52ad0549f843 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 21 seconds ago Running kube-controller-manager 2 d3eefb9f4d69d kube-controller-manager-pause-951466
b020ac4e50a5f 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 21 seconds ago Running kube-apiserver 2 4963f328b78ca kube-apiserver-pause-951466
63a05e8ef8bd3 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 23 seconds ago Running kube-scheduler 1 336d83b5a0d66 kube-scheduler-pause-951466
ef900e47b23bd 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 27 seconds ago Exited etcd 1 dd467bf0567b7 etcd-pause-951466
1bc4409034161 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 28 seconds ago Exited kube-controller-manager 1 770fbdf632a1d kube-controller-manager-pause-951466
cb6c13c72fd3f 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 28 seconds ago Exited kube-apiserver 1 55a06fc16b903 kube-apiserver-pause-951466
0550efbb7b836 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e About a minute ago Exited kube-proxy 0 2b0e3228392a5 kube-proxy-lrmhp
3ee34acf1521f ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc About a minute ago Exited coredns 0 32bbb4ebf19a6 coredns-5dd5756b68-rsn2w
a7d06e68e3786 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 About a minute ago Exited kube-scheduler 0 8c5ac1cacda53 kube-scheduler-pause-951466
==> coredns [3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: i/o timeout
[INFO] Reloading
[INFO] plugin/reload: Running configuration SHA512 = 7996ca7cabdb2fd3e37b0463c78d5a492f8d30690ee66a90ae7ff24c50d9d936a24d239b3a5946771521ff70c09a796ffaf6ef8abe5753fd1ad5af38b6cdbb7f
[INFO] Reloading complete
[INFO] 127.0.0.1:55567 - 45290 "HINFO IN 7947121574309215298.4406530438668576787. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.028302595s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> coredns [f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 7996ca7cabdb2fd3e37b0463c78d5a492f8d30690ee66a90ae7ff24c50d9d936a24d239b3a5946771521ff70c09a796ffaf6ef8abe5753fd1ad5af38b6cdbb7f
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:55171 - 4500 "HINFO IN 2986831352118255742.7066900278557097918. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.120580936s
==> describe nodes <==
Name: pause-951466
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=pause-951466
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=pause-951466
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_05_24_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:05:20 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: pause-951466
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 04:06:58 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:06:48 +0000 Wed, 14 Feb 2024 04:05:18 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:06:48 +0000 Wed, 14 Feb 2024 04:05:18 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:06:48 +0000 Wed, 14 Feb 2024 04:05:18 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:06:48 +0000 Wed, 14 Feb 2024 04:05:24 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.61.64
Hostname: pause-951466
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2017420Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2017420Ki
pods: 110
System Info:
Machine ID: bd5b142b3fca41dea3382399cfa67768
System UUID: bd5b142b-3fca-41de-a338-2399cfa67768
Boot ID: 09e3adcb-cf14-4ce4-a26a-1b7c9de9fbc9
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (6 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-5dd5756b68-rsn2w 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 87s
kube-system etcd-pause-951466 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (5%!)(MISSING) 0 (0%!)(MISSING) 101s
kube-system kube-apiserver-pause-951466 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 101s
kube-system kube-controller-manager-pause-951466 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 100s
kube-system kube-proxy-lrmhp 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 87s
kube-system kube-scheduler-pause-951466 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 100s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 0 (0%!)(MISSING)
memory 170Mi (8%!)(MISSING) 170Mi (8%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 82s kube-proxy
Normal Starting 14s kube-proxy
Normal NodeAllocatableEnforced 100s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 100s kubelet Node pause-951466 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 100s kubelet Node pause-951466 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 100s kubelet Node pause-951466 status is now: NodeHasSufficientPID
Normal NodeReady 100s kubelet Node pause-951466 status is now: NodeReady
Normal Starting 100s kubelet Starting kubelet.
Normal RegisteredNode 87s node-controller Node pause-951466 event: Registered Node pause-951466 in Controller
Normal Starting 22s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 22s (x8 over 22s) kubelet Node pause-951466 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 22s (x8 over 22s) kubelet Node pause-951466 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 22s (x7 over 22s) kubelet Node pause-951466 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 22s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 4s node-controller Node pause-951466 event: Registered Node pause-951466 in Controller
==> dmesg <==
[ +4.592226] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.157494] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.158160] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.115431] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000009] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[Feb14 04:05] systemd-fstab-generator[644]: Ignoring "noauto" for root device
[ +0.109995] systemd-fstab-generator[655]: Ignoring "noauto" for root device
[ +0.141094] systemd-fstab-generator[668]: Ignoring "noauto" for root device
[ +0.124128] systemd-fstab-generator[679]: Ignoring "noauto" for root device
[ +0.221661] systemd-fstab-generator[703]: Ignoring "noauto" for root device
[ +5.829895] systemd-fstab-generator[803]: Ignoring "noauto" for root device
[ +4.643365] systemd-fstab-generator[990]: Ignoring "noauto" for root device
[ +9.814255] systemd-fstab-generator[1322]: Ignoring "noauto" for root device
[ +14.299474] systemd-fstab-generator[1547]: Ignoring "noauto" for root device
[ +12.897647] kauditd_printk_skb: 28 callbacks suppressed
[Feb14 04:06] systemd-fstab-generator[2485]: Ignoring "noauto" for root device
[ +0.391107] systemd-fstab-generator[2501]: Ignoring "noauto" for root device
[ +0.459675] systemd-fstab-generator[2558]: Ignoring "noauto" for root device
[ +0.308833] systemd-fstab-generator[2577]: Ignoring "noauto" for root device
[ +0.635277] systemd-fstab-generator[2629]: Ignoring "noauto" for root device
[ +2.231490] systemd-fstab-generator[2905]: Ignoring "noauto" for root device
[ +2.857324] systemd-fstab-generator[3307]: Ignoring "noauto" for root device
[ +17.477857] systemd-fstab-generator[3716]: Ignoring "noauto" for root device
==> etcd [a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28] <==
{"level":"info","ts":"2024-02-14T04:06:45.418326Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T04:06:45.418366Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T04:06:45.418885Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 switched to configuration voters=(12995502694743150360)"}
{"level":"info","ts":"2024-02-14T04:06:45.419032Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"a20e7ca2a4f7396b","local-member-id":"b4594cd905cc0f18","added-peer-id":"b4594cd905cc0f18","added-peer-peer-urls":["https://192.168.61.64:2380"]}
{"level":"info","ts":"2024-02-14T04:06:45.419219Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"a20e7ca2a4f7396b","local-member-id":"b4594cd905cc0f18","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:06:45.419287Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:06:45.425179Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-02-14T04:06:45.425449Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"b4594cd905cc0f18","initial-advertise-peer-urls":["https://192.168.61.64:2380"],"listen-peer-urls":["https://192.168.61.64:2380"],"advertise-client-urls":["https://192.168.61.64:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.61.64:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-02-14T04:06:45.425566Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.61.64:2380"}
{"level":"info","ts":"2024-02-14T04:06:45.425649Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.61.64:2380"}
{"level":"info","ts":"2024-02-14T04:06:45.425685Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-02-14T04:06:46.600966Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 is starting a new election at term 2"}
{"level":"info","ts":"2024-02-14T04:06:46.601046Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 became pre-candidate at term 2"}
{"level":"info","ts":"2024-02-14T04:06:46.601087Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 received MsgPreVoteResp from b4594cd905cc0f18 at term 2"}
{"level":"info","ts":"2024-02-14T04:06:46.601119Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 became candidate at term 3"}
{"level":"info","ts":"2024-02-14T04:06:46.60113Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 received MsgVoteResp from b4594cd905cc0f18 at term 3"}
{"level":"info","ts":"2024-02-14T04:06:46.601146Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 became leader at term 3"}
{"level":"info","ts":"2024-02-14T04:06:46.601157Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: b4594cd905cc0f18 elected leader b4594cd905cc0f18 at term 3"}
{"level":"info","ts":"2024-02-14T04:06:46.608187Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"b4594cd905cc0f18","local-member-attributes":"{Name:pause-951466 ClientURLs:[https://192.168.61.64:2379]}","request-path":"/0/members/b4594cd905cc0f18/attributes","cluster-id":"a20e7ca2a4f7396b","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T04:06:46.60821Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:06:46.608226Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:06:46.610006Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.61.64:2379"}
{"level":"info","ts":"2024-02-14T04:06:46.610006Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T04:06:46.625614Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T04:06:46.62568Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
==> etcd [ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7] <==
==> kernel <==
04:07:04 up 2 min, 0 users, load average: 1.58, 0.62, 0.23
Linux pause-951466 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254] <==
I0214 04:06:48.238560 1 aggregator.go:164] waiting for initial CRD sync...
I0214 04:06:48.243218 1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0214 04:06:48.243272 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0214 04:06:48.427365 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0214 04:06:48.428244 1 shared_informer.go:318] Caches are synced for configmaps
I0214 04:06:48.428350 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0214 04:06:48.435602 1 apf_controller.go:377] Running API Priority and Fairness config worker
I0214 04:06:48.435640 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I0214 04:06:48.438562 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0214 04:06:48.440757 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0214 04:06:48.440910 1 shared_informer.go:318] Caches are synced for node_authorizer
I0214 04:06:48.443617 1 shared_informer.go:318] Caches are synced for crd-autoregister
I0214 04:06:48.443701 1 aggregator.go:166] initial CRD sync complete...
I0214 04:06:48.443733 1 autoregister_controller.go:141] Starting autoregister controller
I0214 04:06:48.443755 1 cache.go:32] Waiting for caches to sync for autoregister controller
I0214 04:06:48.443779 1 cache.go:39] Caches are synced for autoregister controller
E0214 04:06:48.477769 1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service
I0214 04:06:49.237391 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0214 04:06:50.132215 1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0214 04:06:50.147045 1 controller.go:624] quota admission added evaluator for: deployments.apps
I0214 04:06:50.195457 1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0214 04:06:50.225239 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0214 04:06:50.233399 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0214 04:07:00.773231 1 controller.go:624] quota admission added evaluator for: endpoints
I0214 04:07:00.884422 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
==> kube-apiserver [cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b] <==
==> kube-controller-manager [1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7] <==
==> kube-controller-manager [a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724] <==
I0214 04:07:00.755022 1 shared_informer.go:318] Caches are synced for daemon sets
I0214 04:07:00.756245 1 shared_informer.go:318] Caches are synced for PVC protection
I0214 04:07:00.762745 1 shared_informer.go:318] Caches are synced for endpoint
I0214 04:07:00.777091 1 shared_informer.go:318] Caches are synced for ephemeral
I0214 04:07:00.780614 1 shared_informer.go:318] Caches are synced for ReplicationController
I0214 04:07:00.786215 1 shared_informer.go:318] Caches are synced for stateful set
I0214 04:07:00.798442 1 shared_informer.go:318] Caches are synced for endpoint_slice
I0214 04:07:00.800589 1 shared_informer.go:318] Caches are synced for deployment
I0214 04:07:00.804686 1 shared_informer.go:318] Caches are synced for GC
I0214 04:07:00.810415 1 shared_informer.go:318] Caches are synced for HPA
I0214 04:07:00.828453 1 shared_informer.go:318] Caches are synced for taint
I0214 04:07:00.828873 1 node_lifecycle_controller.go:1225] "Initializing eviction metric for zone" zone=""
I0214 04:07:00.829287 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="pause-951466"
I0214 04:07:00.830825 1 node_lifecycle_controller.go:1071] "Controller detected that zone is now in new state" zone="" newState="Normal"
I0214 04:07:00.830856 1 shared_informer.go:318] Caches are synced for ReplicaSet
I0214 04:07:00.831007 1 event.go:307] "Event occurred" object="pause-951466" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-951466 event: Registered Node pause-951466 in Controller"
I0214 04:07:00.831162 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="165.24µs"
I0214 04:07:00.829726 1 taint_manager.go:205] "Starting NoExecuteTaintManager"
I0214 04:07:00.831243 1 taint_manager.go:210] "Sending events to api server"
I0214 04:07:00.891393 1 shared_informer.go:318] Caches are synced for resource quota
I0214 04:07:00.909228 1 shared_informer.go:318] Caches are synced for disruption
I0214 04:07:00.930292 1 shared_informer.go:318] Caches are synced for resource quota
I0214 04:07:01.287917 1 shared_informer.go:318] Caches are synced for garbage collector
I0214 04:07:01.326433 1 shared_informer.go:318] Caches are synced for garbage collector
I0214 04:07:01.326594 1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
==> kube-proxy [0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189] <==
I0214 04:05:41.421606 1 server_others.go:69] "Using iptables proxy"
I0214 04:05:41.442692 1 node.go:141] Successfully retrieved node IP: 192.168.61.64
I0214 04:05:41.504127 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 04:05:41.504204 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:05:41.507586 1 server_others.go:152] "Using iptables Proxier"
I0214 04:05:41.508303 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:05:41.508669 1 server.go:846] "Version info" version="v1.28.4"
I0214 04:05:41.508719 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:05:41.511625 1 config.go:188] "Starting service config controller"
I0214 04:05:41.512190 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:05:41.512259 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:05:41.512280 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:05:41.515603 1 config.go:315] "Starting node config controller"
I0214 04:05:41.515743 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:05:41.612452 1 shared_informer.go:318] Caches are synced for service config
I0214 04:05:41.612453 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 04:05:41.615911 1 shared_informer.go:318] Caches are synced for node config
==> kube-proxy [ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba] <==
I0214 04:06:49.879398 1 server_others.go:69] "Using iptables proxy"
I0214 04:06:49.897206 1 node.go:141] Successfully retrieved node IP: 192.168.61.64
I0214 04:06:49.960928 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 04:06:49.961034 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:06:49.965881 1 server_others.go:152] "Using iptables Proxier"
I0214 04:06:49.966034 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:06:49.966209 1 server.go:846] "Version info" version="v1.28.4"
I0214 04:06:49.966350 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:06:49.968076 1 config.go:188] "Starting service config controller"
I0214 04:06:49.968122 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:06:49.968153 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:06:49.968169 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:06:49.968271 1 config.go:315] "Starting node config controller"
I0214 04:06:49.968290 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:06:50.068216 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 04:06:50.068337 1 shared_informer.go:318] Caches are synced for node config
I0214 04:06:50.068360 1 shared_informer.go:318] Caches are synced for service config
==> kube-scheduler [63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d] <==
I0214 04:06:44.418421 1 serving.go:348] Generated self-signed cert in-memory
W0214 04:06:48.333083 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0214 04:06:48.333328 1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0214 04:06:48.333412 1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
W0214 04:06:48.333441 1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0214 04:06:48.399323 1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"
I0214 04:06:48.399431 1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:06:48.403980 1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
I0214 04:06:48.404308 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0214 04:06:48.404415 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 04:06:48.404590 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0214 04:06:48.504835 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5] <==
E0214 04:05:21.649832 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0214 04:05:21.665915 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0214 04:05:21.665968 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
W0214 04:05:21.725730 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:05:21.725756 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0214 04:05:21.768762 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:05:21.768817 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 04:05:21.782614 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 04:05:21.782666 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0214 04:05:21.805987 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 04:05:21.806084 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 04:05:21.866961 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:05:21.867011 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0214 04:05:22.007209 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:05:22.007302 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 04:05:22.042913 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 04:05:22.043000 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0214 04:05:22.163948 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 04:05:22.164005 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 04:05:22.316859 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 04:05:22.316979 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0214 04:05:24.259702 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 04:06:25.675684 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
I0214 04:06:25.675988 1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259
E0214 04:06:25.676635 1 run.go:74] "command failed" err="finished without leader elect"
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:04:49 UTC, ends at Wed 2024-02-14 04:07:05 UTC. --
Feb 14 04:06:42 pause-951466 kubelet[3313]: I0214 04:06:42.985939 3313 scope.go:117] "RemoveContainer" containerID="a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5"
Feb 14 04:06:43 pause-951466 kubelet[3313]: W0214 04:06:43.280004 3313 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)pause-951466&limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.280078 3313 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)pause-951466&limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: W0214 04:06:43.567980 3313 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.568037 3313 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: W0214 04:06:43.625688 3313 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: Get "https://control-plane.minikube.internal:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.625779 3313 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://control-plane.minikube.internal:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.663148 3313 controller.go:146] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-951466?timeout=10s\": dial tcp 192.168.61.64:8443: connect: connection refused" interval="1.6s"
Feb 14 04:06:43 pause-951466 kubelet[3313]: I0214 04:06:43.769736 3313 kubelet_node_status.go:70] "Attempting to register node" node="pause-951466"
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.771148 3313 kubelet_node_status.go:92] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.61.64:8443: connect: connection refused" node="pause-951466"
Feb 14 04:06:43 pause-951466 kubelet[3313]: W0214 04:06:43.883294 3313 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.883383 3313 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:45 pause-951466 kubelet[3313]: I0214 04:06:45.373292 3313 kubelet_node_status.go:70] "Attempting to register node" node="pause-951466"
Feb 14 04:06:48 pause-951466 kubelet[3313]: I0214 04:06:48.460905 3313 kubelet_node_status.go:108] "Node was previously registered" node="pause-951466"
Feb 14 04:06:48 pause-951466 kubelet[3313]: I0214 04:06:48.460994 3313 kubelet_node_status.go:73] "Successfully registered node" node="pause-951466"
Feb 14 04:06:48 pause-951466 kubelet[3313]: I0214 04:06:48.464958 3313 kuberuntime_manager.go:1528] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"
Feb 14 04:06:48 pause-951466 kubelet[3313]: I0214 04:06:48.466292 3313 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
Feb 14 04:06:48 pause-951466 kubelet[3313]: E0214 04:06:48.790262 3313 kubelet.go:1890] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-pause-951466\" already exists" pod="kube-system/kube-controller-manager-pause-951466"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.230041 3313 apiserver.go:52] "Watching apiserver"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.236108 3313 topology_manager.go:215] "Topology Admit Handler" podUID="fc243ae7-ccbe-4149-9159-10f6dfc3f9cd" podNamespace="kube-system" podName="kube-proxy-lrmhp"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.236268 3313 topology_manager.go:215] "Topology Admit Handler" podUID="71d07922-2814-4eb9-94f9-c2c3f46066b2" podNamespace="kube-system" podName="coredns-5dd5756b68-rsn2w"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.257156 3313 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.288592 3313 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc243ae7-ccbe-4149-9159-10f6dfc3f9cd-lib-modules\") pod \"kube-proxy-lrmhp\" (UID: \"fc243ae7-ccbe-4149-9159-10f6dfc3f9cd\") " pod="kube-system/kube-proxy-lrmhp"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.288633 3313 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/fc243ae7-ccbe-4149-9159-10f6dfc3f9cd-xtables-lock\") pod \"kube-proxy-lrmhp\" (UID: \"fc243ae7-ccbe-4149-9159-10f6dfc3f9cd\") " pod="kube-system/kube-proxy-lrmhp"
Feb 14 04:06:57 pause-951466 kubelet[3313]: I0214 04:06:57.727397 3313 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
-- /stdout --
** stderr **
E0214 04:07:03.567484 1534344 logs.go:258] failed to output last start logs: failed to read file /home/jenkins/minikube-integration/17909-1487441/.minikube/logs/lastStart.txt: bufio.Scanner: token too long
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-951466 -n pause-951466
helpers_test.go:261: (dbg) Run: kubectl --context pause-951466 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestPause/serial/SecondStartNoReconfiguration FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p pause-951466 -n pause-951466
helpers_test.go:244: <<< TestPause/serial/SecondStartNoReconfiguration FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestPause/serial/SecondStartNoReconfiguration]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p pause-951466 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p pause-951466 logs -n 25: (1.538964319s)
helpers_test.go:252: TestPause/serial/SecondStartNoReconfiguration logs:
-- stdout --
==> Audit <==
|---------|----------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|----------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-528898 sudo | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | systemctl cat containerd | | | | | |
| | --no-pager | | | | | |
| ssh | -p cilium-528898 sudo cat | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | /lib/systemd/system/containerd.service | | | | | |
| ssh | -p cilium-528898 sudo cat | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p cilium-528898 sudo | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | containerd config dump | | | | | |
| ssh | -p cilium-528898 sudo | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p cilium-528898 sudo | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p cilium-528898 sudo find | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-528898 sudo crio | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | config | | | | | |
| delete | -p cilium-528898 | cilium-528898 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:03 UTC |
| start | -p force-systemd-flag-681097 | force-systemd-flag-681097 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:04 UTC |
| | --memory=2048 --force-systemd | | | | | |
| | --alsologtostderr | | | | | |
| | -v=5 --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p stopped-upgrade-581303 | stopped-upgrade-581303 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:03 UTC |
| start | -p cert-options-608119 | cert-options-608119 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:05 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | -p NoKubernetes-841938 sudo | NoKubernetes-841938 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | |
| | systemctl is-active --quiet | | | | | |
| | service kubelet | | | | | |
| delete | -p NoKubernetes-841938 | NoKubernetes-841938 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:03 UTC |
| start | -p pause-951466 --memory=2048 | pause-951466 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:06 UTC |
| | --install-addons=false | | | | | |
| | --wait=all --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p force-systemd-env-059598 | force-systemd-env-059598 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:03 UTC |
| start | -p cert-expiration-239926 | cert-expiration-239926 | jenkins | v1.32.0 | 14 Feb 24 04:03 UTC | 14 Feb 24 04:05 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | force-systemd-flag-681097 ssh cat | force-systemd-flag-681097 | jenkins | v1.32.0 | 14 Feb 24 04:04 UTC | 14 Feb 24 04:04 UTC |
| | /etc/crio/crio.conf.d/02-crio.conf | | | | | |
| delete | -p force-systemd-flag-681097 | force-systemd-flag-681097 | jenkins | v1.32.0 | 14 Feb 24 04:04 UTC | 14 Feb 24 04:04 UTC |
| start | -p auto-528898 --memory=3072 | auto-528898 | jenkins | v1.32.0 | 14 Feb 24 04:04 UTC | |
| | --alsologtostderr --wait=true | | | | | |
| | --wait-timeout=15m | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | cert-options-608119 ssh | cert-options-608119 | jenkins | v1.32.0 | 14 Feb 24 04:05 UTC | 14 Feb 24 04:05 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-608119 -- sudo | cert-options-608119 | jenkins | v1.32.0 | 14 Feb 24 04:05 UTC | 14 Feb 24 04:05 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-608119 | cert-options-608119 | jenkins | v1.32.0 | 14 Feb 24 04:05 UTC | 14 Feb 24 04:05 UTC |
| start | -p kindnet-528898 | kindnet-528898 | jenkins | v1.32.0 | 14 Feb 24 04:05 UTC | |
| | --memory=3072 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --wait-timeout=15m | | | | | |
| | --cni=kindnet --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| start | -p pause-951466 | pause-951466 | jenkins | v1.32.0 | 14 Feb 24 04:06 UTC | 14 Feb 24 04:07 UTC |
| | --alsologtostderr | | | | | |
| | -v=1 --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
|---------|----------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:06:20
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:06:20.330928 1534061 out.go:291] Setting OutFile to fd 1 ...
I0214 04:06:20.331121 1534061 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:06:20.331133 1534061 out.go:304] Setting ErrFile to fd 2...
I0214 04:06:20.331141 1534061 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:06:20.331376 1534061 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:06:20.332001 1534061 out.go:298] Setting JSON to false
I0214 04:06:20.333136 1534061 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":24528,"bootTime":1707859053,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:06:20.333207 1534061 start.go:138] virtualization: kvm guest
I0214 04:06:20.336257 1534061 out.go:177] * [pause-951466] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:06:20.338709 1534061 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:06:20.340556 1534061 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:06:20.338777 1534061 notify.go:220] Checking for updates...
I0214 04:06:20.342742 1534061 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:06:20.344624 1534061 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:06:20.346217 1534061 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:06:20.347884 1534061 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:06:20.349987 1534061 config.go:182] Loaded profile config "pause-951466": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:20.350430 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:20.350480 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:20.366550 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37031
I0214 04:06:20.367007 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:20.367698 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:20.367741 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:20.368149 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:20.368447 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:20.368743 1534061 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:06:20.369125 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:20.369165 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:20.386115 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39873
I0214 04:06:20.386586 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:20.387065 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:20.387089 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:20.387561 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:20.387817 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:20.427116 1534061 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:06:20.428965 1534061 start.go:296] selected driver: kvm2
I0214 04:06:20.428987 1534061 start.go:900] validating driver "kvm2" against &{Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernetes
Version:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-devi
ce-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:20.429122 1534061 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:06:20.429579 1534061 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:06:20.429673 1534061 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:06:20.446377 1534061 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:06:20.447383 1534061 cni.go:84] Creating CNI manager for ""
I0214 04:06:20.447406 1534061 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:06:20.447466 1534061 start.go:339] cluster config:
{Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:f
alse registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:20.447594 1534061 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:06:20.450645 1534061 out.go:177] * Starting "pause-951466" primary control-plane node in "pause-951466" cluster
I0214 04:06:21.485191 1532906 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:06:21.485277 1532906 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:06:21.485374 1532906 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:06:21.485502 1532906 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:06:21.485656 1532906 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:06:21.485743 1532906 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:06:21.488264 1532906 out.go:204] - Generating certificates and keys ...
I0214 04:06:21.488354 1532906 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:06:21.488414 1532906 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:06:21.488501 1532906 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 04:06:21.488572 1532906 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 04:06:21.488632 1532906 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 04:06:21.488677 1532906 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 04:06:21.488728 1532906 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 04:06:21.488901 1532906 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [auto-528898 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]
I0214 04:06:21.488983 1532906 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 04:06:21.489145 1532906 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [auto-528898 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]
I0214 04:06:21.489245 1532906 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 04:06:21.489350 1532906 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 04:06:21.489413 1532906 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 04:06:21.489486 1532906 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:06:21.489568 1532906 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:06:21.489633 1532906 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:06:21.489720 1532906 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:06:21.489788 1532906 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:06:21.489937 1532906 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:06:21.490039 1532906 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:06:21.492317 1532906 out.go:204] - Booting up control plane ...
I0214 04:06:21.492468 1532906 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:06:21.492571 1532906 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:06:21.492661 1532906 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:06:21.492786 1532906 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:06:21.492891 1532906 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:06:21.492953 1532906 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:06:21.493123 1532906 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:06:21.493224 1532906 kubeadm.go:309] [apiclient] All control plane components are healthy after 9.003624 seconds
I0214 04:06:21.493446 1532906 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:06:21.493602 1532906 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:06:21.493684 1532906 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:06:21.493896 1532906 kubeadm.go:309] [mark-control-plane] Marking the node auto-528898 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:06:21.493974 1532906 kubeadm.go:309] [bootstrap-token] Using token: s01oco.kf9k0ytczi4mlk4k
I0214 04:06:21.496104 1532906 out.go:204] - Configuring RBAC rules ...
I0214 04:06:21.496256 1532906 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:06:21.496332 1532906 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:06:21.496463 1532906 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:06:21.496574 1532906 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:06:21.496702 1532906 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:06:21.496822 1532906 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:06:21.496958 1532906 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:06:21.497002 1532906 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:06:21.497040 1532906 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:06:21.497050 1532906 kubeadm.go:309]
I0214 04:06:21.497106 1532906 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:06:21.497112 1532906 kubeadm.go:309]
I0214 04:06:21.497172 1532906 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:06:21.497177 1532906 kubeadm.go:309]
I0214 04:06:21.497203 1532906 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:06:21.497272 1532906 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:06:21.497338 1532906 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:06:21.497347 1532906 kubeadm.go:309]
I0214 04:06:21.497433 1532906 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:06:21.497458 1532906 kubeadm.go:309]
I0214 04:06:21.497524 1532906 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:06:21.497533 1532906 kubeadm.go:309]
I0214 04:06:21.497584 1532906 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:06:21.497707 1532906 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:06:21.497818 1532906 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:06:21.497832 1532906 kubeadm.go:309]
I0214 04:06:21.497919 1532906 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:06:21.498034 1532906 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:06:21.498046 1532906 kubeadm.go:309]
I0214 04:06:21.498173 1532906 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token s01oco.kf9k0ytczi4mlk4k \
I0214 04:06:21.498318 1532906 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:06:21.498348 1532906 kubeadm.go:309] --control-plane
I0214 04:06:21.498353 1532906 kubeadm.go:309]
I0214 04:06:21.498485 1532906 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:06:21.498509 1532906 kubeadm.go:309]
I0214 04:06:21.498608 1532906 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token s01oco.kf9k0ytczi4mlk4k \
I0214 04:06:21.498740 1532906 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:06:21.498771 1532906 cni.go:84] Creating CNI manager for ""
I0214 04:06:21.498781 1532906 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:06:21.500726 1532906 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:06:17.382309 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:17.382926 1533329 main.go:141] libmachine: (kindnet-528898) DBG | unable to find current IP address of domain kindnet-528898 in network mk-kindnet-528898
I0214 04:06:17.382962 1533329 main.go:141] libmachine: (kindnet-528898) DBG | I0214 04:06:17.382860 1533864 retry.go:31] will retry after 4.954861712s: waiting for machine to come up
I0214 04:06:20.452279 1534061 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:06:20.452324 1534061 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 04:06:20.452333 1534061 cache.go:56] Caching tarball of preloaded images
I0214 04:06:20.452419 1534061 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:06:20.452431 1534061 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 04:06:20.452550 1534061 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/config.json ...
I0214 04:06:20.452782 1534061 start.go:360] acquireMachinesLock for pause-951466: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:06:24.431367 1534061 start.go:364] duration metric: took 3.97853049s to acquireMachinesLock for "pause-951466"
I0214 04:06:24.431425 1534061 start.go:96] Skipping create...Using existing machine configuration
I0214 04:06:24.431436 1534061 fix.go:54] fixHost starting:
I0214 04:06:24.431861 1534061 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:24.431926 1534061 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:24.451671 1534061 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37513
I0214 04:06:24.452324 1534061 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:24.452961 1534061 main.go:141] libmachine: Using API Version 1
I0214 04:06:24.453007 1534061 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:24.453445 1534061 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:24.453664 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:24.453857 1534061 main.go:141] libmachine: (pause-951466) Calling .GetState
I0214 04:06:24.456099 1534061 fix.go:112] recreateIfNeeded on pause-951466: state=Running err=<nil>
W0214 04:06:24.456121 1534061 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:06:24.458443 1534061 out.go:177] * Updating the running kvm2 "pause-951466" VM ...
I0214 04:06:24.459949 1534061 machine.go:94] provisionDockerMachine start ...
I0214 04:06:24.459977 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:24.460199 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.463941 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.464427 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.464452 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.464630 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.464836 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.465023 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.465145 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.465384 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.465818 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.465830 1534061 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:06:24.622572 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: pause-951466
I0214 04:06:24.622610 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.622913 1534061 buildroot.go:166] provisioning hostname "pause-951466"
I0214 04:06:24.622935 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.623172 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.626341 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.626777 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.626812 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.627148 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.627345 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.627539 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.627726 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.627916 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.628325 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.628343 1534061 main.go:141] libmachine: About to run SSH command:
sudo hostname pause-951466 && echo "pause-951466" | sudo tee /etc/hostname
I0214 04:06:24.781533 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: pause-951466
I0214 04:06:24.781562 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.784672 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.785015 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.785046 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.785293 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:24.785506 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.785698 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:24.785936 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:24.786120 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.786439 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:24.786456 1534061 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\spause-951466' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 pause-951466/g' /etc/hosts;
else
echo '127.0.1.1 pause-951466' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:06:24.934977 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:06:24.935015 1534061 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:06:24.935039 1534061 buildroot.go:174] setting up certificates
I0214 04:06:24.935059 1534061 provision.go:84] configureAuth start
I0214 04:06:24.935077 1534061 main.go:141] libmachine: (pause-951466) Calling .GetMachineName
I0214 04:06:24.935450 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:24.939113 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.939629 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.939674 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.939787 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:24.942868 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.943235 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:24.943265 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:24.943391 1534061 provision.go:143] copyHostCerts
I0214 04:06:24.943462 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:06:24.943477 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:06:24.943548 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:06:24.943691 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:06:24.943705 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:06:24.943741 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:06:24.943856 1534061 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:06:24.943870 1534061 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:06:24.943901 1534061 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:06:24.943974 1534061 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.pause-951466 san=[127.0.0.1 192.168.61.64 localhost minikube pause-951466]
I0214 04:06:25.302868 1534061 provision.go:177] copyRemoteCerts
I0214 04:06:25.302952 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:06:25.302984 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:25.306056 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.306463 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:25.306509 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.306627 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:25.306865 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.307076 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:25.307250 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:21.502499 1532906 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:06:21.534870 1532906 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:06:21.574171 1532906 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:06:21.574283 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:21.574303 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes auto-528898 minikube.k8s.io/updated_at=2024_02_14T04_06_21_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=auto-528898 minikube.k8s.io/primary=true
I0214 04:06:21.856318 1532906 ops.go:34] apiserver oom_adj: -16
I0214 04:06:21.856401 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:22.356817 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:22.857400 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:23.356397 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:23.857419 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:24.356856 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:24.856668 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:25.357312 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:22.339421 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.339970 1533329 main.go:141] libmachine: (kindnet-528898) Found IP for machine: 192.168.72.93
I0214 04:06:22.339993 1533329 main.go:141] libmachine: (kindnet-528898) Reserving static IP address...
I0214 04:06:22.340004 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has current primary IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.340430 1533329 main.go:141] libmachine: (kindnet-528898) DBG | unable to find host DHCP lease matching {name: "kindnet-528898", mac: "52:54:00:f3:57:4d", ip: "192.168.72.93"} in network mk-kindnet-528898
I0214 04:06:22.430708 1533329 main.go:141] libmachine: (kindnet-528898) Reserved static IP address: 192.168.72.93
I0214 04:06:22.430747 1533329 main.go:141] libmachine: (kindnet-528898) Waiting for SSH to be available...
I0214 04:06:22.430757 1533329 main.go:141] libmachine: (kindnet-528898) DBG | Getting to WaitForSSH function...
I0214 04:06:22.434242 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.434740 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:minikube Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.434777 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.434988 1533329 main.go:141] libmachine: (kindnet-528898) DBG | Using SSH client type: external
I0214 04:06:22.435020 1533329 main.go:141] libmachine: (kindnet-528898) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa (-rw-------)
I0214 04:06:22.435069 1533329 main.go:141] libmachine: (kindnet-528898) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.93 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:06:22.435093 1533329 main.go:141] libmachine: (kindnet-528898) DBG | About to run SSH command:
I0214 04:06:22.435107 1533329 main.go:141] libmachine: (kindnet-528898) DBG | exit 0
I0214 04:06:22.541853 1533329 main.go:141] libmachine: (kindnet-528898) DBG | SSH cmd err, output: <nil>:
I0214 04:06:22.542229 1533329 main.go:141] libmachine: (kindnet-528898) KVM machine creation complete!
I0214 04:06:22.542582 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetConfigRaw
I0214 04:06:22.543269 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:22.543507 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:22.543805 1533329 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 04:06:22.543824 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetState
I0214 04:06:22.545572 1533329 main.go:141] libmachine: Detecting operating system of created instance...
I0214 04:06:22.545604 1533329 main.go:141] libmachine: Waiting for SSH to be available...
I0214 04:06:22.545624 1533329 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 04:06:22.545639 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:22.548276 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.548722 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.548756 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.548987 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:22.549293 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.549538 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.549758 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:22.550001 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:22.550495 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:22.550513 1533329 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 04:06:22.689636 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:06:22.689677 1533329 main.go:141] libmachine: Detecting the provisioner...
I0214 04:06:22.689688 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:22.693624 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.694211 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.694252 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.694436 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:22.694723 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.695045 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.695252 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:22.695559 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:22.696061 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:22.696085 1533329 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 04:06:22.835117 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 04:06:22.835238 1533329 main.go:141] libmachine: found compatible host: buildroot
I0214 04:06:22.835251 1533329 main.go:141] libmachine: Provisioning with buildroot...
I0214 04:06:22.835260 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetMachineName
I0214 04:06:22.835610 1533329 buildroot.go:166] provisioning hostname "kindnet-528898"
I0214 04:06:22.835647 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetMachineName
I0214 04:06:22.835893 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:22.839446 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.839910 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.839969 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.840148 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:22.840403 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.840650 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.840837 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:22.841040 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:22.841459 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:22.841486 1533329 main.go:141] libmachine: About to run SSH command:
sudo hostname kindnet-528898 && echo "kindnet-528898" | sudo tee /etc/hostname
I0214 04:06:22.992095 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>: kindnet-528898
I0214 04:06:22.992138 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:22.995113 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.995474 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:22.995508 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:22.995643 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:22.995841 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.996045 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:22.996216 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:22.996434 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:22.996752 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:22.996775 1533329 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\skindnet-528898' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kindnet-528898/g' /etc/hosts;
else
echo '127.0.1.1 kindnet-528898' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:06:23.143023 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:06:23.143055 1533329 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:06:23.143099 1533329 buildroot.go:174] setting up certificates
I0214 04:06:23.143118 1533329 provision.go:84] configureAuth start
I0214 04:06:23.143137 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetMachineName
I0214 04:06:23.143442 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetIP
I0214 04:06:23.146449 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.146817 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:23.146837 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.147083 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:23.149775 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.150184 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:23.150224 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.150386 1533329 provision.go:143] copyHostCerts
I0214 04:06:23.150474 1533329 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:06:23.150486 1533329 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:06:23.150539 1533329 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:06:23.150674 1533329 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:06:23.150684 1533329 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:06:23.150706 1533329 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:06:23.150759 1533329 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:06:23.150766 1533329 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:06:23.150782 1533329 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:06:23.150830 1533329 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.kindnet-528898 san=[127.0.0.1 192.168.72.93 kindnet-528898 localhost minikube]
I0214 04:06:23.618253 1533329 provision.go:177] copyRemoteCerts
I0214 04:06:23.618352 1533329 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:06:23.618443 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:23.621899 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.622334 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:23.622376 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.622647 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:23.622932 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:23.623140 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:23.623301 1533329 sshutil.go:53] new ssh client: &{IP:192.168.72.93 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa Username:docker}
I0214 04:06:23.719156 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:06:23.745600 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:06:23.770852 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1212 bytes)
I0214 04:06:23.795721 1533329 provision.go:87] duration metric: took 652.580449ms to configureAuth
I0214 04:06:23.795757 1533329 buildroot.go:189] setting minikube options for container-runtime
I0214 04:06:23.795958 1533329 config.go:182] Loaded profile config "kindnet-528898": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:23.796104 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:23.799434 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.799870 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:23.799904 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:23.800070 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:23.800299 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:23.800527 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:23.800665 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:23.800864 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:23.801207 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:23.801222 1533329 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:06:24.142015 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:06:24.142054 1533329 main.go:141] libmachine: Checking connection to Docker...
I0214 04:06:24.142067 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetURL
I0214 04:06:24.143648 1533329 main.go:141] libmachine: (kindnet-528898) DBG | Using libvirt version 6000000
I0214 04:06:24.146154 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.146564 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.146595 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.146777 1533329 main.go:141] libmachine: Docker is up and running!
I0214 04:06:24.146860 1533329 main.go:141] libmachine: Reticulating splines...
I0214 04:06:24.146872 1533329 client.go:171] duration metric: took 25.59036891s to LocalClient.Create
I0214 04:06:24.146902 1533329 start.go:167] duration metric: took 25.590464973s to libmachine.API.Create "kindnet-528898"
I0214 04:06:24.146914 1533329 start.go:293] postStartSetup for "kindnet-528898" (driver="kvm2")
I0214 04:06:24.146930 1533329 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:06:24.146955 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.147217 1533329 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:06:24.147246 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:24.150202 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.150731 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.150764 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.150946 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:24.151149 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.151334 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:24.151513 1533329 sshutil.go:53] new ssh client: &{IP:192.168.72.93 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa Username:docker}
I0214 04:06:24.247458 1533329 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:06:24.251943 1533329 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:06:24.251976 1533329 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:06:24.252055 1533329 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:06:24.252150 1533329 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:06:24.252282 1533329 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:06:24.262141 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:24.286703 1533329 start.go:296] duration metric: took 139.770959ms for postStartSetup
I0214 04:06:24.286780 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetConfigRaw
I0214 04:06:24.287480 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetIP
I0214 04:06:24.290700 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.291237 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.291273 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.291558 1533329 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/config.json ...
I0214 04:06:24.291960 1533329 start.go:128] duration metric: took 25.761131671s to createHost
I0214 04:06:24.292001 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:24.294402 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.294727 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.294749 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.294919 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:24.295137 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.295319 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.295495 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:24.295690 1533329 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:24.296035 1533329 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.93 22 <nil> <nil>}
I0214 04:06:24.296048 1533329 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:06:24.431171 1533329 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707883584.405554710
I0214 04:06:24.431198 1533329 fix.go:216] guest clock: 1707883584.405554710
I0214 04:06:24.431205 1533329 fix.go:229] Guest: 2024-02-14 04:06:24.40555471 +0000 UTC Remote: 2024-02-14 04:06:24.291979137 +0000 UTC m=+82.243775021 (delta=113.575573ms)
I0214 04:06:24.431231 1533329 fix.go:200] guest clock delta is within tolerance: 113.575573ms
I0214 04:06:24.431240 1533329 start.go:83] releasing machines lock for "kindnet-528898", held for 25.900642372s
I0214 04:06:24.431271 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.431602 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetIP
I0214 04:06:24.435080 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.435569 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.435607 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.435753 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.436481 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.436773 1533329 main.go:141] libmachine: (kindnet-528898) Calling .DriverName
I0214 04:06:24.436877 1533329 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:06:24.436924 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:24.437049 1533329 ssh_runner.go:195] Run: cat /version.json
I0214 04:06:24.437078 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHHostname
I0214 04:06:24.440281 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.440319 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.440803 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.440870 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.440939 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:24.440963 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:24.441133 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:24.441244 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHPort
I0214 04:06:24.441340 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.441398 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHKeyPath
I0214 04:06:24.441573 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:24.441586 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetSSHUsername
I0214 04:06:24.441764 1533329 sshutil.go:53] new ssh client: &{IP:192.168.72.93 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa Username:docker}
I0214 04:06:24.441767 1533329 sshutil.go:53] new ssh client: &{IP:192.168.72.93 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/kindnet-528898/id_rsa Username:docker}
I0214 04:06:24.565575 1533329 ssh_runner.go:195] Run: systemctl --version
I0214 04:06:24.572252 1533329 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:06:24.737547 1533329 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:06:24.744857 1533329 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:06:24.744963 1533329 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:06:24.761114 1533329 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:06:24.761147 1533329 start.go:494] detecting cgroup driver to use...
I0214 04:06:24.761228 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:06:24.777398 1533329 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:06:24.793731 1533329 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:06:24.793802 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:06:24.810242 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:06:24.827190 1533329 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:06:24.954044 1533329 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:06:25.092865 1533329 docker.go:233] disabling docker service ...
I0214 04:06:25.092954 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:06:25.106637 1533329 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:06:25.119104 1533329 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:06:25.241493 1533329 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:06:25.364208 1533329 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:06:25.379722 1533329 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:06:25.401299 1533329 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:06:25.401403 1533329 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:25.415183 1533329 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:06:25.415265 1533329 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:25.429390 1533329 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:25.443668 1533329 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:25.458139 1533329 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:06:25.471497 1533329 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:06:25.481903 1533329 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:06:25.481975 1533329 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:06:25.500396 1533329 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:06:25.512516 1533329 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:25.641000 1533329 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:06:25.843029 1533329 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:06:25.843109 1533329 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:06:25.848353 1533329 start.go:562] Will wait 60s for crictl version
I0214 04:06:25.848428 1533329 ssh_runner.go:195] Run: which crictl
I0214 04:06:25.854048 1533329 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:06:25.895221 1533329 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:06:25.895339 1533329 ssh_runner.go:195] Run: crio --version
I0214 04:06:25.948807 1533329 ssh_runner.go:195] Run: crio --version
I0214 04:06:26.008393 1533329 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:06:26.009943 1533329 main.go:141] libmachine: (kindnet-528898) Calling .GetIP
I0214 04:06:26.012704 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:26.013036 1533329 main.go:141] libmachine: (kindnet-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:57:4d", ip: ""} in network mk-kindnet-528898: {Iface:virbr4 ExpiryTime:2024-02-14 05:06:15 +0000 UTC Type:0 Mac:52:54:00:f3:57:4d Iaid: IPaddr:192.168.72.93 Prefix:24 Hostname:kindnet-528898 Clientid:01:52:54:00:f3:57:4d}
I0214 04:06:26.013106 1533329 main.go:141] libmachine: (kindnet-528898) DBG | domain kindnet-528898 has defined IP address 192.168.72.93 and MAC address 52:54:00:f3:57:4d in network mk-kindnet-528898
I0214 04:06:26.013308 1533329 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:06:26.017686 1533329 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:06:26.031065 1533329 kubeadm.go:877] updating cluster {Name:kindnet-528898 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:kindnet-528898 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.72.93 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort
:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:06:26.031181 1533329 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:06:26.031226 1533329 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:26.066172 1533329 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:06:26.066246 1533329 ssh_runner.go:195] Run: which lz4
I0214 04:06:26.070545 1533329 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:06:26.075017 1533329 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:06:26.075060 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:06:25.405339 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1204 bytes)
I0214 04:06:25.433511 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:06:25.461693 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:06:25.493110 1534061 provision.go:87] duration metric: took 558.034007ms to configureAuth
I0214 04:06:25.493137 1534061 buildroot.go:189] setting minikube options for container-runtime
I0214 04:06:25.493373 1534061 config.go:182] Loaded profile config "pause-951466": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:25.493451 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:25.496797 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.497375 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:25.497407 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:25.497653 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:25.497927 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.498130 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:25.498333 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:25.498576 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:25.499104 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:25.499131 1534061 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:06:25.857138 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:26.356520 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:26.857325 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:27.356889 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:27.856677 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:28.357411 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:28.856618 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:29.356437 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:29.856925 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:30.356619 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:28.055413 1533329 crio.go:444] duration metric: took 1.98490759s to copy over tarball
I0214 04:06:28.055525 1533329 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:06:31.656499 1533329 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.60092179s)
I0214 04:06:31.656548 1533329 crio.go:451] duration metric: took 3.601098567s to extract the tarball
I0214 04:06:31.656568 1533329 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:06:31.700806 1533329 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:31.780332 1533329 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:06:31.780364 1533329 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:06:31.780376 1533329 kubeadm.go:928] updating node { 192.168.72.93 8443 v1.28.4 crio true true} ...
I0214 04:06:31.780509 1533329 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=kindnet-528898 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.72.93
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:kindnet-528898 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet}
I0214 04:06:31.780582 1533329 ssh_runner.go:195] Run: crio config
I0214 04:06:31.844395 1533329 cni.go:84] Creating CNI manager for "kindnet"
I0214 04:06:31.844440 1533329 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:06:31.844464 1533329 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.93 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kindnet-528898 NodeName:kindnet-528898 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.93"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.93 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku
bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:06:31.844633 1533329 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.93
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "kindnet-528898"
kubeletExtraArgs:
node-ip: 192.168.72.93
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.93"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:06:31.844720 1533329 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:06:31.854342 1533329 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:06:31.854435 1533329 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:06:31.863616 1533329 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)
I0214 04:06:31.883185 1533329 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:06:31.899933 1533329 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2155 bytes)
I0214 04:06:31.916821 1533329 ssh_runner.go:195] Run: grep 192.168.72.93 control-plane.minikube.internal$ /etc/hosts
I0214 04:06:31.921887 1533329 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.93 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:06:31.935493 1533329 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:32.041903 1533329 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:06:32.058238 1533329 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898 for IP: 192.168.72.93
I0214 04:06:32.058271 1533329 certs.go:194] generating shared ca certs ...
I0214 04:06:32.058294 1533329 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.058520 1533329 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:06:32.058585 1533329 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:06:32.058600 1533329 certs.go:256] generating profile certs ...
I0214 04:06:32.058678 1533329 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.key
I0214 04:06:32.058711 1533329 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt with IP's: []
I0214 04:06:32.483554 1533329 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt ...
I0214 04:06:32.483597 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: {Name:mkf53b2185a8d5121331af016cdb5f39c378a011 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.483810 1533329 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.key ...
I0214 04:06:32.483845 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.key: {Name:mka2e54089d3d71a6962795ae919d43ae34b658b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.483988 1533329 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key.1b800f55
I0214 04:06:32.484011 1533329 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt.1b800f55 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.93]
I0214 04:06:32.613618 1533329 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt.1b800f55 ...
I0214 04:06:32.613664 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt.1b800f55: {Name:mk328710241c94e67af0973b62221efd52805739 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.613911 1533329 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key.1b800f55 ...
I0214 04:06:32.613942 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key.1b800f55: {Name:mk7be1f5648188f4cafbf35491bf27fd8dc94ce9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.614087 1533329 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt.1b800f55 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt
I0214 04:06:32.614217 1533329 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key.1b800f55 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key
I0214 04:06:32.614314 1533329 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.key
I0214 04:06:32.614340 1533329 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.crt with IP's: []
I0214 04:06:32.772862 1533329 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.crt ...
I0214 04:06:32.772906 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.crt: {Name:mkb2eea88cd2510cf54af217ebf0d07e0167a618 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.773082 1533329 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.key ...
I0214 04:06:32.773095 1533329 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.key: {Name:mkc1d314795c1d5dfdcb592ae9736aa69a3d8a0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:32.773293 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:06:32.773345 1533329 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:06:32.773356 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:06:32.773384 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:06:32.773407 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:06:32.773430 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:06:32.773468 1533329 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:32.774199 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:06:32.804374 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:06:32.830523 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:06:32.855621 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:06:32.883437 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0214 04:06:32.923244 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:06:32.946981 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:06:32.972836 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:06:32.996639 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:06:33.019273 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:06:33.045545 1533329 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:06:33.070754 1533329 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:06:33.087306 1533329 ssh_runner.go:195] Run: openssl version
I0214 04:06:33.093785 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:06:33.104120 1533329 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:33.109612 1533329 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:33.109690 1533329 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:33.116962 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:06:33.127325 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:06:33.137862 1533329 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:06:33.143172 1533329 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:06:33.143249 1533329 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:06:33.149608 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:06:33.163734 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:06:33.177962 1533329 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:06:33.184559 1533329 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:06:33.184652 1533329 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:06:33.191261 1533329 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:06:33.202675 1533329 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:06:33.207338 1533329 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 04:06:33.207426 1533329 kubeadm.go:391] StartCluster: {Name:kindnet-528898 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4
ClusterName:kindnet-528898 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.72.93 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:33.207510 1533329 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:06:33.207563 1533329 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:06:33.252827 1533329 cri.go:89] found id: ""
I0214 04:06:33.252917 1533329 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0214 04:06:33.263638 1533329 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:06:33.273835 1533329 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:06:33.284143 1533329 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:06:33.284175 1533329 kubeadm.go:156] found existing configuration files:
I0214 04:06:33.284234 1533329 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:06:33.293087 1533329 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:06:33.293170 1533329 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:06:33.303595 1533329 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:06:33.312568 1533329 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:06:33.312639 1533329 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:06:33.322401 1533329 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:06:33.331506 1533329 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:06:33.331568 1533329 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:06:33.340740 1533329 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:06:33.349379 1533329 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:06:33.349457 1533329 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:06:33.358825 1533329 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:06:33.424899 1533329 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:06:33.425150 1533329 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:06:33.593958 1533329 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:06:33.594107 1533329 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:06:33.594239 1533329 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:06:33.948455 1533329 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:06:30.857329 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:31.356992 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:31.857071 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:32.357172 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:32.856868 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:33.356862 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:33.857436 1532906 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:06:33.982321 1532906 kubeadm.go:1106] duration metric: took 12.408120233s to wait for elevateKubeSystemPrivileges
W0214 04:06:33.982377 1532906 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:06:33.982386 1532906 kubeadm.go:393] duration metric: took 26.281511703s to StartCluster
I0214 04:06:33.982411 1532906 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:33.982525 1532906 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:06:33.984331 1532906 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:33.984621 1532906 start.go:234] Will wait 15m0s for node &{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:06:33.986659 1532906 out.go:177] * Verifying Kubernetes components...
I0214 04:06:33.984771 1532906 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0214 04:06:33.984791 1532906 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:06:33.984979 1532906 config.go:182] Loaded profile config "auto-528898": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:06:33.988430 1532906 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:33.988455 1532906 addons.go:69] Setting storage-provisioner=true in profile "auto-528898"
I0214 04:06:33.988481 1532906 addons.go:69] Setting default-storageclass=true in profile "auto-528898"
I0214 04:06:33.988491 1532906 addons.go:234] Setting addon storage-provisioner=true in "auto-528898"
I0214 04:06:33.988529 1532906 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "auto-528898"
I0214 04:06:33.988532 1532906 host.go:66] Checking if "auto-528898" exists ...
I0214 04:06:33.989009 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:33.989070 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:33.989009 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:33.989136 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:34.009394 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42191
I0214 04:06:34.010113 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.010824 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.010860 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.011285 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.011996 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:34.012028 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:34.019526 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45777
I0214 04:06:34.021643 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.022173 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.022195 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.022591 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.022754 1532906 main.go:141] libmachine: (auto-528898) Calling .GetState
I0214 04:06:34.027112 1532906 addons.go:234] Setting addon default-storageclass=true in "auto-528898"
I0214 04:06:34.027161 1532906 host.go:66] Checking if "auto-528898" exists ...
I0214 04:06:34.027543 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:34.027581 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:34.032943 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35053
I0214 04:06:34.033454 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.033921 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.033941 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.034283 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.034521 1532906 main.go:141] libmachine: (auto-528898) Calling .GetState
I0214 04:06:34.036889 1532906 main.go:141] libmachine: (auto-528898) Calling .DriverName
I0214 04:06:34.038733 1532906 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:06:33.677212 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:06:33.677245 1534061 machine.go:97] duration metric: took 9.217278338s to provisionDockerMachine
I0214 04:06:33.677285 1534061 start.go:293] postStartSetup for "pause-951466" (driver="kvm2")
I0214 04:06:33.677301 1534061 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:06:33.677337 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:33.677841 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:06:33.677875 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:33.681031 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.681474 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:33.681496 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.681701 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:33.681919 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.682089 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:33.682240 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:33.793747 1534061 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:06:33.800325 1534061 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:06:33.800365 1534061 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:06:33.800456 1534061 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:06:33.800568 1534061 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:06:33.800703 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:06:33.811682 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:33.843858 1534061 start.go:296] duration metric: took 166.55133ms for postStartSetup
I0214 04:06:33.843943 1534061 fix.go:56] duration metric: took 9.412506338s for fixHost
I0214 04:06:33.843979 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:33.847119 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.847464 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:33.847492 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:33.847737 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:33.848010 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.848232 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:33.848410 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:33.848668 1534061 main.go:141] libmachine: Using SSH client type: native
I0214 04:06:33.849078 1534061 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.64 22 <nil> <nil>}
I0214 04:06:33.849092 1534061 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:06:34.064366 1534061 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707883594.058978164
I0214 04:06:34.064394 1534061 fix.go:216] guest clock: 1707883594.058978164
I0214 04:06:34.064405 1534061 fix.go:229] Guest: 2024-02-14 04:06:34.058978164 +0000 UTC Remote: 2024-02-14 04:06:33.843953524 +0000 UTC m=+13.569509178 (delta=215.02464ms)
I0214 04:06:34.064451 1534061 fix.go:200] guest clock delta is within tolerance: 215.02464ms
I0214 04:06:34.064458 1534061 start.go:83] releasing machines lock for "pause-951466", held for 9.633059332s
I0214 04:06:34.064493 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.065564 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:34.068871 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.069637 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.069684 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.069713 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.077958 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.078230 1534061 main.go:141] libmachine: (pause-951466) Calling .DriverName
I0214 04:06:34.078337 1534061 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:06:34.078380 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:34.078943 1534061 ssh_runner.go:195] Run: cat /version.json
I0214 04:06:34.078973 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHHostname
I0214 04:06:34.082130 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.082908 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.082941 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.083366 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:34.083579 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:34.083645 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.083916 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:34.084082 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:34.084386 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHPort
I0214 04:06:34.084202 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:34.084578 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:34.084620 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHKeyPath
I0214 04:06:34.084764 1534061 main.go:141] libmachine: (pause-951466) Calling .GetSSHUsername
I0214 04:06:34.084995 1534061 sshutil.go:53] new ssh client: &{IP:192.168.61.64 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/pause-951466/id_rsa Username:docker}
I0214 04:06:34.547561 1534061 ssh_runner.go:195] Run: systemctl --version
I0214 04:06:34.571488 1534061 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:06:34.795873 1534061 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:06:34.811478 1534061 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:06:34.811567 1534061 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:06:34.828664 1534061 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0214 04:06:34.828712 1534061 start.go:494] detecting cgroup driver to use...
I0214 04:06:34.828791 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:06:34.855603 1534061 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:06:34.877058 1534061 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:06:34.877139 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:06:34.900372 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:06:34.933782 1534061 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:06:34.040538 1532906 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:06:34.040558 1532906 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:06:34.040578 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHHostname
I0214 04:06:34.045561 1532906 main.go:141] libmachine: (auto-528898) DBG | domain auto-528898 has defined MAC address 52:54:00:5a:79:cd in network mk-auto-528898
I0214 04:06:34.046095 1532906 main.go:141] libmachine: (auto-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:79:cd", ip: ""} in network mk-auto-528898: {Iface:virbr3 ExpiryTime:2024-02-14 05:05:45 +0000 UTC Type:0 Mac:52:54:00:5a:79:cd Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:auto-528898 Clientid:01:52:54:00:5a:79:cd}
I0214 04:06:34.046115 1532906 main.go:141] libmachine: (auto-528898) DBG | domain auto-528898 has defined IP address 192.168.39.198 and MAC address 52:54:00:5a:79:cd in network mk-auto-528898
I0214 04:06:34.046281 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHPort
I0214 04:06:34.049455 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHKeyPath
I0214 04:06:34.049639 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHUsername
I0214 04:06:34.049788 1532906 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/auto-528898/id_rsa Username:docker}
I0214 04:06:34.051705 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36995
I0214 04:06:34.052140 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.052770 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.052792 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.053189 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.053800 1532906 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:06:34.053831 1532906 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:06:34.074280 1532906 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40821
I0214 04:06:34.074738 1532906 main.go:141] libmachine: () Calling .GetVersion
I0214 04:06:34.075335 1532906 main.go:141] libmachine: Using API Version 1
I0214 04:06:34.075364 1532906 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:06:34.075763 1532906 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:06:34.075977 1532906 main.go:141] libmachine: (auto-528898) Calling .GetState
I0214 04:06:34.077911 1532906 main.go:141] libmachine: (auto-528898) Calling .DriverName
I0214 04:06:34.078194 1532906 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:06:34.078210 1532906 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:06:34.078227 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHHostname
I0214 04:06:34.084002 1532906 main.go:141] libmachine: (auto-528898) DBG | domain auto-528898 has defined MAC address 52:54:00:5a:79:cd in network mk-auto-528898
I0214 04:06:34.084915 1532906 main.go:141] libmachine: (auto-528898) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5a:79:cd", ip: ""} in network mk-auto-528898: {Iface:virbr3 ExpiryTime:2024-02-14 05:05:45 +0000 UTC Type:0 Mac:52:54:00:5a:79:cd Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:auto-528898 Clientid:01:52:54:00:5a:79:cd}
I0214 04:06:34.084941 1532906 main.go:141] libmachine: (auto-528898) DBG | domain auto-528898 has defined IP address 192.168.39.198 and MAC address 52:54:00:5a:79:cd in network mk-auto-528898
I0214 04:06:34.084988 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHPort
I0214 04:06:34.085209 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHKeyPath
I0214 04:06:34.085431 1532906 main.go:141] libmachine: (auto-528898) Calling .GetSSHUsername
I0214 04:06:34.085655 1532906 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/auto-528898/id_rsa Username:docker}
I0214 04:06:34.383372 1532906 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:06:34.383675 1532906 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0214 04:06:34.396840 1532906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:06:34.536178 1532906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:06:36.580011 1532906 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.39.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.19629818s)
I0214 04:06:36.580057 1532906 start.go:948] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap
I0214 04:06:36.581884 1532906 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.198470993s)
I0214 04:06:36.583157 1532906 node_ready.go:35] waiting up to 15m0s for node "auto-528898" to be "Ready" ...
I0214 04:06:36.583387 1532906 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.186508399s)
I0214 04:06:36.583430 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.583445 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.583902 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.583922 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.583933 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.583943 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.584211 1532906 main.go:141] libmachine: (auto-528898) DBG | Closing plugin on server side
I0214 04:06:36.584251 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.584268 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.625425 1532906 node_ready.go:49] node "auto-528898" has status "Ready":"True"
I0214 04:06:36.625477 1532906 node_ready.go:38] duration metric: took 42.2894ms for node "auto-528898" to be "Ready" ...
I0214 04:06:36.625493 1532906 pod_ready.go:35] extra waiting up to 15m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:06:36.645816 1532906 pod_ready.go:78] waiting up to 15m0s for pod "coredns-5dd5756b68-64mjb" in "kube-system" namespace to be "Ready" ...
I0214 04:06:36.646401 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.646449 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.646965 1532906 main.go:141] libmachine: (auto-528898) DBG | Closing plugin on server side
I0214 04:06:36.647010 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.647025 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.846539 1532906 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.310304622s)
I0214 04:06:36.846692 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.846753 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.847141 1532906 main.go:141] libmachine: (auto-528898) DBG | Closing plugin on server side
I0214 04:06:36.847188 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.847218 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.847233 1532906 main.go:141] libmachine: Making call to close driver server
I0214 04:06:36.847247 1532906 main.go:141] libmachine: (auto-528898) Calling .Close
I0214 04:06:36.847538 1532906 main.go:141] libmachine: (auto-528898) DBG | Closing plugin on server side
I0214 04:06:36.847577 1532906 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:06:36.847588 1532906 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:06:36.850571 1532906 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I0214 04:06:33.952080 1533329 out.go:204] - Generating certificates and keys ...
I0214 04:06:33.952263 1533329 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:06:33.952362 1533329 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:06:34.047593 1533329 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 04:06:34.572559 1533329 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 04:06:34.708612 1533329 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 04:06:34.944353 1533329 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 04:06:35.290599 1533329 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 04:06:35.290997 1533329 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [kindnet-528898 localhost] and IPs [192.168.72.93 127.0.0.1 ::1]
I0214 04:06:35.369151 1533329 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 04:06:35.369471 1533329 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [kindnet-528898 localhost] and IPs [192.168.72.93 127.0.0.1 ::1]
I0214 04:06:35.513544 1533329 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 04:06:35.628451 1533329 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 04:06:35.818260 1533329 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 04:06:35.818575 1533329 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:06:36.007391 1533329 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:06:36.734485 1533329 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:06:36.881469 1533329 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:06:37.028140 1533329 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:06:37.028965 1533329 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:06:37.031784 1533329 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:06:37.033723 1533329 out.go:204] - Booting up control plane ...
I0214 04:06:37.033855 1533329 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:06:37.035511 1533329 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:06:37.036675 1533329 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:06:37.056578 1533329 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:06:37.056735 1533329 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:06:37.056820 1533329 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:06:35.378508 1534061 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:06:35.702727 1534061 docker.go:233] disabling docker service ...
I0214 04:06:35.702821 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:06:35.762944 1534061 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:06:35.805557 1534061 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:06:36.152685 1534061 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:06:36.459334 1534061 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:06:36.486614 1534061 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:06:36.538266 1534061 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:06:36.538353 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.560216 1534061 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:06:36.560356 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.608844 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.652421 1534061 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:06:36.675973 1534061 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:06:36.701752 1534061 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:06:36.723934 1534061 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:06:36.760530 1534061 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:37.142372 1534061 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:06:38.583626 1534061 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1.441206411s)
I0214 04:06:38.583665 1534061 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:06:38.583728 1534061 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:06:38.589300 1534061 start.go:562] Will wait 60s for crictl version
I0214 04:06:38.589374 1534061 ssh_runner.go:195] Run: which crictl
I0214 04:06:38.593346 1534061 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:06:38.636742 1534061 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:06:38.636864 1534061 ssh_runner.go:195] Run: crio --version
I0214 04:06:38.696074 1534061 ssh_runner.go:195] Run: crio --version
I0214 04:06:38.747754 1534061 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:06:38.749416 1534061 main.go:141] libmachine: (pause-951466) Calling .GetIP
I0214 04:06:38.752813 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:38.753183 1534061 main.go:141] libmachine: (pause-951466) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c9:02:55", ip: ""} in network mk-pause-951466: {Iface:virbr2 ExpiryTime:2024-02-14 05:04:53 +0000 UTC Type:0 Mac:52:54:00:c9:02:55 Iaid: IPaddr:192.168.61.64 Prefix:24 Hostname:pause-951466 Clientid:01:52:54:00:c9:02:55}
I0214 04:06:38.753208 1534061 main.go:141] libmachine: (pause-951466) DBG | domain pause-951466 has defined IP address 192.168.61.64 and MAC address 52:54:00:c9:02:55 in network mk-pause-951466
I0214 04:06:38.753470 1534061 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0214 04:06:38.759411 1534061 kubeadm.go:877] updating cluster {Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4
ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false
olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:06:38.759577 1534061 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:06:38.759646 1534061 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:38.821329 1534061 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:06:38.821375 1534061 crio.go:415] Images already preloaded, skipping extraction
I0214 04:06:38.821442 1534061 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:06:38.862076 1534061 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:06:38.862112 1534061 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:06:38.862128 1534061 kubeadm.go:928] updating node { 192.168.61.64 8443 v1.28.4 crio true true} ...
I0214 04:06:38.862277 1534061 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=pause-951466 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.64
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:06:38.862365 1534061 ssh_runner.go:195] Run: crio config
I0214 04:06:38.934373 1534061 cni.go:84] Creating CNI manager for ""
I0214 04:06:38.934408 1534061 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:06:38.934426 1534061 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:06:38.934465 1534061 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.64 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-951466 NodeName:pause-951466 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.64"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.64 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubern
etes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:06:38.934663 1534061 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.64
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "pause-951466"
kubeletExtraArgs:
node-ip: 192.168.61.64
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.64"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:06:38.934746 1534061 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:06:38.945954 1534061 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:06:38.946030 1534061 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:06:38.957200 1534061 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (311 bytes)
I0214 04:06:38.977693 1534061 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:06:38.995710 1534061 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)
I0214 04:06:39.016901 1534061 ssh_runner.go:195] Run: grep 192.168.61.64 control-plane.minikube.internal$ /etc/hosts
I0214 04:06:39.022519 1534061 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:06:39.500604 1534061 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:06:39.639408 1534061 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466 for IP: 192.168.61.64
I0214 04:06:39.639441 1534061 certs.go:194] generating shared ca certs ...
I0214 04:06:39.639475 1534061 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:06:39.639676 1534061 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:06:39.639749 1534061 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:06:39.639763 1534061 certs.go:256] generating profile certs ...
I0214 04:06:39.639895 1534061 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/client.key
I0214 04:06:39.639983 1534061 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.key.9654be93
I0214 04:06:39.640064 1534061 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.key
I0214 04:06:39.640224 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:06:39.640266 1534061 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:06:39.640279 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:06:39.640314 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:06:39.640346 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:06:39.640392 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:06:39.640455 1534061 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:06:39.641377 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:06:39.696825 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:06:39.746233 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:06:39.785132 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:06:39.827358 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0214 04:06:39.880076 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 04:06:39.920074 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:06:39.944377 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/pause-951466/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:06:39.972007 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:06:40.062131 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:06:40.125888 1534061 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:06:40.205494 1534061 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:06:40.237725 1534061 ssh_runner.go:195] Run: openssl version
I0214 04:06:40.257410 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:06:40.277411 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.285844 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.285927 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:06:40.297791 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:06:40.317947 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:06:36.852296 1532906 addons.go:505] duration metric: took 2.867518272s for enable addons: enabled=[default-storageclass storage-provisioner]
I0214 04:06:37.092267 1532906 kapi.go:248] "coredns" deployment in "kube-system" namespace and "auto-528898" context rescaled to 1 replicas
I0214 04:06:38.656383 1532906 pod_ready.go:102] pod "coredns-5dd5756b68-64mjb" in "kube-system" namespace has status "Ready":"False"
I0214 04:06:39.155202 1532906 pod_ready.go:92] pod "coredns-5dd5756b68-64mjb" in "kube-system" namespace has status "Ready":"True"
I0214 04:06:39.155234 1532906 pod_ready.go:81] duration metric: took 2.509321619s for pod "coredns-5dd5756b68-64mjb" in "kube-system" namespace to be "Ready" ...
I0214 04:06:39.155248 1532906 pod_ready.go:78] waiting up to 15m0s for pod "coredns-5dd5756b68-9jtk9" in "kube-system" namespace to be "Ready" ...
I0214 04:06:37.249804 1533329 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:06:40.339071 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.349634 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.349713 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:06:40.360896 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:06:40.378400 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:06:40.401064 1534061 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.410181 1534061 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.410258 1534061 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:06:40.421748 1534061 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:06:40.435327 1534061 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:06:40.451007 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:06:40.461126 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:06:40.472196 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:06:40.486842 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:06:40.499789 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:06:40.512866 1534061 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:06:40.527853 1534061 kubeadm.go:391] StartCluster: {Name:pause-951466 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 Cl
usterName:pause-951466 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.64 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false ol
m:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:06:40.528067 1534061 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:06:40.528148 1534061 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:06:40.604639 1534061 cri.go:89] found id: "ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7"
I0214 04:06:40.604671 1534061 cri.go:89] found id: "1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7"
I0214 04:06:40.604678 1534061 cri.go:89] found id: "cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b"
I0214 04:06:40.604685 1534061 cri.go:89] found id: "0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189"
I0214 04:06:40.604691 1534061 cri.go:89] found id: "3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5"
I0214 04:06:40.604697 1534061 cri.go:89] found id: "a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5"
I0214 04:06:40.604703 1534061 cri.go:89] found id: ""
I0214 04:06:40.604760 1534061 ssh_runner.go:195] Run: sudo runc list -f json
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:04:49 UTC, ends at Wed 2024-02-14 04:07:06 UTC. --
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.321849490Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=a89089f1-a170-42ba-8481-6f2297ea1b43 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.323156176Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=52cfef87-a8ac-438f-8946-e39c0588aaeb name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.323694025Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707883626323676507,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},}" file="go-grpc-middleware/chain.go:25" id=52cfef87-a8ac-438f-8946-e39c0588aaeb name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.324367005Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=9e411bed-d3bc-4640-b0fb-d3f6139cd4d2 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.324439043Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=9e411bed-d3bc-4640-b0fb-d3f6139cd4d2 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.324768223Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba,PodSandboxId:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707883609604748053,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePat
h: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014,PodSandboxId:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707883609580089528,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28,PodSandboxId:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707883603073325379,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:
map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724,PodSandboxId:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707883603061394627,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf184
6b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254,PodSandboxId:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb7530c3,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707883603012090131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotati
ons:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d,PodSandboxId:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707883600772799614,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]s
tring{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7,PodSandboxId:dd467bf0567b71627d2dc460f3b7f12f8a7d1c04b20d0dbd0fc81168941147c6,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707883596599341815,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 1,
io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7,PodSandboxId:770fbdf632a1d6c1a73c24acb0c61fc5c6c583371dbfdbad3438bf53bf49de51,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707883595761831063,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf1846b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.term
inationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b,PodSandboxId:55a06fc16b903b9f295e66491cbb864d43a7885b816aea2c7e571b816cd26775,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707883595547868840,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotations:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.
container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189,PodSandboxId:2b0e3228392a59920963e9f065ab2c7c14ebcb06fb6631f0bf9dbbdfc5f50021,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707883540682109734,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.termination
GracePeriod: 30,},},&Container{Id:3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5,PodSandboxId:32bbb4ebf19a698d3f9eae6d2c23b1b90a41b69f7dbbda731a861bc951b59a96,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707883540555644362,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCoun
t: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5,PodSandboxId:8c5ac1cacda530e913fcfdf329cc72f5fb7310d1059d262e9808a451a4b75d72,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707883516284052861,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=9e411bed-d3bc-4640-b0fb-d3f6139cd4d2 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.371446397Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=3899e3e4-64ea-4516-b852-90ba049f5eb6 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.371634861Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=3899e3e4-64ea-4516-b852-90ba049f5eb6 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.373873571Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=cf46ed0f-4eea-47e1-b1f9-f91fdb4b88ed name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.374447906Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707883626374423904,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},}" file="go-grpc-middleware/chain.go:25" id=cf46ed0f-4eea-47e1-b1f9-f91fdb4b88ed name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.375180601Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=2abad83c-4bdf-4cfb-a9e6-4c1c63c13a6c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.375369826Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=2abad83c-4bdf-4cfb-a9e6-4c1c63c13a6c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.375872713Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba,PodSandboxId:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707883609604748053,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePat
h: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014,PodSandboxId:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707883609580089528,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28,PodSandboxId:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707883603073325379,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:
map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724,PodSandboxId:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707883603061394627,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf184
6b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254,PodSandboxId:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb7530c3,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707883603012090131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotati
ons:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d,PodSandboxId:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707883600772799614,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]s
tring{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7,PodSandboxId:dd467bf0567b71627d2dc460f3b7f12f8a7d1c04b20d0dbd0fc81168941147c6,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707883596599341815,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 1,
io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7,PodSandboxId:770fbdf632a1d6c1a73c24acb0c61fc5c6c583371dbfdbad3438bf53bf49de51,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707883595761831063,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf1846b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.term
inationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b,PodSandboxId:55a06fc16b903b9f295e66491cbb864d43a7885b816aea2c7e571b816cd26775,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707883595547868840,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotations:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.
container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189,PodSandboxId:2b0e3228392a59920963e9f065ab2c7c14ebcb06fb6631f0bf9dbbdfc5f50021,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707883540682109734,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.termination
GracePeriod: 30,},},&Container{Id:3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5,PodSandboxId:32bbb4ebf19a698d3f9eae6d2c23b1b90a41b69f7dbbda731a861bc951b59a96,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707883540555644362,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCoun
t: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5,PodSandboxId:8c5ac1cacda530e913fcfdf329cc72f5fb7310d1059d262e9808a451a4b75d72,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707883516284052861,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=2abad83c-4bdf-4cfb-a9e6-4c1c63c13a6c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.381579790Z" level=debug msg="Request: &ListPodSandboxRequest{Filter:&PodSandboxFilter{Id:,State:&PodSandboxStateValue{State:SANDBOX_READY,},LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=56619d88-52f5-49fc-b498-780c84253e94 name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.381853019Z" level=debug msg="Response: &ListPodSandboxResponse{Items:[]*PodSandbox{&PodSandbox{Id:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-rsn2w,Uid:71d07922-2814-4eb9-94f9-c2c3f46066b2,Namespace:kube-system,Attempt:2,},State:SANDBOX_READY,CreatedAt:1707883599439041022,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T04:05:38.116660920Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&PodSandboxMetadata{Name:kube-proxy-lrmhp,Uid:fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,Namespace:kube-system,Attempt
:2,},State:SANDBOX_READY,CreatedAt:1707883599381655005,Labels:map[string]string{controller-revision-hash: 8486c7d9cd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,k8s-app: kube-proxy,pod-template-generation: 1,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T04:05:37.203354301Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&PodSandboxMetadata{Name:etcd-pause-951466,Uid:55e97bc5c96233f15e0b6045e4f64496,Namespace:kube-system,Attempt:2,},State:SANDBOX_READY,CreatedAt:1707883599341251465,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/
etcd.advertise-client-urls: https://192.168.61.64:2379,kubernetes.io/config.hash: 55e97bc5c96233f15e0b6045e4f64496,kubernetes.io/config.seen: 2024-02-14T04:05:24.404115516Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&PodSandboxMetadata{Name:kube-scheduler-pause-951466,Uid:51ba4add132a8dce72b04590ce7e7f72,Namespace:kube-system,Attempt:2,},State:SANDBOX_READY,CreatedAt:1707883599327214394,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 51ba4add132a8dce72b04590ce7e7f72,kubernetes.io/config.seen: 2024-02-14T04:05:24.404112377Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb753
0c3,Metadata:&PodSandboxMetadata{Name:kube-apiserver-pause-951466,Uid:9d1896b9a147ca1fd7c84296a6056d04,Namespace:kube-system,Attempt:2,},State:SANDBOX_READY,CreatedAt:1707883599248251548,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.61.64:8443,kubernetes.io/config.hash: 9d1896b9a147ca1fd7c84296a6056d04,kubernetes.io/config.seen: 2024-02-14T04:05:24.404116905Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&PodSandboxMetadata{Name:kube-controller-manager-pause-951466,Uid:2660231f5c1026249e2a53bf1846b196,Namespace:kube-system,Attempt:2,},State:SANDBOX_READY,CreatedAt:1707883599154244286,Labels:map[string]strin
g{component: kube-controller-manager,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf1846b196,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 2660231f5c1026249e2a53bf1846b196,kubernetes.io/config.seen: 2024-02-14T04:05:24.404117854Z,kubernetes.io/config.source: file,},RuntimeHandler:,},},}" file="go-grpc-middleware/chain.go:25" id=56619d88-52f5-49fc-b498-780c84253e94 name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.382838784Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:&ContainerStateValue{State:CONTAINER_RUNNING,},PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=d60c6656-4832-4174-8090-989d1ec3293d name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.382976679Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=d60c6656-4832-4174-8090-989d1ec3293d name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.383797574Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba,PodSandboxId:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707883609604748053,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePat
h: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014,PodSandboxId:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707883609580089528,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28,PodSandboxId:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707883603073325379,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:
map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724,PodSandboxId:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707883603061394627,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf184
6b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254,PodSandboxId:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb7530c3,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707883603012090131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotati
ons:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d,PodSandboxId:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707883600772799614,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]s
tring{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=d60c6656-4832-4174-8090-989d1ec3293d name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.426008360Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=2a9b3226-15ae-48af-9008-2ad9d686ef63 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.426168193Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=2a9b3226-15ae-48af-9008-2ad9d686ef63 name=/runtime.v1.RuntimeService/Version
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.428186911Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=dff7102a-30b4-4b7c-bd62-aca2666582bb name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.428910321Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707883626428885948,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},}" file="go-grpc-middleware/chain.go:25" id=dff7102a-30b4-4b7c-bd62-aca2666582bb name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.430176789Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=dff81407-6cf1-4c3d-8a99-10920a0dc46f name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.430267662Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=dff81407-6cf1-4c3d-8a99-10920a0dc46f name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:07:06 pause-951466 crio[2767]: time="2024-02-14 04:07:06.430809456Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba,PodSandboxId:56f8fa60100f46e01f310455dcf1790b43c827a43c09dffe0e5bfa4c94d913d7,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707883609604748053,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePat
h: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014,PodSandboxId:f66b83c6da2bda7e4519a7b77ea7c63d8ad29ac999ca883e997a6b345d82478b,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707883609580089528,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\
",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28,PodSandboxId:0be2dc2612651440277f7b225d8be8991d3725dd7b7497643cb4062da01d38da,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707883603073325379,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:
map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724,PodSandboxId:d3eefb9f4d69d8882dcb4c7316d3ab28f1b8c2bccb98208894b5c7903993f991,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707883603061394627,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf184
6b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254,PodSandboxId:4963f328b78caa42e7bc8b5a5e31faea215e9ea1ea5f59c139370427bb7530c3,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707883603012090131,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotati
ons:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d,PodSandboxId:336d83b5a0d66f510a9d89de5555e04d8dab2e9d8928a6e2eb3107c0f7bf1b18,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707883600772799614,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]s
tring{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7,PodSandboxId:dd467bf0567b71627d2dc460f3b7f12f8a7d1c04b20d0dbd0fc81168941147c6,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,State:CONTAINER_EXITED,CreatedAt:1707883596599341815,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 55e97bc5c96233f15e0b6045e4f64496,},Annotations:map[string]string{io.kubernetes.container.hash: ae77608b,io.kubernetes.container.restartCount: 1,
io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7,PodSandboxId:770fbdf632a1d6c1a73c24acb0c61fc5c6c583371dbfdbad3438bf53bf49de51,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1707883595761831063,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2660231f5c1026249e2a53bf1846b196,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.term
inationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b,PodSandboxId:55a06fc16b903b9f295e66491cbb864d43a7885b816aea2c7e571b816cd26775,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,State:CONTAINER_EXITED,CreatedAt:1707883595547868840,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9d1896b9a147ca1fd7c84296a6056d04,},Annotations:map[string]string{io.kubernetes.container.hash: f9f94116,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.
container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189,PodSandboxId:2b0e3228392a59920963e9f065ab2c7c14ebcb06fb6631f0bf9dbbdfc5f50021,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,State:CONTAINER_EXITED,CreatedAt:1707883540682109734,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-lrmhp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fc243ae7-ccbe-4149-9159-10f6dfc3f9cd,},Annotations:map[string]string{io.kubernetes.container.hash: f0715df3,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.termination
GracePeriod: 30,},},&Container{Id:3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5,PodSandboxId:32bbb4ebf19a698d3f9eae6d2c23b1b90a41b69f7dbbda731a861bc951b59a96,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,State:CONTAINER_EXITED,CreatedAt:1707883540555644362,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-rsn2w,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 71d07922-2814-4eb9-94f9-c2c3f46066b2,},Annotations:map[string]string{io.kubernetes.container.hash: bc236a1e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCoun
t: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5,PodSandboxId:8c5ac1cacda530e913fcfdf329cc72f5fb7310d1059d262e9808a451a4b75d72,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_EXITED,CreatedAt:1707883516284052861,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-pause-951466,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 51ba4add132a8dce72b04590ce7e7f72,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /d
ev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=dff81407-6cf1-4c3d-8a99-10920a0dc46f name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
ee51192443906 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 16 seconds ago Running kube-proxy 1 56f8fa60100f4 kube-proxy-lrmhp
f50776e8acf9a ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 16 seconds ago Running coredns 1 f66b83c6da2bd coredns-5dd5756b68-rsn2w
a656f4676ec8e 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 23 seconds ago Running etcd 2 0be2dc2612651 etcd-pause-951466
a52ad0549f843 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 23 seconds ago Running kube-controller-manager 2 d3eefb9f4d69d kube-controller-manager-pause-951466
b020ac4e50a5f 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 23 seconds ago Running kube-apiserver 2 4963f328b78ca kube-apiserver-pause-951466
63a05e8ef8bd3 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 25 seconds ago Running kube-scheduler 1 336d83b5a0d66 kube-scheduler-pause-951466
ef900e47b23bd 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 29 seconds ago Exited etcd 1 dd467bf0567b7 etcd-pause-951466
1bc4409034161 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 30 seconds ago Exited kube-controller-manager 1 770fbdf632a1d kube-controller-manager-pause-951466
cb6c13c72fd3f 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 30 seconds ago Exited kube-apiserver 1 55a06fc16b903 kube-apiserver-pause-951466
0550efbb7b836 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e About a minute ago Exited kube-proxy 0 2b0e3228392a5 kube-proxy-lrmhp
3ee34acf1521f ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc About a minute ago Exited coredns 0 32bbb4ebf19a6 coredns-5dd5756b68-rsn2w
a7d06e68e3786 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 About a minute ago Exited kube-scheduler 0 8c5ac1cacda53 kube-scheduler-pause-951466
==> coredns [3ee34acf1521f74415345a8efc731292ff8dba7c33f5e1ec353d0c3a3240c5d5] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[WARNING] plugin/kubernetes: Kubernetes API connection failure: Get "https://10.96.0.1:443/version": dial tcp 10.96.0.1:443: i/o timeout
[INFO] Reloading
[INFO] plugin/reload: Running configuration SHA512 = 7996ca7cabdb2fd3e37b0463c78d5a492f8d30690ee66a90ae7ff24c50d9d936a24d239b3a5946771521ff70c09a796ffaf6ef8abe5753fd1ad5af38b6cdbb7f
[INFO] Reloading complete
[INFO] 127.0.0.1:55567 - 45290 "HINFO IN 7947121574309215298.4406530438668576787. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.028302595s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> coredns [f50776e8acf9a849cab65781d76dcc25c425b17d30806b91c59e9a67377d1014] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 7996ca7cabdb2fd3e37b0463c78d5a492f8d30690ee66a90ae7ff24c50d9d936a24d239b3a5946771521ff70c09a796ffaf6ef8abe5753fd1ad5af38b6cdbb7f
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:55171 - 4500 "HINFO IN 2986831352118255742.7066900278557097918. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.120580936s
==> describe nodes <==
Name: pause-951466
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=pause-951466
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=pause-951466
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_05_24_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:05:20 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: pause-951466
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 04:06:58 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:06:48 +0000 Wed, 14 Feb 2024 04:05:18 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:06:48 +0000 Wed, 14 Feb 2024 04:05:18 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:06:48 +0000 Wed, 14 Feb 2024 04:05:18 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:06:48 +0000 Wed, 14 Feb 2024 04:05:24 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.61.64
Hostname: pause-951466
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2017420Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2017420Ki
pods: 110
System Info:
Machine ID: bd5b142b3fca41dea3382399cfa67768
System UUID: bd5b142b-3fca-41de-a338-2399cfa67768
Boot ID: 09e3adcb-cf14-4ce4-a26a-1b7c9de9fbc9
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (6 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-5dd5756b68-rsn2w 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 89s
kube-system etcd-pause-951466 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (5%!)(MISSING) 0 (0%!)(MISSING) 103s
kube-system kube-apiserver-pause-951466 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 103s
kube-system kube-controller-manager-pause-951466 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 102s
kube-system kube-proxy-lrmhp 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 89s
kube-system kube-scheduler-pause-951466 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 102s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 0 (0%!)(MISSING)
memory 170Mi (8%!)(MISSING) 170Mi (8%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 85s kube-proxy
Normal Starting 16s kube-proxy
Normal NodeAllocatableEnforced 102s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 102s kubelet Node pause-951466 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 102s kubelet Node pause-951466 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 102s kubelet Node pause-951466 status is now: NodeHasSufficientPID
Normal NodeReady 102s kubelet Node pause-951466 status is now: NodeReady
Normal Starting 102s kubelet Starting kubelet.
Normal RegisteredNode 89s node-controller Node pause-951466 event: Registered Node pause-951466 in Controller
Normal Starting 24s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 24s (x8 over 24s) kubelet Node pause-951466 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 24s (x8 over 24s) kubelet Node pause-951466 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 24s (x7 over 24s) kubelet Node pause-951466 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 24s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 6s node-controller Node pause-951466 event: Registered Node pause-951466 in Controller
==> dmesg <==
[ +4.592226] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.157494] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.158160] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.115431] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000009] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[Feb14 04:05] systemd-fstab-generator[644]: Ignoring "noauto" for root device
[ +0.109995] systemd-fstab-generator[655]: Ignoring "noauto" for root device
[ +0.141094] systemd-fstab-generator[668]: Ignoring "noauto" for root device
[ +0.124128] systemd-fstab-generator[679]: Ignoring "noauto" for root device
[ +0.221661] systemd-fstab-generator[703]: Ignoring "noauto" for root device
[ +5.829895] systemd-fstab-generator[803]: Ignoring "noauto" for root device
[ +4.643365] systemd-fstab-generator[990]: Ignoring "noauto" for root device
[ +9.814255] systemd-fstab-generator[1322]: Ignoring "noauto" for root device
[ +14.299474] systemd-fstab-generator[1547]: Ignoring "noauto" for root device
[ +12.897647] kauditd_printk_skb: 28 callbacks suppressed
[Feb14 04:06] systemd-fstab-generator[2485]: Ignoring "noauto" for root device
[ +0.391107] systemd-fstab-generator[2501]: Ignoring "noauto" for root device
[ +0.459675] systemd-fstab-generator[2558]: Ignoring "noauto" for root device
[ +0.308833] systemd-fstab-generator[2577]: Ignoring "noauto" for root device
[ +0.635277] systemd-fstab-generator[2629]: Ignoring "noauto" for root device
[ +2.231490] systemd-fstab-generator[2905]: Ignoring "noauto" for root device
[ +2.857324] systemd-fstab-generator[3307]: Ignoring "noauto" for root device
[ +17.477857] systemd-fstab-generator[3716]: Ignoring "noauto" for root device
==> etcd [a656f4676ec8e74a8acb1505febeab8b74d2adf3c5f157ea6e233ed68d8e3b28] <==
{"level":"info","ts":"2024-02-14T04:06:45.418326Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T04:06:45.418366Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T04:06:45.418885Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 switched to configuration voters=(12995502694743150360)"}
{"level":"info","ts":"2024-02-14T04:06:45.419032Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"a20e7ca2a4f7396b","local-member-id":"b4594cd905cc0f18","added-peer-id":"b4594cd905cc0f18","added-peer-peer-urls":["https://192.168.61.64:2380"]}
{"level":"info","ts":"2024-02-14T04:06:45.419219Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"a20e7ca2a4f7396b","local-member-id":"b4594cd905cc0f18","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:06:45.419287Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:06:45.425179Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-02-14T04:06:45.425449Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"b4594cd905cc0f18","initial-advertise-peer-urls":["https://192.168.61.64:2380"],"listen-peer-urls":["https://192.168.61.64:2380"],"advertise-client-urls":["https://192.168.61.64:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.61.64:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-02-14T04:06:45.425566Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.61.64:2380"}
{"level":"info","ts":"2024-02-14T04:06:45.425649Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.61.64:2380"}
{"level":"info","ts":"2024-02-14T04:06:45.425685Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-02-14T04:06:46.600966Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 is starting a new election at term 2"}
{"level":"info","ts":"2024-02-14T04:06:46.601046Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 became pre-candidate at term 2"}
{"level":"info","ts":"2024-02-14T04:06:46.601087Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 received MsgPreVoteResp from b4594cd905cc0f18 at term 2"}
{"level":"info","ts":"2024-02-14T04:06:46.601119Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 became candidate at term 3"}
{"level":"info","ts":"2024-02-14T04:06:46.60113Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 received MsgVoteResp from b4594cd905cc0f18 at term 3"}
{"level":"info","ts":"2024-02-14T04:06:46.601146Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b4594cd905cc0f18 became leader at term 3"}
{"level":"info","ts":"2024-02-14T04:06:46.601157Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: b4594cd905cc0f18 elected leader b4594cd905cc0f18 at term 3"}
{"level":"info","ts":"2024-02-14T04:06:46.608187Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"b4594cd905cc0f18","local-member-attributes":"{Name:pause-951466 ClientURLs:[https://192.168.61.64:2379]}","request-path":"/0/members/b4594cd905cc0f18/attributes","cluster-id":"a20e7ca2a4f7396b","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T04:06:46.60821Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:06:46.608226Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:06:46.610006Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.61.64:2379"}
{"level":"info","ts":"2024-02-14T04:06:46.610006Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T04:06:46.625614Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T04:06:46.62568Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
==> etcd [ef900e47b23bdc3642fd628f5d2ee1cdf244a3b116ed31a1e03b88ad564f7ce7] <==
==> kernel <==
04:07:06 up 2 min, 0 users, load average: 1.53, 0.63, 0.23
Linux pause-951466 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [b020ac4e50a5f11318ed9cadc0551adc063db91ec0d360453acffc3ff09a7254] <==
I0214 04:06:48.238560 1 aggregator.go:164] waiting for initial CRD sync...
I0214 04:06:48.243218 1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0214 04:06:48.243272 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0214 04:06:48.427365 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0214 04:06:48.428244 1 shared_informer.go:318] Caches are synced for configmaps
I0214 04:06:48.428350 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0214 04:06:48.435602 1 apf_controller.go:377] Running API Priority and Fairness config worker
I0214 04:06:48.435640 1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
I0214 04:06:48.438562 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0214 04:06:48.440757 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0214 04:06:48.440910 1 shared_informer.go:318] Caches are synced for node_authorizer
I0214 04:06:48.443617 1 shared_informer.go:318] Caches are synced for crd-autoregister
I0214 04:06:48.443701 1 aggregator.go:166] initial CRD sync complete...
I0214 04:06:48.443733 1 autoregister_controller.go:141] Starting autoregister controller
I0214 04:06:48.443755 1 cache.go:32] Waiting for caches to sync for autoregister controller
I0214 04:06:48.443779 1 cache.go:39] Caches are synced for autoregister controller
E0214 04:06:48.477769 1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service
I0214 04:06:49.237391 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0214 04:06:50.132215 1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0214 04:06:50.147045 1 controller.go:624] quota admission added evaluator for: deployments.apps
I0214 04:06:50.195457 1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0214 04:06:50.225239 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0214 04:06:50.233399 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0214 04:07:00.773231 1 controller.go:624] quota admission added evaluator for: endpoints
I0214 04:07:00.884422 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
==> kube-apiserver [cb6c13c72fd3f1da5f8849972c776ab184ffec74c3ec0623e918f8076929d86b] <==
==> kube-controller-manager [1bc4409034161cbb592564c3578f1ec59cd1130a2b303d32a1b622cede14d0c7] <==
==> kube-controller-manager [a52ad0549f8434bf99bbf8843517ab578bcb0d8a39055bf71e6e144ce4417724] <==
I0214 04:07:00.755022 1 shared_informer.go:318] Caches are synced for daemon sets
I0214 04:07:00.756245 1 shared_informer.go:318] Caches are synced for PVC protection
I0214 04:07:00.762745 1 shared_informer.go:318] Caches are synced for endpoint
I0214 04:07:00.777091 1 shared_informer.go:318] Caches are synced for ephemeral
I0214 04:07:00.780614 1 shared_informer.go:318] Caches are synced for ReplicationController
I0214 04:07:00.786215 1 shared_informer.go:318] Caches are synced for stateful set
I0214 04:07:00.798442 1 shared_informer.go:318] Caches are synced for endpoint_slice
I0214 04:07:00.800589 1 shared_informer.go:318] Caches are synced for deployment
I0214 04:07:00.804686 1 shared_informer.go:318] Caches are synced for GC
I0214 04:07:00.810415 1 shared_informer.go:318] Caches are synced for HPA
I0214 04:07:00.828453 1 shared_informer.go:318] Caches are synced for taint
I0214 04:07:00.828873 1 node_lifecycle_controller.go:1225] "Initializing eviction metric for zone" zone=""
I0214 04:07:00.829287 1 node_lifecycle_controller.go:877] "Missing timestamp for Node. Assuming now as a timestamp" node="pause-951466"
I0214 04:07:00.830825 1 node_lifecycle_controller.go:1071] "Controller detected that zone is now in new state" zone="" newState="Normal"
I0214 04:07:00.830856 1 shared_informer.go:318] Caches are synced for ReplicaSet
I0214 04:07:00.831007 1 event.go:307] "Event occurred" object="pause-951466" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-951466 event: Registered Node pause-951466 in Controller"
I0214 04:07:00.831162 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="165.24µs"
I0214 04:07:00.829726 1 taint_manager.go:205] "Starting NoExecuteTaintManager"
I0214 04:07:00.831243 1 taint_manager.go:210] "Sending events to api server"
I0214 04:07:00.891393 1 shared_informer.go:318] Caches are synced for resource quota
I0214 04:07:00.909228 1 shared_informer.go:318] Caches are synced for disruption
I0214 04:07:00.930292 1 shared_informer.go:318] Caches are synced for resource quota
I0214 04:07:01.287917 1 shared_informer.go:318] Caches are synced for garbage collector
I0214 04:07:01.326433 1 shared_informer.go:318] Caches are synced for garbage collector
I0214 04:07:01.326594 1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
==> kube-proxy [0550efbb7b8361c4ae589e28f9b2a889011d4263be39415193ab7281608df189] <==
I0214 04:05:41.421606 1 server_others.go:69] "Using iptables proxy"
I0214 04:05:41.442692 1 node.go:141] Successfully retrieved node IP: 192.168.61.64
I0214 04:05:41.504127 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 04:05:41.504204 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:05:41.507586 1 server_others.go:152] "Using iptables Proxier"
I0214 04:05:41.508303 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:05:41.508669 1 server.go:846] "Version info" version="v1.28.4"
I0214 04:05:41.508719 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:05:41.511625 1 config.go:188] "Starting service config controller"
I0214 04:05:41.512190 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:05:41.512259 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:05:41.512280 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:05:41.515603 1 config.go:315] "Starting node config controller"
I0214 04:05:41.515743 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:05:41.612452 1 shared_informer.go:318] Caches are synced for service config
I0214 04:05:41.612453 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 04:05:41.615911 1 shared_informer.go:318] Caches are synced for node config
==> kube-proxy [ee51192443906e1eb4ee4aa177ecf01bf6b575a1e4c0b9c4d2bd34352d933fba] <==
I0214 04:06:49.879398 1 server_others.go:69] "Using iptables proxy"
I0214 04:06:49.897206 1 node.go:141] Successfully retrieved node IP: 192.168.61.64
I0214 04:06:49.960928 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 04:06:49.961034 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:06:49.965881 1 server_others.go:152] "Using iptables Proxier"
I0214 04:06:49.966034 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:06:49.966209 1 server.go:846] "Version info" version="v1.28.4"
I0214 04:06:49.966350 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:06:49.968076 1 config.go:188] "Starting service config controller"
I0214 04:06:49.968122 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:06:49.968153 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:06:49.968169 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:06:49.968271 1 config.go:315] "Starting node config controller"
I0214 04:06:49.968290 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:06:50.068216 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 04:06:50.068337 1 shared_informer.go:318] Caches are synced for node config
I0214 04:06:50.068360 1 shared_informer.go:318] Caches are synced for service config
==> kube-scheduler [63a05e8ef8bd3ba16549d05b2dfce8bfa4487b8f65b8c12e99f34959df2b479d] <==
I0214 04:06:44.418421 1 serving.go:348] Generated self-signed cert in-memory
W0214 04:06:48.333083 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0214 04:06:48.333328 1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0214 04:06:48.333412 1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
W0214 04:06:48.333441 1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0214 04:06:48.399323 1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"
I0214 04:06:48.399431 1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:06:48.403980 1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
I0214 04:06:48.404308 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0214 04:06:48.404415 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 04:06:48.404590 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0214 04:06:48.504835 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5] <==
E0214 04:05:21.649832 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0214 04:05:21.665915 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0214 04:05:21.665968 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
W0214 04:05:21.725730 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:05:21.725756 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0214 04:05:21.768762 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:05:21.768817 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 04:05:21.782614 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 04:05:21.782666 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0214 04:05:21.805987 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 04:05:21.806084 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 04:05:21.866961 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:05:21.867011 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0214 04:05:22.007209 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:05:22.007302 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 04:05:22.042913 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 04:05:22.043000 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0214 04:05:22.163948 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 04:05:22.164005 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 04:05:22.316859 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 04:05:22.316979 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0214 04:05:24.259702 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 04:06:25.675684 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
I0214 04:06:25.675988 1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259
E0214 04:06:25.676635 1 run.go:74] "command failed" err="finished without leader elect"
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:04:49 UTC, ends at Wed 2024-02-14 04:07:07 UTC. --
Feb 14 04:06:42 pause-951466 kubelet[3313]: I0214 04:06:42.985939 3313 scope.go:117] "RemoveContainer" containerID="a7d06e68e37861079a4aa6291dbf840500af2912adbca42e60dbdbe593b1e0d5"
Feb 14 04:06:43 pause-951466 kubelet[3313]: W0214 04:06:43.280004 3313 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)pause-951466&limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.280078 3313 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)pause-951466&limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: W0214 04:06:43.567980 3313 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.568037 3313 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: W0214 04:06:43.625688 3313 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: Get "https://control-plane.minikube.internal:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.625779 3313 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://control-plane.minikube.internal:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.663148 3313 controller.go:146] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-951466?timeout=10s\": dial tcp 192.168.61.64:8443: connect: connection refused" interval="1.6s"
Feb 14 04:06:43 pause-951466 kubelet[3313]: I0214 04:06:43.769736 3313 kubelet_node_status.go:70] "Attempting to register node" node="pause-951466"
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.771148 3313 kubelet_node_status.go:92] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.61.64:8443: connect: connection refused" node="pause-951466"
Feb 14 04:06:43 pause-951466 kubelet[3313]: W0214 04:06:43.883294 3313 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:43 pause-951466 kubelet[3313]: E0214 04:06:43.883383 3313 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.61.64:8443: connect: connection refused
Feb 14 04:06:45 pause-951466 kubelet[3313]: I0214 04:06:45.373292 3313 kubelet_node_status.go:70] "Attempting to register node" node="pause-951466"
Feb 14 04:06:48 pause-951466 kubelet[3313]: I0214 04:06:48.460905 3313 kubelet_node_status.go:108] "Node was previously registered" node="pause-951466"
Feb 14 04:06:48 pause-951466 kubelet[3313]: I0214 04:06:48.460994 3313 kubelet_node_status.go:73] "Successfully registered node" node="pause-951466"
Feb 14 04:06:48 pause-951466 kubelet[3313]: I0214 04:06:48.464958 3313 kuberuntime_manager.go:1528] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"
Feb 14 04:06:48 pause-951466 kubelet[3313]: I0214 04:06:48.466292 3313 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
Feb 14 04:06:48 pause-951466 kubelet[3313]: E0214 04:06:48.790262 3313 kubelet.go:1890] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-pause-951466\" already exists" pod="kube-system/kube-controller-manager-pause-951466"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.230041 3313 apiserver.go:52] "Watching apiserver"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.236108 3313 topology_manager.go:215] "Topology Admit Handler" podUID="fc243ae7-ccbe-4149-9159-10f6dfc3f9cd" podNamespace="kube-system" podName="kube-proxy-lrmhp"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.236268 3313 topology_manager.go:215] "Topology Admit Handler" podUID="71d07922-2814-4eb9-94f9-c2c3f46066b2" podNamespace="kube-system" podName="coredns-5dd5756b68-rsn2w"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.257156 3313 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.288592 3313 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc243ae7-ccbe-4149-9159-10f6dfc3f9cd-lib-modules\") pod \"kube-proxy-lrmhp\" (UID: \"fc243ae7-ccbe-4149-9159-10f6dfc3f9cd\") " pod="kube-system/kube-proxy-lrmhp"
Feb 14 04:06:49 pause-951466 kubelet[3313]: I0214 04:06:49.288633 3313 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/fc243ae7-ccbe-4149-9159-10f6dfc3f9cd-xtables-lock\") pod \"kube-proxy-lrmhp\" (UID: \"fc243ae7-ccbe-4149-9159-10f6dfc3f9cd\") " pod="kube-system/kube-proxy-lrmhp"
Feb 14 04:06:57 pause-951466 kubelet[3313]: I0214 04:06:57.727397 3313 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
-- /stdout --
** stderr **
E0214 04:07:05.912846 1534452 logs.go:258] failed to output last start logs: failed to read file /home/jenkins/minikube-integration/17909-1487441/.minikube/logs/lastStart.txt: bufio.Scanner: token too long
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-951466 -n pause-951466
helpers_test.go:261: (dbg) Run: kubectl --context pause-951466 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestPause/serial/SecondStartNoReconfiguration FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestPause/serial/SecondStartNoReconfiguration (47.53s)
=== RUN TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p old-k8s-version-960884 --alsologtostderr -v=3
E0214 04:12:50.251912 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p old-k8s-version-960884 --alsologtostderr -v=3: exit status 82 (2m0.643439126s)
-- stdout --
* Stopping node "old-k8s-version-960884" ...
-- /stdout --
** stderr **
I0214 04:12:48.020994 1547130 out.go:291] Setting OutFile to fd 1 ...
I0214 04:12:48.021131 1547130 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:12:48.021142 1547130 out.go:304] Setting ErrFile to fd 2...
I0214 04:12:48.021149 1547130 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:12:48.021442 1547130 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:12:48.021700 1547130 out.go:298] Setting JSON to false
I0214 04:12:48.021813 1547130 mustload.go:65] Loading cluster: old-k8s-version-960884
I0214 04:12:48.022323 1547130 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:12:48.022404 1547130 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/config.json ...
I0214 04:12:48.022590 1547130 mustload.go:65] Loading cluster: old-k8s-version-960884
I0214 04:12:48.022699 1547130 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:12:48.022740 1547130 stop.go:39] StopHost: old-k8s-version-960884
I0214 04:12:48.023224 1547130 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:12:48.023291 1547130 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:12:48.038349 1547130 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46363
I0214 04:12:48.038854 1547130 main.go:141] libmachine: () Calling .GetVersion
I0214 04:12:48.039472 1547130 main.go:141] libmachine: Using API Version 1
I0214 04:12:48.039494 1547130 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:12:48.039943 1547130 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:12:48.042850 1547130 out.go:177] * Stopping node "old-k8s-version-960884" ...
I0214 04:12:48.044440 1547130 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]
I0214 04:12:48.044482 1547130 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:12:48.044768 1547130 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup
I0214 04:12:48.044804 1547130 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:12:48.047740 1547130 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:12:48.048242 1547130 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:10:32 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:12:48.048279 1547130 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:12:48.048521 1547130 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:12:48.048700 1547130 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:12:48.048846 1547130 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:12:48.048984 1547130 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:12:48.163449 1547130 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/cni /var/lib/minikube/backup
I0214 04:12:48.189619 1547130 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/kubernetes /var/lib/minikube/backup
I0214 04:12:48.202747 1547130 main.go:141] libmachine: Stopping "old-k8s-version-960884"...
I0214 04:12:48.202794 1547130 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:12:48.204797 1547130 main.go:141] libmachine: (old-k8s-version-960884) Calling .Stop
I0214 04:12:48.209275 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 0/120
I0214 04:12:49.210858 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 1/120
I0214 04:12:50.213579 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 2/120
I0214 04:12:51.215850 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 3/120
I0214 04:12:52.217491 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 4/120
I0214 04:12:53.219491 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 5/120
I0214 04:12:54.221401 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 6/120
I0214 04:12:55.223659 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 7/120
I0214 04:12:56.225051 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 8/120
I0214 04:12:57.226498 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 9/120
I0214 04:12:58.228808 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 10/120
I0214 04:12:59.230256 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 11/120
I0214 04:13:00.231712 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 12/120
I0214 04:13:01.233530 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 13/120
I0214 04:13:02.234912 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 14/120
I0214 04:13:03.236545 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 15/120
I0214 04:13:04.238275 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 16/120
I0214 04:13:05.240248 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 17/120
I0214 04:13:06.242207 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 18/120
I0214 04:13:07.244487 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 19/120
I0214 04:13:08.246601 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 20/120
I0214 04:13:09.248524 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 21/120
I0214 04:13:10.249819 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 22/120
I0214 04:13:11.251210 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 23/120
I0214 04:13:12.252708 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 24/120
I0214 04:13:13.254518 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 25/120
I0214 04:13:14.256166 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 26/120
I0214 04:13:15.257844 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 27/120
I0214 04:13:16.259830 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 28/120
I0214 04:13:17.261525 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 29/120
I0214 04:13:18.263979 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 30/120
I0214 04:13:19.266514 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 31/120
I0214 04:13:20.268118 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 32/120
I0214 04:13:21.269774 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 33/120
I0214 04:13:22.271649 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 34/120
I0214 04:13:23.273757 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 35/120
I0214 04:13:24.275276 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 36/120
I0214 04:13:25.277872 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 37/120
I0214 04:13:26.279368 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 38/120
I0214 04:13:27.280878 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 39/120
I0214 04:13:28.283125 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 40/120
I0214 04:13:29.284676 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 41/120
I0214 04:13:30.285991 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 42/120
I0214 04:13:31.287514 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 43/120
I0214 04:13:32.288834 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 44/120
I0214 04:13:33.290838 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 45/120
I0214 04:13:34.292901 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 46/120
I0214 04:13:35.294286 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 47/120
I0214 04:13:36.295920 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 48/120
I0214 04:13:37.297605 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 49/120
I0214 04:13:38.299741 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 50/120
I0214 04:13:39.301298 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 51/120
I0214 04:13:40.302654 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 52/120
I0214 04:13:41.304234 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 53/120
I0214 04:13:42.305684 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 54/120
I0214 04:13:43.307632 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 55/120
I0214 04:13:44.309068 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 56/120
I0214 04:13:45.310526 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 57/120
I0214 04:13:46.312136 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 58/120
I0214 04:13:47.313594 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 59/120
I0214 04:13:48.315839 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 60/120
I0214 04:13:49.317588 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 61/120
I0214 04:13:50.319808 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 62/120
I0214 04:13:51.321341 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 63/120
I0214 04:13:52.322973 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 64/120
I0214 04:13:53.325161 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 65/120
I0214 04:13:54.326637 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 66/120
I0214 04:13:55.328088 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 67/120
I0214 04:13:56.329554 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 68/120
I0214 04:13:57.331080 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 69/120
I0214 04:13:58.332322 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 70/120
I0214 04:13:59.333747 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 71/120
I0214 04:14:00.335149 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 72/120
I0214 04:14:01.336743 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 73/120
I0214 04:14:02.338372 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 74/120
I0214 04:14:03.340672 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 75/120
I0214 04:14:04.342046 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 76/120
I0214 04:14:05.343451 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 77/120
I0214 04:14:06.344785 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 78/120
I0214 04:14:07.346327 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 79/120
I0214 04:14:08.348059 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 80/120
I0214 04:14:09.349579 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 81/120
I0214 04:14:10.351159 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 82/120
I0214 04:14:11.352363 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 83/120
I0214 04:14:12.354007 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 84/120
I0214 04:14:13.356144 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 85/120
I0214 04:14:14.357696 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 86/120
I0214 04:14:15.359114 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 87/120
I0214 04:14:16.360492 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 88/120
I0214 04:14:17.362266 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 89/120
I0214 04:14:18.364689 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 90/120
I0214 04:14:19.366240 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 91/120
I0214 04:14:20.367783 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 92/120
I0214 04:14:21.369294 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 93/120
I0214 04:14:22.370836 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 94/120
I0214 04:14:23.373075 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 95/120
I0214 04:14:24.374531 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 96/120
I0214 04:14:25.376031 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 97/120
I0214 04:14:26.377524 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 98/120
I0214 04:14:27.378869 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 99/120
I0214 04:14:28.381085 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 100/120
I0214 04:14:29.382361 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 101/120
I0214 04:14:30.383997 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 102/120
I0214 04:14:31.385536 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 103/120
I0214 04:14:32.387146 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 104/120
I0214 04:14:33.389526 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 105/120
I0214 04:14:34.390868 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 106/120
I0214 04:14:35.392307 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 107/120
I0214 04:14:36.393798 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 108/120
I0214 04:14:37.395349 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 109/120
I0214 04:14:38.397769 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 110/120
I0214 04:14:39.398960 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 111/120
I0214 04:14:40.400511 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 112/120
I0214 04:14:41.401757 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 113/120
I0214 04:14:42.403467 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 114/120
I0214 04:14:43.405673 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 115/120
I0214 04:14:44.407102 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 116/120
I0214 04:14:45.408607 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 117/120
I0214 04:14:46.410163 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 118/120
I0214 04:14:47.411666 1547130 main.go:141] libmachine: (old-k8s-version-960884) Waiting for machine to stop 119/120
I0214 04:14:48.413295 1547130 stop.go:66] stop err: unable to stop vm, current state "Running"
W0214 04:14:48.413409 1547130 stop.go:165] stop host returned error: Temporary Error: stop: unable to stop vm, current state "Running"
I0214 04:14:48.415331 1547130 out.go:177]
W0214 04:14:48.416863 1547130 out.go:239] X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
W0214 04:14:48.416878 1547130 out.go:239] *
*
W0214 04:14:48.600402 1547130 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0214 04:14:48.602292 1547130 out.go:177]
** /stderr **
start_stop_delete_test.go:230: failed stopping minikube - first stop-. args "out/minikube-linux-amd64 stop -p old-k8s-version-960884 --alsologtostderr -v=3" : exit status 82
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884
E0214 04:14:53.133120 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:14:58.298152 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 04:14:58.981552 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:15:01.332299 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:15:05.112621 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:15:05.117885 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:15:05.128117 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:15:05.148381 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:15:05.188923 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:15:05.269265 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:15:05.429714 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884: exit status 3 (18.497564805s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:15:07.101638 1547793 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.72.206:22: connect: no route to host
E0214 04:15:07.101663 1547793 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.72.206:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "old-k8s-version-960884" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Stop (139.14s)
=== RUN TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p no-preload-527067 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p no-preload-527067 --alsologtostderr -v=3: exit status 82 (2m0.499801049s)
-- stdout --
* Stopping node "no-preload-527067" ...
-- /stdout --
** stderr **
I0214 04:13:05.248648 1547250 out.go:291] Setting OutFile to fd 1 ...
I0214 04:13:05.248844 1547250 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:13:05.248863 1547250 out.go:304] Setting ErrFile to fd 2...
I0214 04:13:05.248872 1547250 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:13:05.249185 1547250 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:13:05.249607 1547250 out.go:298] Setting JSON to false
I0214 04:13:05.249718 1547250 mustload.go:65] Loading cluster: no-preload-527067
I0214 04:13:05.250250 1547250 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:13:05.250357 1547250 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/config.json ...
I0214 04:13:05.250602 1547250 mustload.go:65] Loading cluster: no-preload-527067
I0214 04:13:05.250782 1547250 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:13:05.250832 1547250 stop.go:39] StopHost: no-preload-527067
I0214 04:13:05.251246 1547250 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:13:05.251301 1547250 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:13:05.266591 1547250 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36471
I0214 04:13:05.267121 1547250 main.go:141] libmachine: () Calling .GetVersion
I0214 04:13:05.267753 1547250 main.go:141] libmachine: Using API Version 1
I0214 04:13:05.267784 1547250 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:13:05.268156 1547250 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:13:05.270808 1547250 out.go:177] * Stopping node "no-preload-527067" ...
I0214 04:13:05.272223 1547250 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]
I0214 04:13:05.272260 1547250 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:13:05.272502 1547250 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup
I0214 04:13:05.272525 1547250 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:13:05.275793 1547250 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:13:05.276203 1547250 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:11:08 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:13:05.276226 1547250 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:13:05.276353 1547250 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:13:05.276567 1547250 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:13:05.276726 1547250 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:13:05.276901 1547250 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:13:05.433279 1547250 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/cni /var/lib/minikube/backup
I0214 04:13:05.452149 1547250 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/kubernetes /var/lib/minikube/backup
I0214 04:13:05.467483 1547250 main.go:141] libmachine: Stopping "no-preload-527067"...
I0214 04:13:05.467528 1547250 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:13:05.469472 1547250 main.go:141] libmachine: (no-preload-527067) Calling .Stop
I0214 04:13:05.473174 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 0/120
I0214 04:13:06.474687 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 1/120
I0214 04:13:07.476114 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 2/120
I0214 04:13:08.477829 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 3/120
I0214 04:13:09.479872 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 4/120
I0214 04:13:10.482090 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 5/120
I0214 04:13:11.483505 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 6/120
I0214 04:13:12.484868 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 7/120
I0214 04:13:13.486512 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 8/120
I0214 04:13:14.488240 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 9/120
I0214 04:13:15.490599 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 10/120
I0214 04:13:16.492489 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 11/120
I0214 04:13:17.494039 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 12/120
I0214 04:13:18.495394 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 13/120
I0214 04:13:19.497791 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 14/120
I0214 04:13:20.499922 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 15/120
I0214 04:13:21.501811 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 16/120
I0214 04:13:22.503203 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 17/120
I0214 04:13:23.505787 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 18/120
I0214 04:13:24.507839 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 19/120
I0214 04:13:25.509890 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 20/120
I0214 04:13:26.511553 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 21/120
I0214 04:13:27.512890 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 22/120
I0214 04:13:28.514821 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 23/120
I0214 04:13:29.516913 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 24/120
I0214 04:13:30.518760 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 25/120
I0214 04:13:31.520207 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 26/120
I0214 04:13:32.521753 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 27/120
I0214 04:13:33.524073 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 28/120
I0214 04:13:34.525689 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 29/120
I0214 04:13:35.527755 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 30/120
I0214 04:13:36.529156 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 31/120
I0214 04:13:37.530694 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 32/120
I0214 04:13:38.532136 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 33/120
I0214 04:13:39.533899 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 34/120
I0214 04:13:40.536152 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 35/120
I0214 04:13:41.537578 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 36/120
I0214 04:13:42.539426 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 37/120
I0214 04:13:43.540959 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 38/120
I0214 04:13:44.543213 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 39/120
I0214 04:13:45.545544 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 40/120
I0214 04:13:46.546912 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 41/120
I0214 04:13:47.549045 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 42/120
I0214 04:13:48.550291 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 43/120
I0214 04:13:49.551679 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 44/120
I0214 04:13:50.553454 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 45/120
I0214 04:13:51.554856 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 46/120
I0214 04:13:52.556093 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 47/120
I0214 04:13:53.557624 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 48/120
I0214 04:13:54.558958 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 49/120
I0214 04:13:55.560344 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 50/120
I0214 04:13:56.561698 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 51/120
I0214 04:13:57.563100 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 52/120
I0214 04:13:58.564425 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 53/120
I0214 04:13:59.565681 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 54/120
I0214 04:14:00.567874 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 55/120
I0214 04:14:01.569369 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 56/120
I0214 04:14:02.570670 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 57/120
I0214 04:14:03.572220 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 58/120
I0214 04:14:04.573618 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 59/120
I0214 04:14:05.574861 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 60/120
I0214 04:14:06.576315 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 61/120
I0214 04:14:07.577646 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 62/120
I0214 04:14:08.579135 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 63/120
I0214 04:14:09.580511 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 64/120
I0214 04:14:10.582526 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 65/120
I0214 04:14:11.583911 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 66/120
I0214 04:14:12.585569 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 67/120
I0214 04:14:13.586876 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 68/120
I0214 04:14:14.588215 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 69/120
I0214 04:14:15.589703 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 70/120
I0214 04:14:16.591011 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 71/120
I0214 04:14:17.592506 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 72/120
I0214 04:14:18.594167 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 73/120
I0214 04:14:19.595633 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 74/120
I0214 04:14:20.597873 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 75/120
I0214 04:14:21.599684 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 76/120
I0214 04:14:22.601100 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 77/120
I0214 04:14:23.602468 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 78/120
I0214 04:14:24.603772 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 79/120
I0214 04:14:25.606038 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 80/120
I0214 04:14:26.607230 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 81/120
I0214 04:14:27.608577 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 82/120
I0214 04:14:28.610346 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 83/120
I0214 04:14:29.612284 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 84/120
I0214 04:14:30.614584 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 85/120
I0214 04:14:31.615923 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 86/120
I0214 04:14:32.617455 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 87/120
I0214 04:14:33.618888 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 88/120
I0214 04:14:34.620264 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 89/120
I0214 04:14:35.622567 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 90/120
I0214 04:14:36.624117 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 91/120
I0214 04:14:37.625491 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 92/120
I0214 04:14:38.626807 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 93/120
I0214 04:14:39.628201 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 94/120
I0214 04:14:40.630000 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 95/120
I0214 04:14:41.631739 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 96/120
I0214 04:14:42.633107 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 97/120
I0214 04:14:43.635021 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 98/120
I0214 04:14:44.636411 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 99/120
I0214 04:14:45.638691 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 100/120
I0214 04:14:46.640318 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 101/120
I0214 04:14:47.641933 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 102/120
I0214 04:14:48.643995 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 103/120
I0214 04:14:49.645298 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 104/120
I0214 04:14:50.647313 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 105/120
I0214 04:14:51.648777 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 106/120
I0214 04:14:52.650319 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 107/120
I0214 04:14:53.651881 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 108/120
I0214 04:14:54.653575 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 109/120
I0214 04:14:55.655969 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 110/120
I0214 04:14:56.657388 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 111/120
I0214 04:14:57.659011 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 112/120
I0214 04:14:58.660472 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 113/120
I0214 04:14:59.661977 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 114/120
I0214 04:15:00.664264 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 115/120
I0214 04:15:01.666018 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 116/120
I0214 04:15:02.667396 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 117/120
I0214 04:15:03.668883 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 118/120
I0214 04:15:04.670182 1547250 main.go:141] libmachine: (no-preload-527067) Waiting for machine to stop 119/120
I0214 04:15:05.670588 1547250 stop.go:66] stop err: unable to stop vm, current state "Running"
W0214 04:15:05.670645 1547250 stop.go:165] stop host returned error: Temporary Error: stop: unable to stop vm, current state "Running"
I0214 04:15:05.672833 1547250 out.go:177]
W0214 04:15:05.674229 1547250 out.go:239] X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
W0214 04:15:05.674247 1547250 out.go:239] *
*
W0214 04:15:05.679361 1547250 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0214 04:15:05.680815 1547250 out.go:177]
** /stderr **
start_stop_delete_test.go:230: failed stopping minikube - first stop-. args "out/minikube-linux-amd64 stop -p no-preload-527067 --alsologtostderr -v=3" : exit status 82
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067
E0214 04:15:05.750812 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:15:06.391877 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067: exit status 3 (18.571027413s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:15:24.253588 1547868 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.167:22: connect: no route to host
E0214 04:15:24.253610 1547868 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.39.167:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "no-preload-527067" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/no-preload/serial/Stop (139.07s)
=== RUN TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p embed-certs-722906 --alsologtostderr -v=3
E0214 04:13:31.212821 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:13:39.411605 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p embed-certs-722906 --alsologtostderr -v=3: exit status 82 (2m0.475469531s)
-- stdout --
* Stopping node "embed-certs-722906" ...
-- /stdout --
** stderr **
I0214 04:13:28.783584 1547454 out.go:291] Setting OutFile to fd 1 ...
I0214 04:13:28.783745 1547454 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:13:28.783755 1547454 out.go:304] Setting ErrFile to fd 2...
I0214 04:13:28.783760 1547454 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:13:28.784047 1547454 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:13:28.784370 1547454 out.go:298] Setting JSON to false
I0214 04:13:28.784469 1547454 mustload.go:65] Loading cluster: embed-certs-722906
I0214 04:13:28.784834 1547454 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:13:28.784917 1547454 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/config.json ...
I0214 04:13:28.785153 1547454 mustload.go:65] Loading cluster: embed-certs-722906
I0214 04:13:28.785335 1547454 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:13:28.785387 1547454 stop.go:39] StopHost: embed-certs-722906
I0214 04:13:28.785848 1547454 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:13:28.785908 1547454 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:13:28.801060 1547454 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39857
I0214 04:13:28.801571 1547454 main.go:141] libmachine: () Calling .GetVersion
I0214 04:13:28.802244 1547454 main.go:141] libmachine: Using API Version 1
I0214 04:13:28.802273 1547454 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:13:28.802712 1547454 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:13:28.805097 1547454 out.go:177] * Stopping node "embed-certs-722906" ...
I0214 04:13:28.806570 1547454 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]
I0214 04:13:28.806596 1547454 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:13:28.806834 1547454 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup
I0214 04:13:28.806859 1547454 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:13:28.809764 1547454 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:13:28.810174 1547454 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:13:28.810204 1547454 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:13:28.810352 1547454 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:13:28.810539 1547454 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:13:28.810697 1547454 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:13:28.810847 1547454 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:13:28.955126 1547454 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/cni /var/lib/minikube/backup
I0214 04:13:28.972010 1547454 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/kubernetes /var/lib/minikube/backup
I0214 04:13:28.984004 1547454 main.go:141] libmachine: Stopping "embed-certs-722906"...
I0214 04:13:28.984029 1547454 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:13:28.985771 1547454 main.go:141] libmachine: (embed-certs-722906) Calling .Stop
I0214 04:13:28.989513 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 0/120
I0214 04:13:29.991917 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 1/120
I0214 04:13:30.994300 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 2/120
I0214 04:13:31.995763 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 3/120
I0214 04:13:32.997360 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 4/120
I0214 04:13:33.999577 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 5/120
I0214 04:13:35.001148 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 6/120
I0214 04:13:36.003011 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 7/120
I0214 04:13:37.004383 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 8/120
I0214 04:13:38.005758 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 9/120
I0214 04:13:39.008000 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 10/120
I0214 04:13:40.009887 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 11/120
I0214 04:13:41.011700 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 12/120
I0214 04:13:42.014022 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 13/120
I0214 04:13:43.015653 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 14/120
I0214 04:13:44.017672 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 15/120
I0214 04:13:45.020000 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 16/120
I0214 04:13:46.021405 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 17/120
I0214 04:13:47.023572 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 18/120
I0214 04:13:48.024916 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 19/120
I0214 04:13:49.027577 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 20/120
I0214 04:13:50.028972 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 21/120
I0214 04:13:51.030371 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 22/120
I0214 04:13:52.031862 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 23/120
I0214 04:13:53.033135 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 24/120
I0214 04:13:54.035735 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 25/120
I0214 04:13:55.037408 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 26/120
I0214 04:13:56.039080 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 27/120
I0214 04:13:57.040558 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 28/120
I0214 04:13:58.042104 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 29/120
I0214 04:13:59.044131 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 30/120
I0214 04:14:00.045715 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 31/120
I0214 04:14:01.047828 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 32/120
I0214 04:14:02.049506 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 33/120
I0214 04:14:03.050846 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 34/120
I0214 04:14:04.052887 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 35/120
I0214 04:14:05.054203 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 36/120
I0214 04:14:06.055777 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 37/120
I0214 04:14:07.057186 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 38/120
I0214 04:14:08.058585 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 39/120
I0214 04:14:09.060097 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 40/120
I0214 04:14:10.062157 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 41/120
I0214 04:14:11.063986 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 42/120
I0214 04:14:12.065499 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 43/120
I0214 04:14:13.066868 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 44/120
I0214 04:14:14.068920 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 45/120
I0214 04:14:15.070327 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 46/120
I0214 04:14:16.071796 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 47/120
I0214 04:14:17.073099 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 48/120
I0214 04:14:18.074552 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 49/120
I0214 04:14:19.076226 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 50/120
I0214 04:14:20.077818 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 51/120
I0214 04:14:21.079316 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 52/120
I0214 04:14:22.080973 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 53/120
I0214 04:14:23.082418 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 54/120
I0214 04:14:24.084420 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 55/120
I0214 04:14:25.085836 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 56/120
I0214 04:14:26.087159 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 57/120
I0214 04:14:27.088641 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 58/120
I0214 04:14:28.090013 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 59/120
I0214 04:14:29.092346 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 60/120
I0214 04:14:30.093897 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 61/120
I0214 04:14:31.095760 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 62/120
I0214 04:14:32.097188 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 63/120
I0214 04:14:33.098564 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 64/120
I0214 04:14:34.100720 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 65/120
I0214 04:14:35.102246 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 66/120
I0214 04:14:36.103761 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 67/120
I0214 04:14:37.105111 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 68/120
I0214 04:14:38.106689 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 69/120
I0214 04:14:39.108967 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 70/120
I0214 04:14:40.110498 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 71/120
I0214 04:14:41.111962 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 72/120
I0214 04:14:42.113597 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 73/120
I0214 04:14:43.115101 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 74/120
I0214 04:14:44.117169 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 75/120
I0214 04:14:45.119126 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 76/120
I0214 04:14:46.120719 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 77/120
I0214 04:14:47.122301 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 78/120
I0214 04:14:48.123757 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 79/120
I0214 04:14:49.125901 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 80/120
I0214 04:14:50.127264 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 81/120
I0214 04:14:51.128899 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 82/120
I0214 04:14:52.130443 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 83/120
I0214 04:14:53.131892 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 84/120
I0214 04:14:54.134071 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 85/120
I0214 04:14:55.135404 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 86/120
I0214 04:14:56.136841 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 87/120
I0214 04:14:57.138248 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 88/120
I0214 04:14:58.139672 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 89/120
I0214 04:14:59.141965 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 90/120
I0214 04:15:00.143388 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 91/120
I0214 04:15:01.144747 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 92/120
I0214 04:15:02.146150 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 93/120
I0214 04:15:03.147612 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 94/120
I0214 04:15:04.149790 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 95/120
I0214 04:15:05.151619 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 96/120
I0214 04:15:06.153149 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 97/120
I0214 04:15:07.154540 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 98/120
I0214 04:15:08.155822 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 99/120
I0214 04:15:09.157990 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 100/120
I0214 04:15:10.159374 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 101/120
I0214 04:15:11.160803 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 102/120
I0214 04:15:12.162435 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 103/120
I0214 04:15:13.163819 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 104/120
I0214 04:15:14.166025 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 105/120
I0214 04:15:15.167504 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 106/120
I0214 04:15:16.168898 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 107/120
I0214 04:15:17.170388 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 108/120
I0214 04:15:18.171953 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 109/120
I0214 04:15:19.174291 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 110/120
I0214 04:15:20.175858 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 111/120
I0214 04:15:21.177306 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 112/120
I0214 04:15:22.178695 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 113/120
I0214 04:15:23.179954 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 114/120
I0214 04:15:24.182040 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 115/120
I0214 04:15:25.183504 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 116/120
I0214 04:15:26.184999 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 117/120
I0214 04:15:27.186425 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 118/120
I0214 04:15:28.187875 1547454 main.go:141] libmachine: (embed-certs-722906) Waiting for machine to stop 119/120
I0214 04:15:29.188825 1547454 stop.go:66] stop err: unable to stop vm, current state "Running"
W0214 04:15:29.188902 1547454 stop.go:165] stop host returned error: Temporary Error: stop: unable to stop vm, current state "Running"
I0214 04:15:29.190873 1547454 out.go:177]
W0214 04:15:29.192473 1547454 out.go:239] X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
W0214 04:15:29.192494 1547454 out.go:239] *
*
W0214 04:15:29.197676 1547454 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0214 04:15:29.199124 1547454 out.go:177]
** /stderr **
start_stop_delete_test.go:230: failed stopping minikube - first stop-. args "out/minikube-linux-amd64 stop -p embed-certs-722906 --alsologtostderr -v=3" : exit status 82
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906: exit status 3 (18.60497144s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:15:47.805624 1548128 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.50.108:22: connect: no route to host
E0214 04:15:47.805647 1548128 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.50.108:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "embed-certs-722906" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/embed-certs/serial/Stop (139.08s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p default-k8s-diff-port-224675 --alsologtostderr -v=3
E0214 04:13:52.697479 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:52.702726 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:52.712994 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:52.733328 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:52.773681 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:52.854074 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:53.014542 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:53.335488 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:53.976048 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:55.257305 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:13:57.817552 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:14:02.937723 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:14:13.178323 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:14:18.020302 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:18.025654 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:18.035860 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:18.056213 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:18.096884 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:18.177287 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:18.337917 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:18.658558 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:19.299059 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:20.579266 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:23.139799 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:28.260572 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:14:33.659413 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:14:38.501220 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p default-k8s-diff-port-224675 --alsologtostderr -v=3: exit status 82 (2m0.434589696s)
-- stdout --
* Stopping node "default-k8s-diff-port-224675" ...
-- /stdout --
** stderr **
I0214 04:13:49.552554 1547591 out.go:291] Setting OutFile to fd 1 ...
I0214 04:13:49.552725 1547591 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:13:49.552738 1547591 out.go:304] Setting ErrFile to fd 2...
I0214 04:13:49.552746 1547591 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:13:49.553041 1547591 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:13:49.553438 1547591 out.go:298] Setting JSON to false
I0214 04:13:49.553550 1547591 mustload.go:65] Loading cluster: default-k8s-diff-port-224675
I0214 04:13:49.554155 1547591 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:13:49.554300 1547591 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:13:49.554533 1547591 mustload.go:65] Loading cluster: default-k8s-diff-port-224675
I0214 04:13:49.554705 1547591 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:13:49.554757 1547591 stop.go:39] StopHost: default-k8s-diff-port-224675
I0214 04:13:49.555387 1547591 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:13:49.555458 1547591 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:13:49.571142 1547591 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37863
I0214 04:13:49.571731 1547591 main.go:141] libmachine: () Calling .GetVersion
I0214 04:13:49.572399 1547591 main.go:141] libmachine: Using API Version 1
I0214 04:13:49.572428 1547591 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:13:49.572889 1547591 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:13:49.575672 1547591 out.go:177] * Stopping node "default-k8s-diff-port-224675" ...
I0214 04:13:49.577035 1547591 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]
I0214 04:13:49.577071 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:13:49.577349 1547591 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup
I0214 04:13:49.577378 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:13:49.580983 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:13:49.581590 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:12:21 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:13:49.581629 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:13:49.581768 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:13:49.581984 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:13:49.582165 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:13:49.582328 1547591 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:13:49.698313 1547591 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/cni /var/lib/minikube/backup
I0214 04:13:49.708718 1547591 ssh_runner.go:195] Run: sudo cp --archive --parents --force /etc/kubernetes /var/lib/minikube/backup
I0214 04:13:49.719478 1547591 main.go:141] libmachine: Stopping "default-k8s-diff-port-224675"...
I0214 04:13:49.719524 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:13:49.721221 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Stop
I0214 04:13:49.724800 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 0/120
I0214 04:13:50.726451 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 1/120
I0214 04:13:51.727844 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 2/120
I0214 04:13:52.729058 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 3/120
I0214 04:13:53.730474 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 4/120
I0214 04:13:54.732722 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 5/120
I0214 04:13:55.734294 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 6/120
I0214 04:13:56.735641 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 7/120
I0214 04:13:57.737134 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 8/120
I0214 04:13:58.738566 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 9/120
I0214 04:13:59.740914 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 10/120
I0214 04:14:00.742373 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 11/120
I0214 04:14:01.743868 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 12/120
I0214 04:14:02.745305 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 13/120
I0214 04:14:03.746672 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 14/120
I0214 04:14:04.748756 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 15/120
I0214 04:14:05.750221 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 16/120
I0214 04:14:06.751631 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 17/120
I0214 04:14:07.752984 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 18/120
I0214 04:14:08.754292 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 19/120
I0214 04:14:09.755871 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 20/120
I0214 04:14:10.757311 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 21/120
I0214 04:14:11.758655 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 22/120
I0214 04:14:12.760043 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 23/120
I0214 04:14:13.761331 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 24/120
I0214 04:14:14.763585 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 25/120
I0214 04:14:15.764973 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 26/120
I0214 04:14:16.766335 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 27/120
I0214 04:14:17.767708 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 28/120
I0214 04:14:18.769113 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 29/120
I0214 04:14:19.771806 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 30/120
I0214 04:14:20.773197 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 31/120
I0214 04:14:21.774690 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 32/120
I0214 04:14:22.776437 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 33/120
I0214 04:14:23.777848 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 34/120
I0214 04:14:24.779921 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 35/120
I0214 04:14:25.781230 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 36/120
I0214 04:14:26.782724 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 37/120
I0214 04:14:27.784075 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 38/120
I0214 04:14:28.785595 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 39/120
I0214 04:14:29.787163 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 40/120
I0214 04:14:30.788704 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 41/120
I0214 04:14:31.790057 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 42/120
I0214 04:14:32.791839 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 43/120
I0214 04:14:33.793339 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 44/120
I0214 04:14:34.795558 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 45/120
I0214 04:14:35.797139 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 46/120
I0214 04:14:36.798774 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 47/120
I0214 04:14:37.800223 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 48/120
I0214 04:14:38.801455 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 49/120
I0214 04:14:39.803823 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 50/120
I0214 04:14:40.805127 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 51/120
I0214 04:14:41.806391 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 52/120
I0214 04:14:42.807934 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 53/120
I0214 04:14:43.809352 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 54/120
I0214 04:14:44.811391 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 55/120
I0214 04:14:45.812831 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 56/120
I0214 04:14:46.814209 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 57/120
I0214 04:14:47.815648 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 58/120
I0214 04:14:48.816902 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 59/120
I0214 04:14:49.819525 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 60/120
I0214 04:14:50.820967 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 61/120
I0214 04:14:51.822835 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 62/120
I0214 04:14:52.824415 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 63/120
I0214 04:14:53.826006 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 64/120
I0214 04:14:54.828068 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 65/120
I0214 04:14:55.829640 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 66/120
I0214 04:14:56.831118 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 67/120
I0214 04:14:57.832657 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 68/120
I0214 04:14:58.834169 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 69/120
I0214 04:14:59.836446 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 70/120
I0214 04:15:00.838447 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 71/120
I0214 04:15:01.839733 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 72/120
I0214 04:15:02.841418 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 73/120
I0214 04:15:03.842775 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 74/120
I0214 04:15:04.844965 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 75/120
I0214 04:15:05.846242 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 76/120
I0214 04:15:06.847449 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 77/120
I0214 04:15:07.848748 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 78/120
I0214 04:15:08.849991 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 79/120
I0214 04:15:09.851300 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 80/120
I0214 04:15:10.852690 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 81/120
I0214 04:15:11.854198 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 82/120
I0214 04:15:12.855567 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 83/120
I0214 04:15:13.857053 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 84/120
I0214 04:15:14.859346 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 85/120
I0214 04:15:15.860863 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 86/120
I0214 04:15:16.862403 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 87/120
I0214 04:15:17.863873 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 88/120
I0214 04:15:18.865649 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 89/120
I0214 04:15:19.867944 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 90/120
I0214 04:15:20.869592 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 91/120
I0214 04:15:21.871089 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 92/120
I0214 04:15:22.872607 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 93/120
I0214 04:15:23.874074 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 94/120
I0214 04:15:24.875947 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 95/120
I0214 04:15:25.877324 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 96/120
I0214 04:15:26.878896 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 97/120
I0214 04:15:27.880365 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 98/120
I0214 04:15:28.881902 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 99/120
I0214 04:15:29.884173 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 100/120
I0214 04:15:30.885551 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 101/120
I0214 04:15:31.887075 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 102/120
I0214 04:15:32.888572 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 103/120
I0214 04:15:33.889888 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 104/120
I0214 04:15:34.892106 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 105/120
I0214 04:15:35.893656 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 106/120
I0214 04:15:36.895131 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 107/120
I0214 04:15:37.896877 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 108/120
I0214 04:15:38.898607 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 109/120
I0214 04:15:39.901042 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 110/120
I0214 04:15:40.902575 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 111/120
I0214 04:15:41.903998 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 112/120
I0214 04:15:42.905390 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 113/120
I0214 04:15:43.906849 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 114/120
I0214 04:15:44.909008 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 115/120
I0214 04:15:45.910447 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 116/120
I0214 04:15:46.911850 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 117/120
I0214 04:15:47.912670 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 118/120
I0214 04:15:48.914092 1547591 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for machine to stop 119/120
I0214 04:15:49.915310 1547591 stop.go:66] stop err: unable to stop vm, current state "Running"
W0214 04:15:49.915383 1547591 stop.go:165] stop host returned error: Temporary Error: stop: unable to stop vm, current state "Running"
I0214 04:15:49.917414 1547591 out.go:177]
W0214 04:15:49.918984 1547591 out.go:239] X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: Temporary Error: stop: unable to stop vm, current state "Running"
W0214 04:15:49.918997 1547591 out.go:239] *
*
W0214 04:15:49.924143 1547591 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_1.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0214 04:15:49.925503 1547591 out.go:177]
** /stderr **
start_stop_delete_test.go:230: failed stopping minikube - first stop-. args "out/minikube-linux-amd64 stop -p default-k8s-diff-port-224675 --alsologtostderr -v=3" : exit status 82
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
E0214 04:15:50.025986 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:50.031248 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:50.041485 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:50.061745 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:50.102042 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:50.182444 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:50.342845 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:50.663492 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675: exit status 3 (18.614245592s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:16:08.541616 1548310 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.61.188:22: connect: no route to host
E0214 04:16:08.541638 1548310 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.61.188:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-224675" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Stop (139.05s)
=== RUN TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884
E0214 04:15:07.672597 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:15:10.233715 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884: exit status 3 (3.167716632s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:15:10.269583 1547898 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.72.206:22: connect: no route to host
E0214 04:15:10.269607 1547898 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.72.206:22: connect: no route to host
** /stderr **
start_stop_delete_test.go:239: status error: exit status 3 (may be ok)
start_stop_delete_test.go:241: expected post-stop host status to be -"Stopped"- but got *"Error"*
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-960884 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
E0214 04:15:14.619794 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:15:15.353909 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
start_stop_delete_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-960884 --images=MetricsScraper=registry.k8s.io/echoserver:1.4: exit status 11 (6.156192358s)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: crictl list: NewSession: new client: new client: dial tcp 192.168.72.206:22: connect: no route to host
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_a2d68fa011bbbda55500e636dff79fec124b29e3_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:248: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-960884 --images=MetricsScraper=registry.k8s.io/echoserver:1.4": exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884: exit status 3 (3.059830922s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:15:19.485709 1547968 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.72.206:22: connect: no route to host
E0214 04:15:19.485737 1547968 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.72.206:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "old-k8s-version-960884" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (12.38s)
=== RUN TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067
E0214 04:15:25.594171 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067: exit status 3 (3.199972463s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:15:27.453643 1548069 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.167:22: connect: no route to host
E0214 04:15:27.453665 1548069 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.39.167:22: connect: no route to host
** /stderr **
start_stop_delete_test.go:239: status error: exit status 3 (may be ok)
start_stop_delete_test.go:241: expected post-stop host status to be -"Stopped"- but got *"Error"*
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p no-preload-527067 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
start_stop_delete_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p no-preload-527067 --images=MetricsScraper=registry.k8s.io/echoserver:1.4: exit status 11 (6.155785666s)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: crictl list: NewSession: new client: new client: dial tcp 192.168.39.167:22: connect: no route to host
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_a2d68fa011bbbda55500e636dff79fec124b29e3_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:248: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable dashboard -p no-preload-527067 --images=MetricsScraper=registry.k8s.io/echoserver:1.4": exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067: exit status 3 (3.059867455s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:15:36.669753 1548169 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.167:22: connect: no route to host
E0214 04:15:36.669787 1548169 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.39.167:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "no-preload-527067" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (12.42s)
=== RUN TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906: exit status 3 (3.199844014s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:15:51.005635 1548267 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.50.108:22: connect: no route to host
E0214 04:15:51.005662 1548267 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.50.108:22: connect: no route to host
** /stderr **
start_stop_delete_test.go:239: status error: exit status 3 (may be ok)
start_stop_delete_test.go:241: expected post-stop host status to be -"Stopped"- but got *"Error"*
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p embed-certs-722906 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
E0214 04:15:51.304743 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:52.585531 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:55.146302 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:15:56.222970 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
start_stop_delete_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p embed-certs-722906 --images=MetricsScraper=registry.k8s.io/echoserver:1.4: exit status 11 (6.154932667s)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: crictl list: NewSession: new client: new client: dial tcp 192.168.50.108:22: connect: no route to host
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_a2d68fa011bbbda55500e636dff79fec124b29e3_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:248: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable dashboard -p embed-certs-722906 --images=MetricsScraper=registry.k8s.io/echoserver:1.4": exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906: exit status 3 (3.060465082s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:16:00.221675 1548375 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.50.108:22: connect: no route to host
E0214 04:16:00.221702 1548375 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.50.108:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "embed-certs-722906" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (12.42s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
E0214 04:16:10.508026 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675: exit status 3 (3.199563287s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:16:11.741590 1548490 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.61.188:22: connect: no route to host
E0214 04:16:11.741613 1548490 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.61.188:22: connect: no route to host
** /stderr **
start_stop_delete_test.go:239: status error: exit status 3 (may be ok)
start_stop_delete_test.go:241: expected post-stop host status to be -"Stopped"- but got *"Error"*
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-224675 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
E0214 04:16:13.611705 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
start_stop_delete_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-224675 --images=MetricsScraper=registry.k8s.io/echoserver:1.4: exit status 11 (6.156605724s)
-- stdout --
-- /stdout --
** stderr **
X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: crictl list: NewSession: new client: new client: dial tcp 192.168.61.188:22: connect: no route to host
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_addons_a2d68fa011bbbda55500e636dff79fec124b29e3_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
start_stop_delete_test.go:248: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-224675 --images=MetricsScraper=registry.k8s.io/echoserver:1.4": exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675: exit status 3 (3.059317398s)
-- stdout --
Error
-- /stdout --
** stderr **
E0214 04:16:20.957761 1548560 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.61.188:22: connect: no route to host
E0214 04:16:20.957788 1548560 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.61.188:22: connect: no route to host
** /stderr **
helpers_test.go:239: status error: exit status 3 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-224675" host is not running, skipping log retrieval (state="Error")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (12.42s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
E0214 04:25:50.025776 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
start_stop_delete_test.go:274: ***** TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:274: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
start_stop_delete_test.go:274: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: showing logs for failed pods as of 2024-02-14 04:34:43.374312097 +0000 UTC m=+6400.338929694
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
helpers_test.go:244: <<< TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p default-k8s-diff-port-224675 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p default-k8s-diff-port-224675 logs -n 25: (1.626175109s)
helpers_test.go:252: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p bridge-528898 sudo cat | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | containerd config dump | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p bridge-528898 sudo find | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p bridge-528898 sudo crio | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:12 UTC |
| | config | | | | | |
| delete | -p bridge-528898 | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| delete | -p | disable-driver-mounts-648156 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | disable-driver-mounts-648156 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:13 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable metrics-server -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | default-k8s-diff-port-224675 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable dashboard -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:26 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable dashboard -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:16:21
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:16:21.016222 1548589 out.go:291] Setting OutFile to fd 1 ...
I0214 04:16:21.016364 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016373 1548589 out.go:304] Setting ErrFile to fd 2...
I0214 04:16:21.016378 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016548 1548589 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:16:21.017128 1548589 out.go:298] Setting JSON to false
I0214 04:16:21.018088 1548589 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":25128,"bootTime":1707859053,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:16:21.018154 1548589 start.go:138] virtualization: kvm guest
I0214 04:16:21.020869 1548589 out.go:177] * [default-k8s-diff-port-224675] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:16:21.022663 1548589 notify.go:220] Checking for updates...
I0214 04:16:21.022671 1548589 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:16:21.024231 1548589 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:16:21.025835 1548589 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:16:21.027384 1548589 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:16:21.028899 1548589 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:16:21.030391 1548589 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:16:21.032286 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:16:21.032695 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.032740 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.048006 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36251
I0214 04:16:21.048486 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.049074 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.049097 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.049529 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.049715 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.049979 1548589 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:16:21.050268 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.050306 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.064529 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34885
I0214 04:16:21.064932 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.065386 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.065417 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.065713 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.065881 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.102150 1548589 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:16:21.104036 1548589 start.go:296] selected driver: kvm2
I0214 04:16:21.104047 1548589 start.go:900] validating driver "kvm2" against &{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisk
s:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.104144 1548589 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:16:21.104799 1548589 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.104878 1548589 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:16:21.119570 1548589 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:16:21.119934 1548589 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:16:21.120000 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:16:21.120015 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:16:21.120050 1548589 start.go:339] cluster config:
{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Names
pace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.120145 1548589 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.122309 1548589 out.go:177] * Starting "default-k8s-diff-port-224675" primary control-plane node in "default-k8s-diff-port-224675" cluster
I0214 04:16:20.509543 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:23.581533 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:21.123776 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:16:21.123806 1548589 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 04:16:21.123816 1548589 cache.go:56] Caching tarball of preloaded images
I0214 04:16:21.123877 1548589 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:16:21.123887 1548589 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 04:16:21.123977 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:16:21.124153 1548589 start.go:360] acquireMachinesLock for default-k8s-diff-port-224675: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:16:29.661593 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:32.733584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:38.813574 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:41.885576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:47.965558 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:51.037514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:57.117639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:00.189564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:06.269549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:09.341644 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:15.421514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:18.493573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:24.573561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:27.645587 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:33.725630 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:36.797500 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:42.877547 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:45.949563 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:52.029594 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:55.101598 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:01.181611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:04.253573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:10.333576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:13.405584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:19.485564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:22.557519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:28.637560 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:31.709570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:37.789577 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:40.861658 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:46.941582 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:50.013561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:56.093507 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:59.165639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:05.245643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:08.317643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:14.397568 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:17.469610 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:23.549636 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:26.621578 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:32.701570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:35.773525 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:41.853530 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:44.925611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:51.005519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:54.077549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:57.080691 1548199 start.go:364] duration metric: took 4m20.251500972s to acquireMachinesLock for "no-preload-527067"
I0214 04:19:57.080766 1548199 start.go:96] Skipping create...Using existing machine configuration
I0214 04:19:57.080773 1548199 fix.go:54] fixHost starting:
I0214 04:19:57.081118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:19:57.081148 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:19:57.096555 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44277
I0214 04:19:57.097002 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:19:57.097550 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:19:57.097577 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:19:57.097855 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:19:57.098034 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:19:57.098149 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:19:57.099876 1548199 fix.go:112] recreateIfNeeded on no-preload-527067: state=Stopped err=<nil>
I0214 04:19:57.099914 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
W0214 04:19:57.100102 1548199 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:19:57.102069 1548199 out.go:177] * Restarting existing kvm2 VM for "no-preload-527067" ...
I0214 04:19:57.077816 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:19:57.077865 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078255 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:19:57.078287 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078566 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:19:57.080537 1548015 machine.go:97] duration metric: took 4m37.408761431s to provisionDockerMachine
I0214 04:19:57.080584 1548015 fix.go:56] duration metric: took 4m37.431215989s for fixHost
I0214 04:19:57.080596 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 4m37.431242855s
W0214 04:19:57.080624 1548015 start.go:713] error starting host: provision: host is not running
W0214 04:19:57.080748 1548015 out.go:239] ! StartHost failed, but will try again: provision: host is not running
I0214 04:19:57.080758 1548015 start.go:728] Will try again in 5 seconds ...
I0214 04:19:57.103328 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Start
I0214 04:19:57.103512 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring networks are active...
I0214 04:19:57.104245 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network default is active
I0214 04:19:57.104698 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network mk-no-preload-527067 is active
I0214 04:19:57.105038 1548199 main.go:141] libmachine: (no-preload-527067) Getting domain xml...
I0214 04:19:57.105698 1548199 main.go:141] libmachine: (no-preload-527067) Creating domain...
I0214 04:19:58.292262 1548199 main.go:141] libmachine: (no-preload-527067) Waiting to get IP...
I0214 04:19:58.293277 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.293718 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.293762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.293632 1549610 retry.go:31] will retry after 307.836827ms: waiting for machine to come up
I0214 04:19:58.603354 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.603935 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.603965 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.603876 1549610 retry.go:31] will retry after 375.894078ms: waiting for machine to come up
I0214 04:19:58.981513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.981981 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.982015 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.981916 1549610 retry.go:31] will retry after 451.678342ms: waiting for machine to come up
I0214 04:19:59.435521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.435921 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.435961 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.435861 1549610 retry.go:31] will retry after 481.719322ms: waiting for machine to come up
I0214 04:19:59.919474 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.919914 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.919949 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.919839 1549610 retry.go:31] will retry after 586.359357ms: waiting for machine to come up
I0214 04:20:00.507667 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:00.508169 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:00.508197 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:00.508112 1549610 retry.go:31] will retry after 703.740251ms: waiting for machine to come up
I0214 04:20:01.213009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:01.213504 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:01.213531 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:01.213452 1549610 retry.go:31] will retry after 979.462057ms: waiting for machine to come up
I0214 04:20:02.082344 1548015 start.go:360] acquireMachinesLock for old-k8s-version-960884: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:20:02.194117 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:02.194497 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:02.194521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:02.194467 1549610 retry.go:31] will retry after 1.278763641s: waiting for machine to come up
I0214 04:20:03.474465 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:03.474892 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:03.474922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:03.474853 1549610 retry.go:31] will retry after 1.500263985s: waiting for machine to come up
I0214 04:20:04.977136 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:04.977601 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:04.977627 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:04.977565 1549610 retry.go:31] will retry after 2.055604163s: waiting for machine to come up
I0214 04:20:07.036030 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:07.036483 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:07.036527 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:07.036415 1549610 retry.go:31] will retry after 2.711272112s: waiting for machine to come up
I0214 04:20:09.750977 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:09.751371 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:09.751404 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:09.751317 1549610 retry.go:31] will retry after 2.924789693s: waiting for machine to come up
I0214 04:20:12.678157 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:12.678553 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:12.678615 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:12.678494 1549610 retry.go:31] will retry after 3.785040141s: waiting for machine to come up
I0214 04:20:16.468466 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468926 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has current primary IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468949 1548199 main.go:141] libmachine: (no-preload-527067) Found IP for machine: 192.168.39.167
I0214 04:20:16.468966 1548199 main.go:141] libmachine: (no-preload-527067) Reserving static IP address...
I0214 04:20:16.469414 1548199 main.go:141] libmachine: (no-preload-527067) Reserved static IP address: 192.168.39.167
I0214 04:20:16.469449 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.469476 1548199 main.go:141] libmachine: (no-preload-527067) Waiting for SSH to be available...
I0214 04:20:16.469513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | skip adding static IP to network mk-no-preload-527067 - found existing host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"}
I0214 04:20:16.469530 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Getting to WaitForSSH function...
I0214 04:20:16.471450 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471707 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.471728 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471812 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH client type: external
I0214 04:20:16.471845 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa (-rw-------)
I0214 04:20:16.471925 1548199 main.go:141] libmachine: (no-preload-527067) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.167 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:16.471947 1548199 main.go:141] libmachine: (no-preload-527067) DBG | About to run SSH command:
I0214 04:20:16.471958 1548199 main.go:141] libmachine: (no-preload-527067) DBG | exit 0
I0214 04:20:16.557177 1548199 main.go:141] libmachine: (no-preload-527067) DBG | SSH cmd err, output: <nil>:
I0214 04:20:16.557638 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetConfigRaw
I0214 04:20:16.558256 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.560907 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561244 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.561290 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561493 1548199 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/config.json ...
I0214 04:20:16.561699 1548199 machine.go:94] provisionDockerMachine start ...
I0214 04:20:16.561722 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:16.561930 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.564237 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564637 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.564664 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.565051 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565394 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.565620 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.565992 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.566004 1548199 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:16.673468 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:16.673502 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.673763 1548199 buildroot.go:166] provisioning hostname "no-preload-527067"
I0214 04:20:16.673799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.674010 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.676849 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677243 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.677291 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677404 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.677612 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677784 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677899 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.678062 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.678523 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.678543 1548199 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-527067 && echo "no-preload-527067" | sudo tee /etc/hostname
I0214 04:20:17.989797 1548416 start.go:364] duration metric: took 4m17.605388932s to acquireMachinesLock for "embed-certs-722906"
I0214 04:20:17.989877 1548416 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:17.989886 1548416 fix.go:54] fixHost starting:
I0214 04:20:17.990389 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:17.990441 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:18.007849 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36303
I0214 04:20:18.008367 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:18.008941 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:20:18.008970 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:18.009367 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:18.009556 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:18.009721 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:20:18.011258 1548416 fix.go:112] recreateIfNeeded on embed-certs-722906: state=Stopped err=<nil>
I0214 04:20:18.011289 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
W0214 04:20:18.011467 1548416 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:18.013874 1548416 out.go:177] * Restarting existing kvm2 VM for "embed-certs-722906" ...
I0214 04:20:16.797274 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-527067
I0214 04:20:16.797308 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.800396 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.800792 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800948 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.801172 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801409 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801569 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.801716 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.802024 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.802041 1548199 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-527067' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-527067/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-527067' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:16.921808 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:16.921851 1548199 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:16.921907 1548199 buildroot.go:174] setting up certificates
I0214 04:20:16.921921 1548199 provision.go:84] configureAuth start
I0214 04:20:16.921942 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.922243 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.924941 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925246 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.925294 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925448 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.927542 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.927839 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.927881 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.928073 1548199 provision.go:143] copyHostCerts
I0214 04:20:16.928185 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:16.928201 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:16.928289 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:16.928403 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:16.928413 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:16.928442 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:16.928502 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:16.928509 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:16.928529 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:16.928578 1548199 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.no-preload-527067 san=[127.0.0.1 192.168.39.167 localhost minikube no-preload-527067]
I0214 04:20:17.305617 1548199 provision.go:177] copyRemoteCerts
I0214 04:20:17.305690 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:17.305716 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.308699 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309038 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.309061 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.309485 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.309657 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.309802 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.394912 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:17.416301 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0214 04:20:17.437138 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:17.457797 1548199 provision.go:87] duration metric: took 535.857617ms to configureAuth
I0214 04:20:17.457828 1548199 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:17.458050 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:20:17.458158 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.460939 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461355 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.461402 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461525 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.461750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.461928 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.462085 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.462252 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.462572 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.462588 1548199 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:17.755399 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:17.755434 1548199 machine.go:97] duration metric: took 1.19371818s to provisionDockerMachine
I0214 04:20:17.755449 1548199 start.go:293] postStartSetup for "no-preload-527067" (driver="kvm2")
I0214 04:20:17.755463 1548199 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:17.755479 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.755812 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:17.755844 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.758654 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.758940 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.758993 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.759135 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.759342 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.759503 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.759639 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.842683 1548199 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:17.847099 1548199 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:17.847127 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:17.847225 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:17.847324 1548199 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:17.847427 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:17.855667 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:17.878842 1548199 start.go:296] duration metric: took 123.375783ms for postStartSetup
I0214 04:20:17.878892 1548199 fix.go:56] duration metric: took 20.79811795s for fixHost
I0214 04:20:17.878923 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.881702 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.882041 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882222 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.882464 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882624 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882782 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.882993 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.883487 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.883502 1548199 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:17.989605 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884417.936736993
I0214 04:20:17.989641 1548199 fix.go:216] guest clock: 1707884417.936736993
I0214 04:20:17.989651 1548199 fix.go:229] Guest: 2024-02-14 04:20:17.936736993 +0000 UTC Remote: 2024-02-14 04:20:17.878897601 +0000 UTC m=+281.200605630 (delta=57.839392ms)
I0214 04:20:17.989679 1548199 fix.go:200] guest clock delta is within tolerance: 57.839392ms
I0214 04:20:17.989697 1548199 start.go:83] releasing machines lock for "no-preload-527067", held for 20.908940374s
I0214 04:20:17.989737 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.990017 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:17.993106 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993551 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.993583 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994292 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994496 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994549 1548199 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:17.994608 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.994767 1548199 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:17.994851 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.997321 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997570 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997602 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997622 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997736 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.997968 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.998111 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.998159 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998305 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.998422 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.998602 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998747 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:18.106735 1548199 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:18.112352 1548199 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:18.256984 1548199 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:18.262909 1548199 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:18.262978 1548199 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:18.279371 1548199 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:18.279399 1548199 start.go:494] detecting cgroup driver to use...
I0214 04:20:18.279462 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:18.294016 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:18.307013 1548199 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:18.307077 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:18.320441 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:18.334729 1548199 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:18.435265 1548199 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:18.543248 1548199 docker.go:233] disabling docker service ...
I0214 04:20:18.543333 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:18.555985 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:18.566967 1548199 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:18.680096 1548199 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:18.798889 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:18.813158 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:18.831387 1548199 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:18.831446 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.841300 1548199 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:18.841352 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.851097 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.860948 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.870710 1548199 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:18.880195 1548199 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:18.889041 1548199 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:18.889111 1548199 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:18.902760 1548199 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:18.912155 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:19.032843 1548199 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:19.218049 1548199 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:19.218136 1548199 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:19.223483 1548199 start.go:562] Will wait 60s for crictl version
I0214 04:20:19.223562 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.227341 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:19.269198 1548199 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:19.269316 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.314795 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.363241 1548199 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on CRI-O 1.24.1 ...
I0214 04:20:18.015330 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Start
I0214 04:20:18.015514 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring networks are active...
I0214 04:20:18.016153 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network default is active
I0214 04:20:18.016585 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network mk-embed-certs-722906 is active
I0214 04:20:18.017058 1548416 main.go:141] libmachine: (embed-certs-722906) Getting domain xml...
I0214 04:20:18.017739 1548416 main.go:141] libmachine: (embed-certs-722906) Creating domain...
I0214 04:20:19.267998 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting to get IP...
I0214 04:20:19.269071 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.269626 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.269744 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.269612 1549739 retry.go:31] will retry after 206.534163ms: waiting for machine to come up
I0214 04:20:19.478352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.478984 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.479109 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.479039 1549739 retry.go:31] will retry after 329.891336ms: waiting for machine to come up
I0214 04:20:19.810738 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.811201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.811225 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.811148 1549739 retry.go:31] will retry after 297.899998ms: waiting for machine to come up
I0214 04:20:20.110861 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.111307 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.111340 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.111260 1549739 retry.go:31] will retry after 483.120653ms: waiting for machine to come up
I0214 04:20:19.364761 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:19.367698 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368111 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:19.368141 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368326 1548199 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 04:20:19.372316 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:19.384595 1548199 kubeadm.go:877] updating cluster {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m
0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:19.384737 1548199 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:20:19.384782 1548199 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:19.428992 1548199 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.29.0-rc.2". assuming images are not preloaded.
I0214 04:20:19.429025 1548199 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.29.0-rc.2 registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 registry.k8s.io/kube-scheduler:v1.29.0-rc.2 registry.k8s.io/kube-proxy:v1.29.0-rc.2 registry.k8s.io/pause:3.9 registry.k8s.io/etcd:3.5.10-0 registry.k8s.io/coredns/coredns:v1.11.1 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.429150 1548199 image.go:134] retrieving image: registry.k8s.io/pause:3.9
I0214 04:20:19.429159 1548199 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.429177 1548199 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.429328 1548199 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.429332 1548199 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.429351 1548199 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.431104 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.431106 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.431123 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.431216 1548199 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.431226 1548199 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
I0214 04:20:19.431239 1548199 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.431291 1548199 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.431826 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.613887 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.614261 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.626641 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.9
I0214 04:20:19.630913 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.638603 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.652797 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.654940 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.656778 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.698298 1548199 cache_images.go:116] "registry.k8s.io/etcd:3.5.10-0" needs transfer: "registry.k8s.io/etcd:3.5.10-0" does not exist at hash "a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7" in container runtime
I0214 04:20:19.698355 1548199 cri.go:218] Removing image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.698414 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.757753 1548199 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" does not exist at hash "bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f" in container runtime
I0214 04:20:19.757810 1548199 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.757870 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941144 1548199 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" does not exist at hash "4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210" in container runtime
I0214 04:20:19.941166 1548199 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.11.1" needs transfer: "registry.k8s.io/coredns/coredns:v1.11.1" does not exist at hash "cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4" in container runtime
I0214 04:20:19.941188 1548199 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime
I0214 04:20:19.941198 1548199 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.941201 1548199 cri.go:218] Removing image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.941205 1548199 cri.go:218] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941337 1548199 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" does not exist at hash "d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d" in container runtime
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941382 1548199 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.941415 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941482 1548199 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-proxy:v1.29.0-rc.2" does not exist at hash "cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834" in container runtime
I0214 04:20:19.941506 1548199 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.941537 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941549 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.941643 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.955388 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.955421 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.969125 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.969198 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.969166 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:20.061499 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
I0214 04:20:20.061591 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.061633 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.061699 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.094179 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094180 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
I0214 04:20:20.094312 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094395 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:20.124555 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
I0214 04:20:20.124585 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124670 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:20.124703 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124677 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124746 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/etcd_3.5.10-0 (exists)
I0214 04:20:20.124760 1548199 crio.go:257] Loading image: /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124793 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124803 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2 (exists)
I0214 04:20:20.124829 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124877 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2 (exists)
I0214 04:20:20.124902 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/storage-provisioner_v5 (exists)
I0214 04:20:20.136587 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/coredns_v1.11.1 (exists)
I0214 04:20:20.136626 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2 (exists)
I0214 04:20:20.595903 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.596479 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.596504 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.596431 1549739 retry.go:31] will retry after 541.170149ms: waiting for machine to come up
I0214 04:20:21.139128 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.139587 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.139619 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.139543 1549739 retry.go:31] will retry after 609.736734ms: waiting for machine to come up
I0214 04:20:21.750821 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.751430 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.751476 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.751373 1549739 retry.go:31] will retry after 889.762874ms: waiting for machine to come up
I0214 04:20:22.642380 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:22.642915 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:22.642966 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:22.642850 1549739 retry.go:31] will retry after 1.310308388s: waiting for machine to come up
I0214 04:20:23.954650 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:23.955082 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:23.955114 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:23.955032 1549739 retry.go:31] will retry after 1.186449176s: waiting for machine to come up
I0214 04:20:25.143888 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:25.144379 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:25.144409 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:25.144331 1549739 retry.go:31] will retry after 1.870374645s: waiting for machine to come up
I0214 04:20:24.103814 1548199 ssh_runner.go:235] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (3.97895084s)
I0214 04:20:24.103870 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2 (exists)
I0214 04:20:24.104023 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0: (3.979201042s)
I0214 04:20:24.104052 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 from cache
I0214 04:20:24.104094 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:24.104197 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:27.017422 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:27.017923 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:27.017949 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:27.017821 1549739 retry.go:31] will retry after 2.372344988s: waiting for machine to come up
I0214 04:20:29.391597 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:29.392177 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:29.392212 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:29.392127 1549739 retry.go:31] will retry after 2.760319549s: waiting for machine to come up
I0214 04:20:27.189223 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2: (3.084990766s)
I0214 04:20:27.189276 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 from cache
I0214 04:20:27.189310 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:27.189404 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:29.355802 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2: (2.166363074s)
I0214 04:20:29.355840 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 from cache
I0214 04:20:29.355881 1548199 crio.go:257] Loading image: /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:29.355951 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:30.013381 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
I0214 04:20:30.013438 1548199 crio.go:257] Loading image: /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:30.013501 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:32.155254 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:32.155727 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:32.155753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:32.155677 1549739 retry.go:31] will retry after 4.524050008s: waiting for machine to come up
I0214 04:20:31.977727 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1: (1.964188552s)
I0214 04:20:31.977769 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 from cache
I0214 04:20:31.977802 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:31.977872 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:34.535494 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2: (2.557583724s)
I0214 04:20:34.535538 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 from cache
I0214 04:20:34.535571 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:34.535624 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:35.791070 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (1.255414762s)
I0214 04:20:35.791122 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 from cache
I0214 04:20:35.791154 1548199 cache_images.go:123] Successfully loaded all cached images
I0214 04:20:35.791166 1548199 cache_images.go:92] duration metric: took 16.362124396s to LoadCachedImages
I0214 04:20:35.791179 1548199 kubeadm.go:928] updating node { 192.168.39.167 8443 v1.29.0-rc.2 crio true true} ...
I0214 04:20:35.791336 1548199 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-527067 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.167
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:35.791437 1548199 ssh_runner.go:195] Run: crio config
I0214 04:20:35.848895 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:20:35.848923 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:35.848935 1548199 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:35.848985 1548199 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.167 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-527067 NodeName:no-preload-527067 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.167"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.167 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:35.849152 1548199 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.167
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-527067"
kubeletExtraArgs:
node-ip: 192.168.39.167
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.167"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:35.849221 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0214 04:20:35.859377 1548199 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:35.859443 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:35.868486 1548199 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0214 04:20:35.885091 1548199 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0214 04:20:35.901749 1548199 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2166 bytes)
I0214 04:20:35.919596 1548199 ssh_runner.go:195] Run: grep 192.168.39.167 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:35.923203 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.167 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:35.934756 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:36.048443 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:36.063403 1548199 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067 for IP: 192.168.39.167
I0214 04:20:36.063423 1548199 certs.go:194] generating shared ca certs ...
I0214 04:20:36.063440 1548199 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:36.063607 1548199 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:36.063675 1548199 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:36.063691 1548199 certs.go:256] generating profile certs ...
I0214 04:20:36.063805 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/client.key
I0214 04:20:36.063903 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key.79c0eebd
I0214 04:20:36.063964 1548199 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key
I0214 04:20:36.064127 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:36.064168 1548199 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:36.064182 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:36.064220 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:36.064249 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:36.064281 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:36.064332 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:36.065313 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:36.101889 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:36.135234 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:36.168832 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:36.204188 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 04:20:36.230823 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 04:20:36.254917 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:36.282014 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:36.303131 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:36.323933 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:36.344419 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:36.365038 1548199 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:36.380645 1548199 ssh_runner.go:195] Run: openssl version
I0214 04:20:36.386091 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:36.395680 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399890 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399959 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.405132 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:36.415168 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:36.424870 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.428976 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.429025 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.434401 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:36.443848 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:36.453658 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457908 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457963 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.463066 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:36.472994 1548199 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:36.477141 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:36.482809 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:36.488342 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:36.493884 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:36.499087 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:36.504410 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:36.509751 1548199 kubeadm.go:391] StartCluster: {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29
.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s
Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:36.509849 1548199 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:36.509914 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.547323 1548199 cri.go:89] found id: ""
I0214 04:20:36.547408 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:36.556907 1548199 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:36.556928 1548199 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:36.556935 1548199 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:36.557012 1548199 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:36.566003 1548199 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:36.567328 1548199 kubeconfig.go:125] found "no-preload-527067" server: "https://192.168.39.167:8443"
I0214 04:20:36.570250 1548199 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:36.578772 1548199 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.167
I0214 04:20:36.578805 1548199 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:36.578819 1548199 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:36.578868 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.615271 1548199 cri.go:89] found id: ""
I0214 04:20:36.615369 1548199 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:36.631254 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:36.640513 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:36.640544 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:20:36.640605 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:36.649213 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:36.649289 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:36.658011 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:36.667277 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:36.667461 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:36.677535 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:36.686189 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:36.686248 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:36.696716 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:36.706405 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:36.706442 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:36.715622 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:36.725241 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.074017 1548589 start.go:364] duration metric: took 4m16.949827565s to acquireMachinesLock for "default-k8s-diff-port-224675"
I0214 04:20:38.074099 1548589 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:38.074107 1548589 fix.go:54] fixHost starting:
I0214 04:20:38.074546 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:38.074596 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:38.092223 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32909
I0214 04:20:38.092628 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:38.093091 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:20:38.093112 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:38.093545 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:38.093743 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:38.093902 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:20:38.095356 1548589 fix.go:112] recreateIfNeeded on default-k8s-diff-port-224675: state=Stopped err=<nil>
I0214 04:20:38.095385 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
W0214 04:20:38.095570 1548589 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:38.097728 1548589 out.go:177] * Restarting existing kvm2 VM for "default-k8s-diff-port-224675" ...
I0214 04:20:36.682303 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.682827 1548416 main.go:141] libmachine: (embed-certs-722906) Found IP for machine: 192.168.50.108
I0214 04:20:36.682865 1548416 main.go:141] libmachine: (embed-certs-722906) Reserving static IP address...
I0214 04:20:36.682884 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has current primary IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.683294 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.683326 1548416 main.go:141] libmachine: (embed-certs-722906) Reserved static IP address: 192.168.50.108
I0214 04:20:36.683352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | skip adding static IP to network mk-embed-certs-722906 - found existing host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"}
I0214 04:20:36.683370 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Getting to WaitForSSH function...
I0214 04:20:36.683386 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting for SSH to be available...
I0214 04:20:36.685555 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.685877 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.685912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.686044 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH client type: external
I0214 04:20:36.686073 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa (-rw-------)
I0214 04:20:36.686108 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.108 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:36.686121 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | About to run SSH command:
I0214 04:20:36.686136 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | exit 0
I0214 04:20:36.777374 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | SSH cmd err, output: <nil>:
I0214 04:20:36.777749 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetConfigRaw
I0214 04:20:36.778583 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:36.781415 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.781891 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.781918 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.782292 1548416 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/config.json ...
I0214 04:20:36.782531 1548416 machine.go:94] provisionDockerMachine start ...
I0214 04:20:36.782576 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:36.782816 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.785327 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.785737 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785996 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.786168 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786327 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786501 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.786710 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.787196 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.787214 1548416 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:36.905657 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:36.905687 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.905964 1548416 buildroot.go:166] provisioning hostname "embed-certs-722906"
I0214 04:20:36.905990 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.906183 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.909442 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.909874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.909912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.910070 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.910262 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910445 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910582 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.910738 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.911264 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.911289 1548416 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-722906 && echo "embed-certs-722906" | sudo tee /etc/hostname
I0214 04:20:37.046181 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-722906
I0214 04:20:37.046216 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.049414 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.049785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.049819 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.050075 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.050291 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050646 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.050842 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.051191 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.051235 1548416 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-722906' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-722906/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-722906' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:37.177589 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:37.177622 1548416 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:37.177646 1548416 buildroot.go:174] setting up certificates
I0214 04:20:37.177657 1548416 provision.go:84] configureAuth start
I0214 04:20:37.177668 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:37.178023 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:37.181013 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181404 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.181435 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181606 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.183959 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184300 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.184329 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184472 1548416 provision.go:143] copyHostCerts
I0214 04:20:37.184534 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:37.184544 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:37.184594 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:37.184678 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:37.184685 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:37.184710 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:37.184785 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:37.184794 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:37.184813 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:37.184881 1548416 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.embed-certs-722906 san=[127.0.0.1 192.168.50.108 embed-certs-722906 localhost minikube]
I0214 04:20:37.334150 1548416 provision.go:177] copyRemoteCerts
I0214 04:20:37.334225 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:37.334258 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.336874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337245 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.337299 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337492 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.337693 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.337868 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.338016 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.424211 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:37.448257 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0214 04:20:37.472132 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:20:37.496606 1548416 provision.go:87] duration metric: took 318.923431ms to configureAuth
I0214 04:20:37.496633 1548416 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:37.496815 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:37.496904 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.499706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500129 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.500174 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500359 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.500566 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500738 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500873 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.501094 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.501587 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.501614 1548416 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:37.814749 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:37.814781 1548416 machine.go:97] duration metric: took 1.032234304s to provisionDockerMachine
I0214 04:20:37.814796 1548416 start.go:293] postStartSetup for "embed-certs-722906" (driver="kvm2")
I0214 04:20:37.814811 1548416 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:37.814848 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:37.815206 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:37.815237 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.818201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818621 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.818644 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818819 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.819026 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.819221 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.819386 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.913636 1548416 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:37.919126 1548416 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:37.919153 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:37.919231 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:37.919328 1548416 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:37.919441 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:37.930902 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:37.955477 1548416 start.go:296] duration metric: took 140.651894ms for postStartSetup
I0214 04:20:37.955515 1548416 fix.go:56] duration metric: took 19.965630101s for fixHost
I0214 04:20:37.955546 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.958406 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.958844 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.958883 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.959025 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.959250 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959490 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.959876 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.960220 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.960236 1548416 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:38.073852 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884438.021225394
I0214 04:20:38.073878 1548416 fix.go:216] guest clock: 1707884438.021225394
I0214 04:20:38.073897 1548416 fix.go:229] Guest: 2024-02-14 04:20:38.021225394 +0000 UTC Remote: 2024-02-14 04:20:37.955524144 +0000 UTC m=+277.725419033 (delta=65.70125ms)
I0214 04:20:38.073926 1548416 fix.go:200] guest clock delta is within tolerance: 65.70125ms
I0214 04:20:38.073936 1548416 start.go:83] releasing machines lock for "embed-certs-722906", held for 20.084084933s
I0214 04:20:38.073965 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.074261 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:38.077151 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077577 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.077612 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077814 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078403 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078604 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078683 1548416 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:38.078733 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.078839 1548416 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:38.078867 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.081284 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081692 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.081758 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081784 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081870 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082041 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082218 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082256 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.082293 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.082336 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.082457 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082607 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082726 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082903 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.190317 1548416 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:38.196626 1548416 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:38.349673 1548416 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:38.356571 1548416 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:38.356677 1548416 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:38.377847 1548416 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:38.377877 1548416 start.go:494] detecting cgroup driver to use...
I0214 04:20:38.377956 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:38.395591 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:38.411254 1548416 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:38.411337 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:38.429922 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:38.446585 1548416 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:38.576797 1548416 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:38.708684 1548416 docker.go:233] disabling docker service ...
I0214 04:20:38.708752 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:38.723898 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:38.736512 1548416 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:38.864382 1548416 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:38.978645 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:38.995888 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:39.015920 1548416 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:39.015998 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.028138 1548416 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:39.028205 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.041203 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.054736 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.064851 1548416 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:39.074475 1548416 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:39.085772 1548416 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:39.085839 1548416 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:39.102669 1548416 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:39.117041 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:39.248406 1548416 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:39.438738 1548416 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:39.438820 1548416 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:39.445895 1548416 start.go:562] Will wait 60s for crictl version
I0214 04:20:39.445969 1548416 ssh_runner.go:195] Run: which crictl
I0214 04:20:39.450199 1548416 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:39.491583 1548416 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:39.491674 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.534681 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.593285 1548416 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:39.594908 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:39.598263 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.598753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:39.598785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.599034 1548416 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0214 04:20:39.603478 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:39.621148 1548416 kubeadm.go:877] updating cluster {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:
false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:39.621309 1548416 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:39.621379 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:39.676783 1548416 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:39.676909 1548416 ssh_runner.go:195] Run: which lz4
I0214 04:20:39.681410 1548416 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:39.686690 1548416 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:39.686727 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:20:38.099207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Start
I0214 04:20:38.099430 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring networks are active...
I0214 04:20:38.100228 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network default is active
I0214 04:20:38.100585 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network mk-default-k8s-diff-port-224675 is active
I0214 04:20:38.101059 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Getting domain xml...
I0214 04:20:38.101854 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Creating domain...
I0214 04:20:39.454986 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting to get IP...
I0214 04:20:39.456025 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456576 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456614 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.456520 1549871 retry.go:31] will retry after 292.69131ms: waiting for machine to come up
I0214 04:20:39.751334 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751908 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751956 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.751858 1549871 retry.go:31] will retry after 340.869303ms: waiting for machine to come up
I0214 04:20:40.094535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095142 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.095051 1549871 retry.go:31] will retry after 293.465495ms: waiting for machine to come up
I0214 04:20:40.390912 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391346 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391377 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.391290 1549871 retry.go:31] will retry after 457.62012ms: waiting for machine to come up
I0214 04:20:40.851151 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851616 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851645 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.851547 1549871 retry.go:31] will retry after 539.345518ms: waiting for machine to come up
I0214 04:20:36.851047 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.089975 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.238873301s)
I0214 04:20:38.090005 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.309755 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.378436 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.478394 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:38.478509 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:38.979577 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.478754 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.979574 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.479243 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.978672 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:41.006970 1548199 api_server.go:72] duration metric: took 2.528578043s to wait for apiserver process to appear ...
I0214 04:20:41.007003 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:41.007024 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.008150 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:20:41.507776 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.762516 1548416 crio.go:444] duration metric: took 2.081156311s to copy over tarball
I0214 04:20:41.762608 1548416 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:20:44.980302 1548416 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.217656042s)
I0214 04:20:44.980335 1548416 crio.go:451] duration metric: took 3.217784443s to extract the tarball
I0214 04:20:44.980346 1548416 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:20:45.024706 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:45.082193 1548416 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:20:45.082217 1548416 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:20:45.082225 1548416 kubeadm.go:928] updating node { 192.168.50.108 8443 v1.28.4 crio true true} ...
I0214 04:20:45.082349 1548416 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-722906 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.50.108
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:45.082447 1548416 ssh_runner.go:195] Run: crio config
I0214 04:20:45.147931 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:45.147969 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:45.147982 1548416 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:45.148006 1548416 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.108 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-722906 NodeName:embed-certs-722906 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.108"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.108 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:45.148164 1548416 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.108
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-722906"
kubeletExtraArgs:
node-ip: 192.168.50.108
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.108"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:45.148232 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:20:45.158479 1548416 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:45.158553 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:45.167772 1548416 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)
I0214 04:20:45.184110 1548416 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:20:45.200469 1548416 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
I0214 04:20:45.217332 1548416 ssh_runner.go:195] Run: grep 192.168.50.108 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:45.221512 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.108 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:45.233317 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:41.392312 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393904 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:41.393756 1549871 retry.go:31] will retry after 729.897424ms: waiting for machine to come up
I0214 04:20:42.125952 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126513 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126542 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:42.126448 1549871 retry.go:31] will retry after 1.070487026s: waiting for machine to come up
I0214 04:20:43.198768 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199234 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199269 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:43.199179 1549871 retry.go:31] will retry after 1.144751625s: waiting for machine to come up
I0214 04:20:44.345532 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345958 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345989 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:44.345929 1549871 retry.go:31] will retry after 1.430046726s: waiting for machine to come up
I0214 04:20:45.778221 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778683 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778713 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:45.778628 1549871 retry.go:31] will retry after 2.320641186s: waiting for machine to come up
I0214 04:20:46.508190 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:46.508231 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:45.341316 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:45.781473 1548416 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906 for IP: 192.168.50.108
I0214 04:20:45.781494 1548416 certs.go:194] generating shared ca certs ...
I0214 04:20:45.781513 1548416 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:45.781690 1548416 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:45.781760 1548416 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:45.781777 1548416 certs.go:256] generating profile certs ...
I0214 04:20:45.781960 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/client.key
I0214 04:20:45.782154 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key.de29a2e4
I0214 04:20:45.782215 1548416 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key
I0214 04:20:45.782395 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:45.782438 1548416 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:45.782453 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:45.782491 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:45.782537 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:45.782570 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:45.782625 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:45.783482 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:45.822613 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:45.853037 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:45.898215 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:45.938947 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0214 04:20:45.965143 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:20:45.994794 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:46.018374 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:46.044018 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:46.067499 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:46.090920 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:46.114475 1548416 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:46.132051 1548416 ssh_runner.go:195] Run: openssl version
I0214 04:20:46.137746 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:46.147403 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152220 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152298 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.158254 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:46.167536 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:46.179112 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184157 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184219 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.190110 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:46.200066 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:46.210093 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214882 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214955 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.220636 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:46.230395 1548416 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:46.235238 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:46.241337 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:46.247195 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:46.253414 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:46.259696 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:46.266214 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:46.272246 1548416 kubeadm.go:391] StartCluster: {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fal
se MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:46.272384 1548416 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:46.272458 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.322213 1548416 cri.go:89] found id: ""
I0214 04:20:46.322303 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:46.334965 1548416 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:46.334993 1548416 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:46.334999 1548416 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:46.335055 1548416 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:46.344493 1548416 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:46.345570 1548416 kubeconfig.go:125] found "embed-certs-722906" server: "https://192.168.50.108:8443"
I0214 04:20:46.347818 1548416 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:46.357313 1548416 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.50.108
I0214 04:20:46.357349 1548416 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:46.357365 1548416 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:46.357429 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.403854 1548416 cri.go:89] found id: ""
I0214 04:20:46.403945 1548416 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:46.418730 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:46.432468 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:46.432491 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:20:46.432541 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:46.441218 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:46.441346 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:46.450078 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:46.458158 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:46.458261 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:46.472089 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:46.480354 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:46.480425 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:46.489174 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:46.497321 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:46.497406 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:46.506204 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:46.517469 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:46.646342 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.587291 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.799709 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.882294 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.990798 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:47.990913 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.491970 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.991676 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.491048 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.991348 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.100608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:48.101075 1549871 retry.go:31] will retry after 2.658096517s: waiting for machine to come up
I0214 04:20:50.762784 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763407 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:50.763316 1549871 retry.go:31] will retry after 2.514722067s: waiting for machine to come up
I0214 04:20:51.508782 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:51.508854 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:50.491707 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:50.511999 1548416 api_server.go:72] duration metric: took 2.521202011s to wait for apiserver process to appear ...
I0214 04:20:50.512032 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:50.512056 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.915403 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:20:53.915447 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:20:53.915465 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.961623 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:53.961686 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.012877 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.029797 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.029829 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.512349 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.517512 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.517539 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.013148 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.019019 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:55.019067 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.512961 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.520464 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:20:55.529064 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:20:55.529096 1548416 api_server.go:131] duration metric: took 5.017056759s to wait for apiserver health ...
I0214 04:20:55.529107 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:55.529117 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:55.531379 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:20:53.279582 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280038 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:53.279941 1549871 retry.go:31] will retry after 3.362064709s: waiting for machine to come up
I0214 04:20:56.510005 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:56.510055 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:58.174260 1548015 start.go:364] duration metric: took 56.091842509s to acquireMachinesLock for "old-k8s-version-960884"
I0214 04:20:58.174320 1548015 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:58.174329 1548015 fix.go:54] fixHost starting:
I0214 04:20:58.174723 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:58.174759 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:58.194079 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41161
I0214 04:20:58.194519 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:58.195088 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:20:58.195119 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:58.195478 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:58.195686 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:20:58.195855 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:20:58.197422 1548015 fix.go:112] recreateIfNeeded on old-k8s-version-960884: state=Stopped err=<nil>
I0214 04:20:58.197454 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
W0214 04:20:58.197646 1548015 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:58.200239 1548015 out.go:177] * Restarting existing kvm2 VM for "old-k8s-version-960884" ...
I0214 04:20:58.201659 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Start
I0214 04:20:58.201846 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring networks are active...
I0214 04:20:58.202622 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network default is active
I0214 04:20:58.202951 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network mk-old-k8s-version-960884 is active
I0214 04:20:58.203335 1548015 main.go:141] libmachine: (old-k8s-version-960884) Getting domain xml...
I0214 04:20:58.204058 1548015 main.go:141] libmachine: (old-k8s-version-960884) Creating domain...
I0214 04:20:59.499603 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting to get IP...
I0214 04:20:59.500457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.500948 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.501078 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.500925 1550044 retry.go:31] will retry after 268.008751ms: waiting for machine to come up
I0214 04:20:56.646632 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647206 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has current primary IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Found IP for machine: 192.168.61.188
I0214 04:20:56.647242 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserving static IP address...
I0214 04:20:56.647731 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserved static IP address: 192.168.61.188
I0214 04:20:56.647765 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for SSH to be available...
I0214 04:20:56.647794 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.647835 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | skip adding static IP to network mk-default-k8s-diff-port-224675 - found existing host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"}
I0214 04:20:56.647855 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Getting to WaitForSSH function...
I0214 04:20:56.650403 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.650820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.650856 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.651067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH client type: external
I0214 04:20:56.651100 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa (-rw-------)
I0214 04:20:56.651166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.188 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:56.651192 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | About to run SSH command:
I0214 04:20:56.651207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | exit 0
I0214 04:20:56.745447 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | SSH cmd err, output: <nil>:
I0214 04:20:56.745839 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetConfigRaw
I0214 04:20:56.746577 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:56.749052 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749421 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.749460 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749749 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:20:56.750003 1548589 machine.go:94] provisionDockerMachine start ...
I0214 04:20:56.750032 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:56.750283 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.752289 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.752669 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752745 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.752923 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753226 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.753428 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.753775 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.753787 1548589 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:56.885360 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:56.885414 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885730 1548589 buildroot.go:166] provisioning hostname "default-k8s-diff-port-224675"
I0214 04:20:56.885763 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885965 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.889200 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889612 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.889646 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.889979 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890304 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.890522 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.890994 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.891016 1548589 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-224675 && echo "default-k8s-diff-port-224675" | sudo tee /etc/hostname
I0214 04:20:57.036037 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-224675
I0214 04:20:57.036072 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.039174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039572 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.039608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039755 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.039972 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040163 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040409 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.040613 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.040946 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.040964 1548589 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-224675' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-224675/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-224675' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:57.182677 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:57.182717 1548589 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:57.182783 1548589 buildroot.go:174] setting up certificates
I0214 04:20:57.182802 1548589 provision.go:84] configureAuth start
I0214 04:20:57.182822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:57.183166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:57.186475 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.186873 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.186913 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.187230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.189476 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189790 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.189822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189971 1548589 provision.go:143] copyHostCerts
I0214 04:20:57.190038 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:57.190049 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:57.190098 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:57.190266 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:57.190280 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:57.190314 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:57.190386 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:57.190394 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:57.190412 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:57.190461 1548589 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-224675 san=[127.0.0.1 192.168.61.188 default-k8s-diff-port-224675 localhost minikube]
I0214 04:20:57.387080 1548589 provision.go:177] copyRemoteCerts
I0214 04:20:57.387149 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:57.387175 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.390293 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.390630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.391007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.391181 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.391322 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.485912 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:57.512761 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0214 04:20:57.536095 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:57.558680 1548589 provision.go:87] duration metric: took 375.857715ms to configureAuth
I0214 04:20:57.558710 1548589 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:57.558918 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:57.559003 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.562067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562500 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.562537 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562704 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.562907 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563106 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563246 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.563461 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.563823 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.563850 1548589 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:57.893504 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:57.893536 1548589 machine.go:97] duration metric: took 1.143516422s to provisionDockerMachine
I0214 04:20:57.893548 1548589 start.go:293] postStartSetup for "default-k8s-diff-port-224675" (driver="kvm2")
I0214 04:20:57.893559 1548589 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:57.893575 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:57.893941 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:57.893974 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.896371 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896764 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.896795 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896910 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.897116 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.897286 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.897442 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.996592 1548589 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:58.000872 1548589 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:58.000900 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:58.000983 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:58.001088 1548589 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:58.001183 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:58.011272 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:58.034964 1548589 start.go:296] duration metric: took 141.398226ms for postStartSetup
I0214 04:20:58.035023 1548589 fix.go:56] duration metric: took 19.960915344s for fixHost
I0214 04:20:58.035053 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.037914 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038291 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.038324 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038581 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.038811 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.038999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.039138 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.039329 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:58.039672 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:58.039684 1548589 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:58.174082 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884458.118396657
I0214 04:20:58.174110 1548589 fix.go:216] guest clock: 1707884458.118396657
I0214 04:20:58.174121 1548589 fix.go:229] Guest: 2024-02-14 04:20:58.118396657 +0000 UTC Remote: 2024-02-14 04:20:58.035028403 +0000 UTC m=+277.067763536 (delta=83.368254ms)
I0214 04:20:58.174148 1548589 fix.go:200] guest clock delta is within tolerance: 83.368254ms
I0214 04:20:58.174154 1548589 start.go:83] releasing machines lock for "default-k8s-diff-port-224675", held for 20.100083449s
I0214 04:20:58.174185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.174605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:58.177237 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177662 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.177693 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177891 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178381 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178690 1548589 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:58.178744 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.178844 1548589 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:58.178867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.181490 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181819 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.181842 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182009 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.182292 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.182352 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.182420 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182520 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182582 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.182999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.183208 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.183377 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.279272 1548589 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:58.306096 1548589 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:58.464434 1548589 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:58.471146 1548589 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:58.471214 1548589 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:58.488300 1548589 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:58.488334 1548589 start.go:494] detecting cgroup driver to use...
I0214 04:20:58.488423 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:58.506634 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:58.521226 1548589 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:58.521315 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:58.536720 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:58.549326 1548589 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:58.661636 1548589 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:58.783909 1548589 docker.go:233] disabling docker service ...
I0214 04:20:58.784000 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:58.796379 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:58.807498 1548589 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:58.924871 1548589 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:59.041964 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:59.055151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:59.082093 1548589 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:59.082175 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.095126 1548589 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:59.095227 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.104759 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.117356 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.126315 1548589 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:59.135891 1548589 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:59.146513 1548589 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:59.146572 1548589 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:59.162055 1548589 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:59.172668 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:59.323690 1548589 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:59.554209 1548589 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:59.554296 1548589 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:59.559401 1548589 start.go:562] Will wait 60s for crictl version
I0214 04:20:59.559471 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:20:59.563786 1548589 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:59.606476 1548589 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:59.606583 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.676861 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.739175 1548589 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:55.532872 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:20:55.548094 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:20:55.582319 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:20:55.595384 1548416 system_pods.go:59] 8 kube-system pods found
I0214 04:20:55.595415 1548416 system_pods.go:61] "coredns-5dd5756b68-4njjf" [3526e55f-d197-40a9-a939-bdc324aa0214] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:20:55.595422 1548416 system_pods.go:61] "etcd-embed-certs-722906" [cc60420b-dd77-4385-86f9-d2ddaa5a9b22] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:20:55.595429 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [850aef3c-4402-4e33-a81d-2d4bd97c5503] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:20:55.595435 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [5f2cc407-f67a-4779-ab0d-1a739e070df4] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:20:55.595443 1548416 system_pods.go:61] "kube-proxy-4wk86" [de0506d7-756a-4ce1-ab3c-54aaf8c041ad] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:20:55.595449 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [05db3b4a-941a-4aaf-88e3-35ec35176042] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:20:55.595458 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-5nqbv" [7784c464-f718-4eb0-b9dd-ebb579ead3bc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:20:55.595464 1548416 system_pods.go:61] "storage-provisioner" [d272841c-697d-4708-bce6-6fcad0d9d2b4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:20:55.595471 1548416 system_pods.go:74] duration metric: took 13.129235ms to wait for pod list to return data ...
I0214 04:20:55.595482 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:20:55.601854 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:20:55.601918 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:20:55.601935 1548416 node_conditions.go:105] duration metric: took 6.44739ms to run NodePressure ...
I0214 04:20:55.601957 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:55.954027 1548416 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:20:55.970665 1548416 kubeadm.go:733] kubelet initialised
I0214 04:20:55.970695 1548416 kubeadm.go:734] duration metric: took 16.634129ms waiting for restarted kubelet to initialise ...
I0214 04:20:55.970708 1548416 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:20:55.978062 1548416 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:20:57.985711 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.989728 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.740766 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:59.744066 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744437 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:59.744465 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744727 1548589 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0214 04:20:59.750187 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:59.763984 1548589 kubeadm.go:877] updating cluster {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat
ion:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:59.764177 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:59.764235 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:59.814567 1548589 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:59.814655 1548589 ssh_runner.go:195] Run: which lz4
I0214 04:20:59.819563 1548589 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:59.824793 1548589 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:59.824844 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:21:01.511247 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:01.511301 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:01.665765 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": read tcp 192.168.39.1:46006->192.168.39.167:8443: read: connection reset by peer
I0214 04:20:59.770509 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.770916 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.770941 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.770880 1550044 retry.go:31] will retry after 254.3155ms: waiting for machine to come up
I0214 04:21:00.027295 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.028116 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.028281 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.028236 1550044 retry.go:31] will retry after 304.399751ms: waiting for machine to come up
I0214 04:21:00.334939 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.335679 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.335710 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.335610 1550044 retry.go:31] will retry after 495.017444ms: waiting for machine to come up
I0214 04:21:00.833716 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.834301 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.834332 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.834259 1550044 retry.go:31] will retry after 586.036153ms: waiting for machine to come up
I0214 04:21:01.422440 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:01.423042 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:01.423073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:01.423002 1550044 retry.go:31] will retry after 893.296492ms: waiting for machine to come up
I0214 04:21:02.318089 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:02.318517 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:02.318553 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:02.318444 1550044 retry.go:31] will retry after 890.603828ms: waiting for machine to come up
I0214 04:21:03.210695 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:03.211183 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:03.211219 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:03.211140 1550044 retry.go:31] will retry after 1.068479468s: waiting for machine to come up
I0214 04:21:04.281009 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:04.281818 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:04.281859 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:04.281713 1550044 retry.go:31] will retry after 1.48876639s: waiting for machine to come up
I0214 04:21:00.490145 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:00.490174 1548416 pod_ready.go:81] duration metric: took 4.512078435s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:21:00.490188 1548416 pod_ready.go:78] waiting up to 4m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:02.498108 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:04.500186 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:01.782168 1548589 crio.go:444] duration metric: took 1.962621296s to copy over tarball
I0214 04:21:01.782265 1548589 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:05.094954 1548589 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.312628523s)
I0214 04:21:05.094995 1548589 crio.go:451] duration metric: took 3.312794343s to extract the tarball
I0214 04:21:05.095005 1548589 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:05.138877 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:05.189028 1548589 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:21:05.189067 1548589 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:21:05.189079 1548589 kubeadm.go:928] updating node { 192.168.61.188 8444 v1.28.4 crio true true} ...
I0214 04:21:05.189273 1548589 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=default-k8s-diff-port-224675 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.188
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:05.189360 1548589 ssh_runner.go:195] Run: crio config
I0214 04:21:05.268931 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:05.268970 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:05.268985 1548589 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:05.269014 1548589 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.188 APIServerPort:8444 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-224675 NodeName:default-k8s-diff-port-224675 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.188"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.188 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cer
ts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:21:05.269248 1548589 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.188
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-224675"
kubeletExtraArgs:
node-ip: 192.168.61.188
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.188"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:05.269373 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:21:05.282570 1548589 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:05.282677 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:05.294227 1548589 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (328 bytes)
I0214 04:21:05.314442 1548589 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:05.335296 1548589 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0214 04:21:05.355453 1548589 ssh_runner.go:195] Run: grep 192.168.61.188 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:05.359558 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.188 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:05.374035 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:05.500958 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:05.517736 1548589 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675 for IP: 192.168.61.188
I0214 04:21:05.517761 1548589 certs.go:194] generating shared ca certs ...
I0214 04:21:05.517784 1548589 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:05.518063 1548589 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:05.518133 1548589 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:05.518149 1548589 certs.go:256] generating profile certs ...
I0214 04:21:05.518278 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/client.key
I0214 04:21:05.518378 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key.107453ef
I0214 04:21:05.518440 1548589 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key
I0214 04:21:05.518591 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:05.518663 1548589 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:05.518679 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:05.518715 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:05.518750 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:05.518786 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:05.518843 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:05.519732 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:05.563956 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:05.600031 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:05.637740 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:05.690706 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0214 04:21:05.737661 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:05.775249 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:05.808393 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:21:05.835096 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:05.859782 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:05.885907 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:05.912030 1548589 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:05.929758 1548589 ssh_runner.go:195] Run: openssl version
I0214 04:21:05.935156 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:05.945003 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949769 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949864 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.955524 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:05.965551 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:05.975674 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980561 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980621 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.986257 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:05.997315 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:06.007670 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012694 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012766 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:02.007691 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.008567 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:02.507730 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.508577 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.007700 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:03.008475 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.507127 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.797126 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.797164 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:07.797184 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.883078 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.883120 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:08.007346 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.097373 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.097412 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:08.507874 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.516200 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.516246 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:09.007697 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:09.012802 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:21:09.021792 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:21:09.021833 1548199 api_server.go:131] duration metric: took 28.01482277s to wait for apiserver health ...
I0214 04:21:09.021845 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:21:09.021853 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:09.023946 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:05.771858 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:05.772454 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:05.772494 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:05.772403 1550044 retry.go:31] will retry after 2.280902204s: waiting for machine to come up
I0214 04:21:08.054571 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:08.055138 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:08.055173 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:08.055076 1550044 retry.go:31] will retry after 1.815235532s: waiting for machine to come up
I0214 04:21:06.844839 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:07.283580 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.283613 1548416 pod_ready.go:81] duration metric: took 6.793414916s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.283638 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294673 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.294704 1548416 pod_ready.go:81] duration metric: took 11.057139ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294719 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303085 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.303113 1548416 pod_ready.go:81] duration metric: took 8.385115ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303125 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310622 1548416 pod_ready.go:92] pod "kube-proxy-4wk86" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.310649 1548416 pod_ready.go:81] duration metric: took 7.515057ms for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310661 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.323237 1548416 pod_ready.go:102] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:09.821404 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:09.821523 1548416 pod_ready.go:81] duration metric: took 2.510851991s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.821565 1548416 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:06.018693 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:06.380858 1548589 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:06.387108 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:06.393578 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:06.399652 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:06.405980 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:06.412267 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:06.419780 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:06.427216 1548589 kubeadm.go:391] StartCluster: {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration
:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:06.427363 1548589 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:06.427422 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.497747 1548589 cri.go:89] found id: ""
I0214 04:21:06.497834 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:06.516612 1548589 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:06.516658 1548589 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:06.516667 1548589 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:06.516733 1548589 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:06.529291 1548589 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:06.531168 1548589 kubeconfig.go:125] found "default-k8s-diff-port-224675" server: "https://192.168.61.188:8444"
I0214 04:21:06.535161 1548589 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:06.546663 1548589 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.61.188
I0214 04:21:06.546708 1548589 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:06.546726 1548589 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:06.546803 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.597843 1548589 cri.go:89] found id: ""
I0214 04:21:06.597935 1548589 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:06.616190 1548589 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:06.628139 1548589 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:06.628171 1548589 kubeadm.go:156] found existing configuration files:
I0214 04:21:06.628236 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I0214 04:21:06.638453 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:06.638512 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:06.648959 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I0214 04:21:06.660706 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:06.660788 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:06.671857 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I0214 04:21:06.682340 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:06.682407 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:06.692058 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I0214 04:21:06.701943 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:06.702022 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:06.711790 1548589 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:06.721996 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:06.889535 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.226025 1548589 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.336439873s)
I0214 04:21:08.226061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.459929 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.556113 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.663379 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:08.663488 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.164266 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.664203 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.163698 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.663743 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.689408 1548589 api_server.go:72] duration metric: took 2.026029304s to wait for apiserver process to appear ...
I0214 04:21:10.689439 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:10.689466 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:10.690130 1548589 api_server.go:269] stopped: https://192.168.61.188:8444/healthz: Get "https://192.168.61.188:8444/healthz": dial tcp 192.168.61.188:8444: connect: connection refused
I0214 04:21:09.025318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:09.044094 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:09.065032 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:09.077574 1548199 system_pods.go:59] 8 kube-system pods found
I0214 04:21:09.077615 1548199 system_pods.go:61] "coredns-76f75df574-kszkn" [e042e368-b6a1-481d-ac0e-a41fded08d17] Running
I0214 04:21:09.077624 1548199 system_pods.go:61] "etcd-no-preload-527067" [f9eb0545-49ea-4302-89ba-f897701543c8] Running
I0214 04:21:09.077632 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [294a622e-a6af-46f1-b011-4d932202c48c] Running
I0214 04:21:09.077641 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [cb6ca785-3638-4e5c-8950-bddb982904b4] Running
I0214 04:21:09.077648 1548199 system_pods.go:61] "kube-proxy-x55kr" [b523c872-d6f6-4522-b3f0-669b55d4784c] Running
I0214 04:21:09.077656 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [7e451830-0a27-4fa9-8ebd-36ae39aa0214] Running
I0214 04:21:09.077669 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-jq29b" [0c974098-1c0c-482e-a187-95f35842b947] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:09.077686 1548199 system_pods.go:61] "storage-provisioner" [d4ce4210-3a50-4839-9266-54a8a6725728] Running
I0214 04:21:09.077698 1548199 system_pods.go:74] duration metric: took 12.635754ms to wait for pod list to return data ...
I0214 04:21:09.077713 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:09.080917 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:09.080955 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:09.080972 1548199 node_conditions.go:105] duration metric: took 3.250174ms to run NodePressure ...
I0214 04:21:09.080995 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:09.378306 1548199 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:09.384151 1548199 retry.go:31] will retry after 170.068456ms: kubelet not initialised
I0214 04:21:09.560919 1548199 retry.go:31] will retry after 290.437429ms: kubelet not initialised
I0214 04:21:09.859277 1548199 retry.go:31] will retry after 624.738868ms: kubelet not initialised
I0214 04:21:10.492136 1548199 retry.go:31] will retry after 533.792177ms: kubelet not initialised
I0214 04:21:11.034100 1548199 retry.go:31] will retry after 1.244408489s: kubelet not initialised
I0214 04:21:09.872580 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:09.873073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:09.873109 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:09.873043 1550044 retry.go:31] will retry after 2.578927184s: waiting for machine to come up
I0214 04:21:12.454474 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:12.454906 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:12.454940 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:12.454858 1550044 retry.go:31] will retry after 3.936870017s: waiting for machine to come up
I0214 04:21:11.833118 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:14.329353 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:11.190349 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.926174 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.926304 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:14.926353 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.981084 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.981133 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:15.190448 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.196250 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.196274 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:15.690479 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.698329 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.698362 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:16.190232 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:16.195910 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:21:16.205529 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:21:16.205562 1548589 api_server.go:131] duration metric: took 5.516113354s to wait for apiserver health ...
I0214 04:21:16.205575 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:16.205584 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:16.207433 1548589 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:12.289467 1548199 retry.go:31] will retry after 1.910737554s: kubelet not initialised
I0214 04:21:14.207622 1548199 retry.go:31] will retry after 2.041648758s: kubelet not initialised
I0214 04:21:16.260641 1548199 kubeadm.go:733] kubelet initialised
I0214 04:21:16.260666 1548199 kubeadm.go:734] duration metric: took 6.882327169s waiting for restarted kubelet to initialise ...
I0214 04:21:16.260677 1548199 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.271440 1548199 pod_ready.go:78] waiting up to 4m0s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.208874 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:16.223699 1548589 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:16.242002 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:16.258621 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:21:16.258672 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:21:16.258684 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:21:16.258702 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:21:16.258720 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:21:16.258735 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:21:16.258745 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:21:16.258757 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:16.258773 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:21:16.258782 1548589 system_pods.go:74] duration metric: took 16.754069ms to wait for pod list to return data ...
I0214 04:21:16.258804 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:16.262763 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:16.262799 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:16.262812 1548589 node_conditions.go:105] duration metric: took 4.002558ms to run NodePressure ...
I0214 04:21:16.262833 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:16.517025 1548589 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:16.522602 1548589 kubeadm.go:733] kubelet initialised
I0214 04:21:16.522681 1548589 kubeadm.go:734] duration metric: took 5.568582ms waiting for restarted kubelet to initialise ...
I0214 04:21:16.522703 1548589 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.529946 1548589 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.535926 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535952 1548589 pod_ready.go:81] duration metric: took 5.972224ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.535962 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535971 1548589 pod_ready.go:78] waiting up to 4m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.541171 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541207 1548589 pod_ready.go:81] duration metric: took 5.225365ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.541221 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541229 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.546186 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546218 1548589 pod_ready.go:81] duration metric: took 4.980231ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.546231 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546239 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.646668 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646709 1548589 pod_ready.go:81] duration metric: took 100.455975ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.646726 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646735 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.049656 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049690 1548589 pod_ready.go:81] duration metric: took 402.946278ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.049704 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049713 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.445638 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445677 1548589 pod_ready.go:81] duration metric: took 395.952591ms for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.445694 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445703 1548589 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.847249 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847282 1548589 pod_ready.go:81] duration metric: took 401.569704ms for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.847311 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847322 1548589 pod_ready.go:38] duration metric: took 1.324598748s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:17.847345 1548589 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:21:17.861893 1548589 ops.go:34] apiserver oom_adj: -16
I0214 04:21:17.861926 1548589 kubeadm.go:591] duration metric: took 11.345250928s to restartPrimaryControlPlane
I0214 04:21:17.861937 1548589 kubeadm.go:393] duration metric: took 11.434732694s to StartCluster
I0214 04:21:17.861963 1548589 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.862046 1548589 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:21:17.864089 1548589 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.864357 1548589 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:21:17.866315 1548589 out.go:177] * Verifying Kubernetes components...
I0214 04:21:17.864450 1548589 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:21:17.864662 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:21:17.867813 1548589 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867813 1548589 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867893 1548589 addons.go:234] Setting addon storage-provisioner=true in "default-k8s-diff-port-224675"
W0214 04:21:17.867911 1548589 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:21:17.867931 1548589 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-224675"
I0214 04:21:17.867822 1548589 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867990 1548589 addons.go:234] Setting addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:17.867995 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
W0214 04:21:17.868002 1548589 addons.go:243] addon metrics-server should already be in state true
I0214 04:21:17.868067 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.868372 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868405 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868471 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868586 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868630 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:17.885511 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35721
I0214 04:21:17.886123 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.886736 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.886761 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.887121 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.887700 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.887744 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.888429 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36919
I0214 04:21:17.888436 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37749
I0214 04:21:17.888934 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.888943 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.889459 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889479 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889628 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889638 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889897 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.890090 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.894107 1548589 addons.go:234] Setting addon default-storageclass=true in "default-k8s-diff-port-224675"
W0214 04:21:17.894129 1548589 addons.go:243] addon default-storageclass should already be in state true
I0214 04:21:17.894158 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.894527 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.894573 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.897686 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.898250 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.898277 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.905863 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43347
I0214 04:21:17.906256 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.906706 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.906719 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.907066 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.907252 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.909082 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.912129 1548589 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:17.913850 1548589 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:17.913867 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:21:17.913882 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.913431 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41665
I0214 04:21:17.914856 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.915448 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.915472 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.916246 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.916924 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.916952 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.917227 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917496 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.917535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917782 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.917997 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.918516 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44391
I0214 04:21:17.918650 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.919229 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.919243 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.919838 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.919858 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.920242 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.921364 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.922929 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.925090 1548589 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:21:16.394555 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:16.395079 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:16.395118 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:16.395000 1550044 retry.go:31] will retry after 4.184306662s: waiting for machine to come up
I0214 04:21:17.930415 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:21:17.930435 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:21:17.930457 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.934174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934210 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.934233 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934380 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.937367 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42083
I0214 04:21:17.937375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.937552 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.937951 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.937949 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.938390 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.938405 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.938789 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.939000 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.940318 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.940561 1548589 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:17.940575 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:21:17.940588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.943188 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943558 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.943600 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943816 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.943954 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.944088 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.944168 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:18.108100 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:18.126785 1548589 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:18.199680 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:21:18.199711 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:21:18.211800 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:18.225027 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:21:18.225053 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:21:18.244323 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.244358 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:21:18.276796 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.350125 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:19.154449 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154480 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.154805 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.154827 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.154841 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154853 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.155094 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.155200 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.155172 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.163519 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.163539 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.163825 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.163880 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.561946 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.28509634s)
I0214 04:21:19.562006 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562027 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562344 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.562355 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562371 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562386 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562395 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562697 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562718 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562731 1548589 addons.go:470] Verifying addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:19.632363 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.282192396s)
I0214 04:21:19.632421 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632434 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.632756 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.632777 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.632777 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.632787 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632796 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.633163 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.633192 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.633209 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.635385 1548589 out.go:177] * Enabled addons: default-storageclass, metrics-server, storage-provisioner
I0214 04:21:16.330627 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:18.829917 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:19.636745 1548589 addons.go:505] duration metric: took 1.772300134s for enable addons: enabled=[default-storageclass metrics-server storage-provisioner]
I0214 04:21:20.130535 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:18.278986 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.279953 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.581058 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581627 1548015 main.go:141] libmachine: (old-k8s-version-960884) Found IP for machine: 192.168.72.206
I0214 04:21:20.581661 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has current primary IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581676 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserving static IP address...
I0214 04:21:20.582088 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.582127 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | skip adding static IP to network mk-old-k8s-version-960884 - found existing host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"}
I0214 04:21:20.582141 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserved static IP address: 192.168.72.206
I0214 04:21:20.582161 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting for SSH to be available...
I0214 04:21:20.582177 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Getting to WaitForSSH function...
I0214 04:21:20.584389 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584675 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.584703 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584856 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH client type: external
I0214 04:21:20.584883 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa (-rw-------)
I0214 04:21:20.584919 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.206 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:21:20.584935 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | About to run SSH command:
I0214 04:21:20.584946 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | exit 0
I0214 04:21:20.681801 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | SSH cmd err, output: <nil>:
I0214 04:21:20.682218 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetConfigRaw
I0214 04:21:20.683002 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:20.686419 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.686997 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.687032 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.687340 1548015 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/config.json ...
I0214 04:21:20.687596 1548015 machine.go:94] provisionDockerMachine start ...
I0214 04:21:20.687624 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:20.687892 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.690877 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691276 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.691307 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691491 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.691695 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.691868 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.692066 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.692276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.692587 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.692598 1548015 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:21:20.821994 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:21:20.822030 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822348 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:21:20.822383 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822629 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.825677 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826050 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.826081 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826289 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.826531 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826688 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826859 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.827085 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.827569 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.827591 1548015 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-960884 && echo "old-k8s-version-960884" | sudo tee /etc/hostname
I0214 04:21:20.970187 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-960884
I0214 04:21:20.970224 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.972969 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973418 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.973457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973649 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.973838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.973991 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.974112 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.974276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.974644 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.974663 1548015 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-960884' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-960884/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-960884' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:21:21.109947 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:21:21.109989 1548015 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:21:21.110028 1548015 buildroot.go:174] setting up certificates
I0214 04:21:21.110040 1548015 provision.go:84] configureAuth start
I0214 04:21:21.110055 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:21.110430 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:21.113401 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113720 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.113755 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.116563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.116901 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.116928 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.117065 1548015 provision.go:143] copyHostCerts
I0214 04:21:21.117136 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:21:21.117149 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:21:21.117216 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:21:21.117349 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:21:21.117363 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:21:21.117397 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:21:21.117479 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:21:21.117495 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:21:21.117525 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:21:21.117600 1548015 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-960884 san=[127.0.0.1 192.168.72.206 localhost minikube old-k8s-version-960884]
I0214 04:21:21.249602 1548015 provision.go:177] copyRemoteCerts
I0214 04:21:21.249679 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:21:21.249705 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.252629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253091 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.253120 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253338 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.253535 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.253683 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.253817 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.352374 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:21:21.376684 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0214 04:21:21.400100 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:21:21.422025 1548015 provision.go:87] duration metric: took 311.969213ms to configureAuth
I0214 04:21:21.422062 1548015 buildroot.go:189] setting minikube options for container-runtime
I0214 04:21:21.422289 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:21:21.422388 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.425363 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425732 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.425769 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425922 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.426103 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426259 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426369 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.426526 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.426855 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.426883 1548015 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:21:21.762573 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:21:21.762683 1548015 machine.go:97] duration metric: took 1.075066333s to provisionDockerMachine
I0214 04:21:21.762703 1548015 start.go:293] postStartSetup for "old-k8s-version-960884" (driver="kvm2")
I0214 04:21:21.762722 1548015 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:21:21.762772 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:21.763195 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:21:21.763254 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.766548 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.766932 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.766960 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.767123 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.767363 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.767558 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.767724 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.864283 1548015 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:21:21.869125 1548015 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:21:21.869155 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:21:21.869235 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:21:21.869404 1548015 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:21:21.869542 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:21:21.879233 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:21.901977 1548015 start.go:296] duration metric: took 139.253065ms for postStartSetup
I0214 04:21:21.902024 1548015 fix.go:56] duration metric: took 23.727695033s for fixHost
I0214 04:21:21.902051 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.904963 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905391 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.905429 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905645 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.905838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906175 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.906361 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.906733 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.906748 1548015 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:21:22.034574 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884481.977175244
I0214 04:21:22.034604 1548015 fix.go:216] guest clock: 1707884481.977175244
I0214 04:21:22.034613 1548015 fix.go:229] Guest: 2024-02-14 04:21:21.977175244 +0000 UTC Remote: 2024-02-14 04:21:21.902028761 +0000 UTC m=+362.408004482 (delta=75.146483ms)
I0214 04:21:22.034653 1548015 fix.go:200] guest clock delta is within tolerance: 75.146483ms
I0214 04:21:22.034658 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 23.860366317s
I0214 04:21:22.034685 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.034987 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:22.038178 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038662 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.038693 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038881 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039433 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039661 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039752 1548015 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:21:22.039824 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.039923 1548015 ssh_runner.go:195] Run: cat /version.json
I0214 04:21:22.039956 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.042871 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.042905 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043230 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043269 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043303 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043320 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043406 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043515 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043651 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043738 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043831 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043988 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.044088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.155962 1548015 ssh_runner.go:195] Run: systemctl --version
I0214 04:21:22.161514 1548015 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:21:22.307311 1548015 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:21:22.313795 1548015 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:21:22.313886 1548015 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:21:22.331192 1548015 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:21:22.331219 1548015 start.go:494] detecting cgroup driver to use...
I0214 04:21:22.331295 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:21:22.348525 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:21:22.360700 1548015 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:21:22.360765 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:21:22.373323 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:21:22.386326 1548015 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:21:22.500712 1548015 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:21:22.628951 1548015 docker.go:233] disabling docker service ...
I0214 04:21:22.629047 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:21:22.644389 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:21:22.656100 1548015 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:21:22.771454 1548015 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:21:22.890367 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:21:22.906025 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:21:22.923645 1548015 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0214 04:21:22.923718 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.934179 1548015 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:21:22.934261 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.945371 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.955276 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.965963 1548015 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:21:22.977213 1548015 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:21:22.987180 1548015 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:21:22.987242 1548015 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:21:23.001621 1548015 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:21:23.011279 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:23.138894 1548015 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:21:23.320312 1548015 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:21:23.320405 1548015 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:21:23.331416 1548015 start.go:562] Will wait 60s for crictl version
I0214 04:21:23.331498 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:23.336532 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:21:23.383038 1548015 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:21:23.383147 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.439429 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.497766 1548015 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.24.1 ...
I0214 04:21:23.499416 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:23.502453 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.502863 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:23.502890 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.503096 1548015 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:21:23.507846 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:23.521497 1548015 kubeadm.go:877] updating cluster {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0
s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:21:23.521668 1548015 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0214 04:21:23.521743 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:23.563000 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:23.563077 1548015 ssh_runner.go:195] Run: which lz4
I0214 04:21:23.567232 1548015 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:21:23.571918 1548015 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:21:23.571956 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0214 04:21:20.832765 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:23.331172 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:22.131519 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:24.132734 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:25.632316 1548589 node_ready.go:49] node "default-k8s-diff-port-224675" has status "Ready":"True"
I0214 04:21:25.632355 1548589 node_ready.go:38] duration metric: took 7.505537722s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:25.632378 1548589 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:25.644082 1548589 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663622 1548589 pod_ready.go:92] pod "coredns-5dd5756b68-27jph" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.663652 1548589 pod_ready.go:81] duration metric: took 19.53614ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663665 1548589 pod_ready.go:78] waiting up to 6m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684330 1548589 pod_ready.go:92] pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.684364 1548589 pod_ready.go:81] duration metric: took 20.690068ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684381 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701825 1548589 pod_ready.go:92] pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.701861 1548589 pod_ready.go:81] duration metric: took 17.469749ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701880 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720092 1548589 pod_ready.go:92] pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.720116 1548589 pod_ready.go:81] duration metric: took 18.227307ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720126 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:22.282916 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:24.790590 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:25.407536 1548015 crio.go:444] duration metric: took 1.840347288s to copy over tarball
I0214 04:21:25.407632 1548015 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:28.466951 1548015 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.059268232s)
I0214 04:21:28.466988 1548015 crio.go:451] duration metric: took 3.059413422s to extract the tarball
I0214 04:21:28.466998 1548015 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:28.508517 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:28.568984 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:28.569019 1548015 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:21:28.569089 1548015 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.569113 1548015 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.569124 1548015 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.569194 1548015 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0214 04:21:28.569261 1548015 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.569341 1548015 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.569195 1548015 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.569577 1548015 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570792 1548015 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.570765 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570822 1548015 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0214 04:21:28.570828 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.570830 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.570764 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.570777 1548015 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.570853 1548015 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.761944 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.765651 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.768487 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0214 04:21:28.777658 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.789124 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.831672 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0214 04:21:28.834241 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.835723 1548015 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0214 04:21:28.835774 1548015 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.835821 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.846042 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.894678 1548015 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0214 04:21:28.894728 1548015 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.894778 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944386 1548015 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0214 04:21:28.944443 1548015 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.944481 1548015 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0214 04:21:28.944507 1548015 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0214 04:21:28.944509 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944535 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989723 1548015 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0214 04:21:28.989774 1548015 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0214 04:21:28.989812 1548015 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.989821 1548015 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0214 04:21:28.989853 1548015 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.989779 1548015 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.989907 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989931 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989873 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989933 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:29.110089 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:29.110123 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0214 04:21:29.110142 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0214 04:21:29.110230 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0214 04:21:29.110281 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0214 04:21:29.110339 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:29.110389 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:29.250488 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0214 04:21:29.250791 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0214 04:21:29.254821 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0214 04:21:29.254967 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0214 04:21:29.255074 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0214 04:21:29.255084 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0214 04:21:29.255142 1548015 cache_images.go:92] duration metric: took 686.107956ms to LoadCachedImages
W0214 04:21:29.255222 1548015 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0: no such file or directory
I0214 04:21:29.255239 1548015 kubeadm.go:928] updating node { 192.168.72.206 8443 v1.16.0 crio true true} ...
I0214 04:21:29.255399 1548015 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-960884 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.206
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:29.255479 1548015 ssh_runner.go:195] Run: crio config
I0214 04:21:29.317891 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:29.317923 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:29.317935 1548015 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:29.317961 1548015 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.206 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-960884 NodeName:old-k8s-version-960884 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.206"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.206 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0214 04:21:29.318104 1548015 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.206
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-960884"
kubeletExtraArgs:
node-ip: 192.168.72.206
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.206"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-960884
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.72.206:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:29.318193 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0214 04:21:29.327452 1548015 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:29.327531 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:29.337200 1548015 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0214 04:21:29.352775 1548015 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:29.370691 1548015 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2181 bytes)
I0214 04:21:29.391607 1548015 ssh_runner.go:195] Run: grep 192.168.72.206 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:29.395665 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.206 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:29.409170 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:29.518566 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:29.534160 1548015 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884 for IP: 192.168.72.206
I0214 04:21:29.534202 1548015 certs.go:194] generating shared ca certs ...
I0214 04:21:29.534231 1548015 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:29.534487 1548015 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:29.534575 1548015 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:29.534595 1548015 certs.go:256] generating profile certs ...
I0214 04:21:29.534721 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/client.key
I0214 04:21:29.534813 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key.83e6709b
I0214 04:21:29.534879 1548015 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key
I0214 04:21:29.535019 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:29.535076 1548015 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:29.535089 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:29.535122 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:29.535155 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:29.535198 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:29.535265 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:29.536212 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:25.332784 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:27.830166 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:26.031649 1548589 pod_ready.go:92] pod "kube-proxy-dbkzv" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:26.031684 1548589 pod_ready.go:81] duration metric: took 311.550001ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:26.031698 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:28.040585 1548589 pod_ready.go:102] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:30.465468 1548589 pod_ready.go:92] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:30.465504 1548589 pod_ready.go:81] duration metric: took 4.433796246s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:30.465519 1548589 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:27.279574 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.552593 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.576065 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:29.714093 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:29.748054 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:29.777699 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0214 04:21:29.804606 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:29.829987 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:29.853803 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0214 04:21:29.878360 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:29.901845 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:29.926801 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:29.951044 1548015 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:29.970807 1548015 ssh_runner.go:195] Run: openssl version
I0214 04:21:29.977053 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:29.990302 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996045 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996150 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:30.002320 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:30.014065 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:30.027194 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032670 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032739 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.039164 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:30.051920 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:30.064135 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070013 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070096 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.076531 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:30.087989 1548015 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:30.094182 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:30.100653 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:30.106827 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:30.112695 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:30.118991 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:30.124783 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:30.130728 1548015 kubeadm.go:391] StartCluster: {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s M
ount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:30.130856 1548015 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:30.130920 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.172760 1548015 cri.go:89] found id: ""
I0214 04:21:30.172844 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:30.182798 1548015 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:30.182820 1548015 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:30.182833 1548015 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:30.182890 1548015 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:30.191987 1548015 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:30.193332 1548015 kubeconfig.go:125] found "old-k8s-version-960884" server: "https://192.168.72.206:8443"
I0214 04:21:30.195906 1548015 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:30.204941 1548015 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.72.206
I0214 04:21:30.204971 1548015 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:30.204983 1548015 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:30.205030 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.246746 1548015 cri.go:89] found id: ""
I0214 04:21:30.246835 1548015 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:30.265837 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:30.277949 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:30.277986 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:21:30.278049 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:21:30.287840 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:30.287899 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:30.298734 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:21:30.307885 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:30.307983 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:30.317668 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:21:30.326303 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:30.326366 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:30.335884 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:21:30.344902 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:30.345020 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:30.355826 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:30.366201 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:30.517881 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.202023 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.400048 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.491748 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.625368 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:31.625475 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.126481 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.626533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.126533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.625871 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.658063 1548015 api_server.go:72] duration metric: took 2.032718395s to wait for apiserver process to appear ...
I0214 04:21:33.658096 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:33.658118 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:30.329984 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.830531 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.831590 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.475902 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.973325 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:31.780474 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.281836 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:36.284001 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.658562 1548015 api_server.go:269] stopped: https://192.168.72.206:8443/healthz: Get "https://192.168.72.206:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:38.658613 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.453628 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.453667 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:39.453686 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.476016 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.476042 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:37.330750 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.829556 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.659245 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.678800 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:39.678842 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.158920 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.165230 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:40.165286 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.659134 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.666024 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:21:40.674534 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:21:40.674571 1548015 api_server.go:131] duration metric: took 7.016466266s to wait for apiserver health ...
I0214 04:21:40.674584 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:40.674594 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:40.676474 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:36.974542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.474238 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.781991 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.280560 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:40.677823 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:40.689136 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:40.709008 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:40.719306 1548015 system_pods.go:59] 7 kube-system pods found
I0214 04:21:40.719343 1548015 system_pods.go:61] "coredns-5644d7b6d9-9ph4x" [6f0623c3-2524-4ba1-b0f2-43c8cdf5d3b2] Running
I0214 04:21:40.719350 1548015 system_pods.go:61] "etcd-old-k8s-version-960884" [6b8c8c75-cb3e-4b82-bc58-51b05ed826a7] Running
I0214 04:21:40.719357 1548015 system_pods.go:61] "kube-apiserver-old-k8s-version-960884" [2d8f7b59-3872-4499-9504-1f030e7c8094] Running
I0214 04:21:40.719364 1548015 system_pods.go:61] "kube-controller-manager-old-k8s-version-960884" [78c409e9-42ac-447c-99c6-6f9b687c2d36] Running
I0214 04:21:40.719378 1548015 system_pods.go:61] "kube-proxy-csc94" [091dfdb5-e19e-40c3-8d1a-e27448a61134] Running
I0214 04:21:40.719384 1548015 system_pods.go:61] "kube-scheduler-old-k8s-version-960884" [7cd0a53c-f839-4886-8902-95a9617c0223] Running
I0214 04:21:40.719390 1548015 system_pods.go:61] "storage-provisioner" [1531bf30-b7cb-46dd-8059-139eda59ab91] Running
I0214 04:21:40.719402 1548015 system_pods.go:74] duration metric: took 10.361661ms to wait for pod list to return data ...
I0214 04:21:40.719419 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:40.723811 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:40.723849 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:40.723864 1548015 node_conditions.go:105] duration metric: took 4.43897ms to run NodePressure ...
I0214 04:21:40.723893 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:40.977897 1548015 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:40.981121 1548015 retry.go:31] will retry after 128.555505ms: kubelet not initialised
I0214 04:21:41.115327 1548015 retry.go:31] will retry after 372.280627ms: kubelet not initialised
I0214 04:21:41.502405 1548015 retry.go:31] will retry after 313.632774ms: kubelet not initialised
I0214 04:21:41.825529 1548015 retry.go:31] will retry after 544.787289ms: kubelet not initialised
I0214 04:21:42.384758 1548015 retry.go:31] will retry after 1.43607177s: kubelet not initialised
I0214 04:21:43.832903 1548015 retry.go:31] will retry after 1.235835339s: kubelet not initialised
I0214 04:21:42.329232 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.330406 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.974395 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.477378 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:43.778781 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.778914 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.073614 1548015 retry.go:31] will retry after 4.115318211s: kubelet not initialised
I0214 04:21:49.193659 1548015 retry.go:31] will retry after 3.071167603s: kubelet not initialised
I0214 04:21:46.829802 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.331008 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:46.974416 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.473600 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:48.278392 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:50.279104 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.271827 1548015 retry.go:31] will retry after 4.905866185s: kubelet not initialised
I0214 04:21:51.331690 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.829509 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:51.973092 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.974274 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.280558 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:54.782002 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:55.278849 1548199 pod_ready.go:92] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.278875 1548199 pod_ready.go:81] duration metric: took 39.007391751s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.278887 1548199 pod_ready.go:78] waiting up to 4m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284671 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.284698 1548199 pod_ready.go:81] duration metric: took 5.804847ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284711 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289743 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.289762 1548199 pod_ready.go:81] duration metric: took 5.043413ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289770 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294751 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.294769 1548199 pod_ready.go:81] duration metric: took 4.99309ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294778 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299781 1548199 pod_ready.go:92] pod "kube-proxy-x55kr" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.299805 1548199 pod_ready.go:81] duration metric: took 5.020271ms for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299817 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677017 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.677045 1548199 pod_ready.go:81] duration metric: took 377.218998ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677059 1548199 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
I0214 04:21:57.184269 1548015 retry.go:31] will retry after 9.183740474s: kubelet not initialised
I0214 04:21:56.331498 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.828024 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:56.473208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.475219 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.974208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:57.684889 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.187231 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.829899 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.329789 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.474087 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:05.973662 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:02.683519 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:04.686765 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:06.375294 1548015 retry.go:31] will retry after 10.020373951s: kubelet not initialised
I0214 04:22:05.330250 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.829740 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.830530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.978588 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:10.473694 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.184721 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:11.185656 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.329405 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.829220 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.474366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.975443 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:13.683763 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:15.683805 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:16.402320 1548015 retry.go:31] will retry after 15.374173134s: kubelet not initialised
I0214 04:22:16.829525 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.330075 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:17.474403 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.973780 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:18.185466 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:20.186291 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.829432 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:23.834007 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.976320 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.474283 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:22.684964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.685062 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.685477 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.329169 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.329997 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.476641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.973366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:30.974012 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:29.184272 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.184459 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.781677 1548015 kubeadm.go:733] kubelet initialised
I0214 04:22:31.781704 1548015 kubeadm.go:734] duration metric: took 50.803779674s waiting for restarted kubelet to initialise ...
I0214 04:22:31.781719 1548015 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:22:31.786850 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791542 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.791560 1548015 pod_ready.go:81] duration metric: took 4.686316ms for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791568 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796485 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.796505 1548015 pod_ready.go:81] duration metric: took 4.931563ms for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796514 1548015 pod_ready.go:78] waiting up to 4m0s for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805785 1548015 pod_ready.go:92] pod "etcd-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.805802 1548015 pod_ready.go:81] duration metric: took 9.282838ms for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805810 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810054 1548015 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.810071 1548015 pod_ready.go:81] duration metric: took 4.255532ms for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810082 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182215 1548015 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.182243 1548015 pod_ready.go:81] duration metric: took 372.153995ms for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182252 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582145 1548015 pod_ready.go:92] pod "kube-proxy-csc94" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.582173 1548015 pod_ready.go:81] duration metric: took 399.915006ms for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582181 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981350 1548015 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.981378 1548015 pod_ready.go:81] duration metric: took 399.188492ms for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981415 1548015 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
I0214 04:22:30.830906 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.330140 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.473744 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.973699 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.186827 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.686309 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:34.989538 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.488713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.488883 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.828958 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.829284 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.829823 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.974025 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.473910 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.688964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.185392 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:41.989551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.487817 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.329132 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.329344 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.475040 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.972605 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.187968 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.683996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.685030 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.488902 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.489494 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.829203 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.829494 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.973991 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:49.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.685120 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.686084 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.988398 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:52.988448 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.332998 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.829030 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.979340 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.476506 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.184251 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:55.685108 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.990421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:57.488098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:59.489487 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.328826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.973425 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.973762 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.185513 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.684633 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.989929 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:04.489964 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.828826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.832159 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.473241 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:03.474787 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.474970 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.685927 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.184376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:06.494093 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:08.989439 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.328777 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.828637 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.829373 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.973237 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.975687 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.184628 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.184711 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.187647 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.488966 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.988214 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.830718 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.329069 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:12.474693 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.977568 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.189114 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:15.684342 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.490073 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.989036 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.329532 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.332792 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:17.475839 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:19.972797 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.184713 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.683768 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.489160 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.489440 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.829097 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.830033 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.830536 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.974815 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.976133 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.684285 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.685554 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:25.988251 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.988908 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.329244 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.330485 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:26.475964 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:28.982419 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.184598 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.683919 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.684156 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.991522 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:32.488915 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.829760 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.329419 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.473542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.973595 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.973745 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.685000 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.685530 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.988612 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.988713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.989808 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.829339 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:39.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.473757 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.474119 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.184045 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.185960 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.488363 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.989158 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.329290 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.329388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.975321 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.473736 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.683468 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:44.690416 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:46.489697 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:48.989092 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.829184 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.831722 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.474154 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.974446 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.184559 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.186644 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.687583 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.489421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:53.988562 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:50.329667 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.338563 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.829530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.472871 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.473807 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.184095 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.687057 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.488978 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.989503 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.829824 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.329912 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.474847 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.973570 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:00.973652 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.184086 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.488818 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.987787 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.830119 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:04.329491 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:02.973916 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.473218 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.686039 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.184833 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.988871 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.989591 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.329626 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.330752 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.973857 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.474126 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.185966 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.684238 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.489965 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.989505 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.829538 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.830552 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.834481 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.973081 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.474984 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.686130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.184428 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.989770 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.488555 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.828863 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.974045 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:20.474441 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.185605 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.684728 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.685632 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.988389 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.989011 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.491174 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.829015 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:23.830388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:22.974348 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:25.473908 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.183571 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.184732 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.989443 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:29.489238 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.329468 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.829440 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:27.973912 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.472580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.184943 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.684148 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.489461 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.989426 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.328521 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.474634 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:34.476234 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.684963 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.185485 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.488685 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.489813 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.829187 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.829640 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.973580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.974641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.684542 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.186898 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.490022 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.988898 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.328976 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.329745 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.829057 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:41.473013 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:43.473476 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:45.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.683866 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.684597 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:46.687189 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.994614 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.489146 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.329572 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.831061 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.474959 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.973243 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.187340 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.684163 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.988804 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.989029 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.489969 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.328728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.328898 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.473423 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.975259 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.184131 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.184881 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.490033 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.989280 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.329901 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.827955 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:57.473867 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:59.973370 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.684729 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.684873 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.487690 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.988399 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.828728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:02.829737 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.973785 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:04.472611 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.183568 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.184388 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.988477 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.989996 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.329020 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.829709 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.821931 1548416 pod_ready.go:81] duration metric: took 4m0.000330437s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
E0214 04:25:09.821969 1548416 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:09.821992 1548416 pod_ready.go:38] duration metric: took 4m13.851272943s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:09.822023 1548416 kubeadm.go:591] duration metric: took 4m23.487018823s to restartPrimaryControlPlane
W0214 04:25:09.822227 1548416 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:09.822321 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:06.472962 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:08.473224 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.475222 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.184478 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.185147 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:11.186402 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.490868 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.989663 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.974982 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.472802 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:13.187130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.685270 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.489955 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.988265 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.473792 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:19.974720 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:18.185036 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:20.687587 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.917450 1548416 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (14.095094363s)
I0214 04:25:23.917578 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:23.933147 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:25:23.944003 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:25:23.954648 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:25:23.954670 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:25:23.954721 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:25:23.964628 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:25:23.964687 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:25:23.975077 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:25:23.985324 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:25:23.985395 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:25:23.994917 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:25:24.003630 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:25:24.003677 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:25:24.012938 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:25:24.021462 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:25:24.021516 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:25:24.030687 1548416 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:25:24.084345 1548416 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:25:24.084459 1548416 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:25:24.247090 1548416 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:25:24.247242 1548416 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:25:24.247374 1548416 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:25:24.485795 1548416 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:25:19.988669 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:21.988724 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.989786 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.487801 1548416 out.go:204] - Generating certificates and keys ...
I0214 04:25:24.487929 1548416 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:25:24.488045 1548416 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:25:24.488156 1548416 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:25:24.488237 1548416 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:25:24.488319 1548416 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:25:24.488383 1548416 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:25:24.488535 1548416 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:25:24.489833 1548416 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:25:24.491055 1548416 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:25:24.492160 1548416 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:25:24.492954 1548416 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:25:24.493057 1548416 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:25:24.698026 1548416 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:25:24.804410 1548416 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:25:24.911827 1548416 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:25:25.071754 1548416 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:25:25.072362 1548416 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:25:25.074829 1548416 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:25:25.076806 1548416 out.go:204] - Booting up control plane ...
I0214 04:25:25.076910 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:25:25.077012 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:25:25.077429 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:25:25.093739 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:25:25.094504 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:25:25.094594 1548416 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:25:25.245976 1548416 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:25:22.473854 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.474402 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.183996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:25.186464 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.489150 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.489653 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.974174 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.975072 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.473411 1548589 pod_ready.go:81] duration metric: took 4m0.007878225s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:25:30.473436 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0214 04:25:30.473443 1548589 pod_ready.go:38] duration metric: took 4m4.841053907s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:30.473469 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:30.473534 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:30.473603 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:30.529327 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:30.529352 1548589 cri.go:89] found id: ""
I0214 04:25:30.529362 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:30.529463 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.538030 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:30.538092 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:30.589897 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:30.589925 1548589 cri.go:89] found id: ""
I0214 04:25:30.589936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:30.590005 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.595536 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:30.595652 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:30.650191 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:30.650224 1548589 cri.go:89] found id: ""
I0214 04:25:30.650235 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:30.650305 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.666693 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:30.666780 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:30.725870 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:30.725896 1548589 cri.go:89] found id: ""
I0214 04:25:30.725906 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:30.725982 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.731165 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:30.731252 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:30.772330 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:30.772361 1548589 cri.go:89] found id: ""
I0214 04:25:30.772372 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:30.772432 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.777656 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:30.777735 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:30.825727 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:30.825760 1548589 cri.go:89] found id: ""
I0214 04:25:30.825771 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:30.825849 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.830555 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:30.830636 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:30.885427 1548589 cri.go:89] found id: ""
I0214 04:25:30.885461 1548589 logs.go:276] 0 containers: []
W0214 04:25:30.885471 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:30.885480 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:30.885549 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:30.932894 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:30.932928 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:30.932935 1548589 cri.go:89] found id: ""
I0214 04:25:30.932945 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:30.933011 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.937903 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.941946 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:30.941972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:30.957244 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:30.957298 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:31.006421 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:31.006469 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:27.687719 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.184052 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:33.251700 1548416 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.005690 seconds
I0214 04:25:33.251865 1548416 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:25:33.279172 1548416 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:25:33.813646 1548416 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:25:33.813879 1548416 kubeadm.go:309] [mark-control-plane] Marking the node embed-certs-722906 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:25:34.330117 1548416 kubeadm.go:309] [bootstrap-token] Using token: ljwfse.zvxgc1v12nz5i5q8
I0214 04:25:30.490723 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:32.490888 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.331680 1548416 out.go:204] - Configuring RBAC rules ...
I0214 04:25:34.331854 1548416 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:25:34.338019 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:25:34.346414 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:25:34.356280 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:25:34.363364 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:25:34.367537 1548416 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:25:34.386334 1548416 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:25:34.635264 1548416 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:25:34.746128 1548416 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:25:34.747640 1548416 kubeadm.go:309]
I0214 04:25:34.747718 1548416 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:25:34.747729 1548416 kubeadm.go:309]
I0214 04:25:34.747815 1548416 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:25:34.747825 1548416 kubeadm.go:309]
I0214 04:25:34.747855 1548416 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:25:34.747919 1548416 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:25:34.747991 1548416 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:25:34.748001 1548416 kubeadm.go:309]
I0214 04:25:34.748053 1548416 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:25:34.748057 1548416 kubeadm.go:309]
I0214 04:25:34.748096 1548416 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:25:34.748102 1548416 kubeadm.go:309]
I0214 04:25:34.748166 1548416 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:25:34.748221 1548416 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:25:34.748286 1548416 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:25:34.748293 1548416 kubeadm.go:309]
I0214 04:25:34.748388 1548416 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:25:34.748476 1548416 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:25:34.748483 1548416 kubeadm.go:309]
I0214 04:25:34.748576 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748694 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:25:34.748719 1548416 kubeadm.go:309] --control-plane
I0214 04:25:34.748725 1548416 kubeadm.go:309]
I0214 04:25:34.748824 1548416 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:25:34.748831 1548416 kubeadm.go:309]
I0214 04:25:34.748897 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748999 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:25:34.752065 1548416 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:25:34.752103 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:25:34.752116 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:25:34.753766 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:25:34.754902 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:25:34.796511 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:25:34.854873 1548416 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:25:34.855010 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:34.855147 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-722906 minikube.k8s.io/updated_at=2024_02_14T04_25_34_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=embed-certs-722906 minikube.k8s.io/primary=true
I0214 04:25:34.950220 1548416 ops.go:34] apiserver oom_adj: -16
I0214 04:25:35.202083 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:31.057754 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:31.057788 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:31.119551 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:31.119592 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:31.180933 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:31.180972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:31.236512 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:31.236559 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:31.290709 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:31.290749 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:31.343989 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:31.344029 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:31.391042 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:31.391076 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:31.436728 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:31.436768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:31.924773 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:31.924835 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:32.076912 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:32.076958 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.634522 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:34.660761 1548589 api_server.go:72] duration metric: took 4m16.796363202s to wait for apiserver process to appear ...
I0214 04:25:34.660794 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:34.660846 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:34.660918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:34.730857 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.730891 1548589 cri.go:89] found id: ""
I0214 04:25:34.730902 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:34.730963 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.735849 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:34.735918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:34.791895 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:34.791926 1548589 cri.go:89] found id: ""
I0214 04:25:34.791936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:34.791999 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.798706 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:34.798792 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:34.848256 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:34.848280 1548589 cri.go:89] found id: ""
I0214 04:25:34.848288 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:34.848339 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.853629 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:34.853699 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:34.908476 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:34.908509 1548589 cri.go:89] found id: ""
I0214 04:25:34.908521 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:34.908586 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.913799 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:34.913881 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:34.956647 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:34.956733 1548589 cri.go:89] found id: ""
I0214 04:25:34.956747 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:34.956799 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.961972 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:34.962058 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:35.005734 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.005763 1548589 cri.go:89] found id: ""
I0214 04:25:35.005772 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:35.005824 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.012134 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:35.012215 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:35.057761 1548589 cri.go:89] found id: ""
I0214 04:25:35.057788 1548589 logs.go:276] 0 containers: []
W0214 04:25:35.057795 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:35.057801 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:35.057902 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:35.100965 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.100992 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.100996 1548589 cri.go:89] found id: ""
I0214 04:25:35.101003 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:35.101058 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.105885 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.110123 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:35.110151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:35.189435 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:35.189477 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:35.206289 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:35.206328 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:35.263399 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:35.263450 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.329373 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:35.329410 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.370980 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:35.371016 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:35.519971 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:35.520010 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.565453 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:35.565488 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:35.622596 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:35.622626 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:35.679526 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:35.679563 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:35.726343 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:35.726386 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:35.774533 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:35.774578 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:35.819726 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:35.819758 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:32.186812 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.686565 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.989832 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:37.489923 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:35.702927 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.203043 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.702176 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.203031 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.702509 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.203045 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.703098 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.203120 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.702193 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:40.202469 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.718371 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:25:38.726571 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:25:38.728501 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:25:38.728531 1548589 api_server.go:131] duration metric: took 4.067727996s to wait for apiserver health ...
I0214 04:25:38.728543 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:38.728574 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:38.728639 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:38.777478 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:38.777506 1548589 cri.go:89] found id: ""
I0214 04:25:38.777516 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:38.777582 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.785109 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:38.785170 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:38.829370 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:38.829398 1548589 cri.go:89] found id: ""
I0214 04:25:38.829409 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:38.829475 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.834285 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:38.834359 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:38.879921 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:38.879967 1548589 cri.go:89] found id: ""
I0214 04:25:38.879978 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:38.880045 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.884937 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:38.884994 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:38.929638 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:38.929663 1548589 cri.go:89] found id: ""
I0214 04:25:38.929672 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:38.929739 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.934420 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:38.934485 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:38.982428 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:38.982464 1548589 cri.go:89] found id: ""
I0214 04:25:38.982476 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:38.982541 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.987942 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:38.988014 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:39.027009 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:39.027041 1548589 cri.go:89] found id: ""
I0214 04:25:39.027051 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:39.027115 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.031258 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:39.031312 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:39.074333 1548589 cri.go:89] found id: ""
I0214 04:25:39.074363 1548589 logs.go:276] 0 containers: []
W0214 04:25:39.074374 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:39.074382 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:39.074445 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:39.121097 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.121119 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.121125 1548589 cri.go:89] found id: ""
I0214 04:25:39.121132 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:39.121192 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.125559 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.129744 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:39.129768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:39.169819 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:39.169857 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:39.217193 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:39.217224 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:39.267119 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:39.267173 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:39.333382 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:39.333426 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.380541 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:39.380575 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.426020 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:39.426061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:39.787418 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:39.787471 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:39.850366 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:39.850412 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:39.970082 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:39.970127 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:40.014849 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:40.014876 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:40.064556 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:40.064597 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:40.116058 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:40.116092 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:37.187809 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:39.684638 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.642784 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:25:42.642824 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.642836 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.642847 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.642854 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.642860 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.642866 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.642876 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.642889 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.642900 1548589 system_pods.go:74] duration metric: took 3.914348976s to wait for pod list to return data ...
I0214 04:25:42.642913 1548589 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:42.647178 1548589 default_sa.go:45] found service account: "default"
I0214 04:25:42.647199 1548589 default_sa.go:55] duration metric: took 4.279291ms for default service account to be created ...
I0214 04:25:42.647208 1548589 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:42.656453 1548589 system_pods.go:86] 8 kube-system pods found
I0214 04:25:42.656474 1548589 system_pods.go:89] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.656480 1548589 system_pods.go:89] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.656485 1548589 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.656490 1548589 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.656494 1548589 system_pods.go:89] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.656498 1548589 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.656504 1548589 system_pods.go:89] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.656509 1548589 system_pods.go:89] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.656517 1548589 system_pods.go:126] duration metric: took 9.303804ms to wait for k8s-apps to be running ...
I0214 04:25:42.656523 1548589 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:42.656567 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:42.675938 1548589 system_svc.go:56] duration metric: took 19.40332ms WaitForService to wait for kubelet
I0214 04:25:42.675968 1548589 kubeadm.go:576] duration metric: took 4m24.811581461s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:42.675997 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:42.680017 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:42.680051 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:42.680099 1548589 node_conditions.go:105] duration metric: took 4.09496ms to run NodePressure ...
I0214 04:25:42.680116 1548589 start.go:240] waiting for startup goroutines ...
I0214 04:25:42.680129 1548589 start.go:245] waiting for cluster config update ...
I0214 04:25:42.680147 1548589 start.go:254] writing updated cluster config ...
I0214 04:25:42.680530 1548589 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:42.736509 1548589 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:42.739295 1548589 out.go:177] * Done! kubectl is now configured to use "default-k8s-diff-port-224675" cluster and "default" namespace by default
I0214 04:25:39.988499 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.487797 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.488009 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:40.702290 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.202214 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.702270 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.202407 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.702166 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.202987 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.702484 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.202110 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.702114 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:45.202558 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.184826 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.685376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.685510 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:45.702721 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.202291 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.703068 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.837652 1548416 kubeadm.go:1106] duration metric: took 11.982686598s to wait for elevateKubeSystemPrivileges
W0214 04:25:46.837704 1548416 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:25:46.837716 1548416 kubeadm.go:393] duration metric: took 5m0.565491944s to StartCluster
I0214 04:25:46.837742 1548416 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.837855 1548416 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:25:46.840795 1548416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.841125 1548416 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:25:46.842696 1548416 out.go:177] * Verifying Kubernetes components...
I0214 04:25:46.841205 1548416 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:25:46.841387 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:25:46.844126 1548416 addons.go:69] Setting default-storageclass=true in profile "embed-certs-722906"
I0214 04:25:46.844139 1548416 addons.go:69] Setting metrics-server=true in profile "embed-certs-722906"
I0214 04:25:46.844161 1548416 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-722906"
I0214 04:25:46.844186 1548416 addons.go:234] Setting addon metrics-server=true in "embed-certs-722906"
W0214 04:25:46.844201 1548416 addons.go:243] addon metrics-server should already be in state true
I0214 04:25:46.844238 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844126 1548416 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-722906"
I0214 04:25:46.844300 1548416 addons.go:234] Setting addon storage-provisioner=true in "embed-certs-722906"
W0214 04:25:46.844326 1548416 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:25:46.844126 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:25:46.844363 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844562 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844592 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844663 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844699 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844736 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844799 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.861369 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43067
I0214 04:25:46.861608 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41001
I0214 04:25:46.862027 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862176 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862591 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862626 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.862672 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862689 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.863022 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863215 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37963
I0214 04:25:46.863398 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863596 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.863763 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.864032 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.864056 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.864428 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.864568 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.864611 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.864955 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.865007 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.867986 1548416 addons.go:234] Setting addon default-storageclass=true in "embed-certs-722906"
W0214 04:25:46.868013 1548416 addons.go:243] addon default-storageclass should already be in state true
I0214 04:25:46.868058 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.868432 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.868487 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.881291 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39701
I0214 04:25:46.882035 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.882540 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.882555 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.883263 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34619
I0214 04:25:46.883304 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.883548 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.883717 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.884554 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.884580 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.885036 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.885241 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.885647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.885718 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35895
I0214 04:25:46.887988 1548416 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:25:46.886555 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.886681 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.889304 1548416 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:46.889318 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:25:46.889335 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.890487 1548416 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:25:46.489212 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:48.990116 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.890206 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.891625 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.891590 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:25:46.891694 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:25:46.891710 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.892169 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.892674 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893285 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.893311 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.893494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.893556 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.893583 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893734 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.893993 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.894174 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.894439 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.894862 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.894886 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.895040 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.895172 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.895286 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.895362 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.912395 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38507
I0214 04:25:46.912945 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.913571 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.913598 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.913955 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.914139 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.915701 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.915924 1548416 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:46.915936 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:25:46.915949 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.918689 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919161 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.919259 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919614 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.919795 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.919991 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.920118 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:47.174988 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:25:47.211043 1548416 node_ready.go:35] waiting up to 6m0s for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248873 1548416 node_ready.go:49] node "embed-certs-722906" has status "Ready":"True"
I0214 04:25:47.248902 1548416 node_ready.go:38] duration metric: took 37.827003ms for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248914 1548416 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:47.291049 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:47.295308 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:47.304396 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:25:47.304431 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:25:47.312577 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:47.352103 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:25:47.352142 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:25:47.652975 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:47.653009 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:25:47.701829 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:49.316545 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.106061464s)
I0214 04:25:49.397232 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397245 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.084547595s)
I0214 04:25:49.397335 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397353 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397607 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397715 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397743 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397752 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397771 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397807 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397824 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397839 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397694 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.397987 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.398013 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398033 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.398118 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398132 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.454369 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.454395 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.454743 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.454768 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.658753 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.956862479s)
I0214 04:25:49.658827 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.658845 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659187 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659205 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659217 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.659226 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659474 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659492 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659501 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.659504 1548416 addons.go:470] Verifying addon metrics-server=true in "embed-certs-722906"
I0214 04:25:49.662582 1548416 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:25:49.664096 1548416 addons.go:505] duration metric: took 2.82289258s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:25:48.687996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:51.185303 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:50.303857 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:50.303890 1548416 pod_ready.go:81] duration metric: took 3.008544941s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:50.303906 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312602 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.312630 1548416 pod_ready.go:81] duration metric: took 1.008715179s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312643 1548416 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318888 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.318913 1548416 pod_ready.go:81] duration metric: took 6.260888ms for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318925 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326339 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.326358 1548416 pod_ready.go:81] duration metric: took 7.425473ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326366 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336131 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.336157 1548416 pod_ready.go:81] duration metric: took 9.784766ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336170 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344427 1548416 pod_ready.go:92] pod "kube-proxy-tzpr9" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.344452 1548416 pod_ready.go:81] duration metric: took 1.008276095s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344461 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703142 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.703165 1548416 pod_ready.go:81] duration metric: took 358.6975ms for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703173 1548416 pod_ready.go:38] duration metric: took 5.454247611s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:52.703187 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:52.703240 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:52.721042 1548416 api_server.go:72] duration metric: took 5.879877619s to wait for apiserver process to appear ...
I0214 04:25:52.721069 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:52.721091 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:25:52.727234 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:25:52.728584 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:25:52.728607 1548416 api_server.go:131] duration metric: took 7.530707ms to wait for apiserver health ...
I0214 04:25:52.728617 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:52.905660 1548416 system_pods.go:59] 9 kube-system pods found
I0214 04:25:52.905694 1548416 system_pods.go:61] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:52.905702 1548416 system_pods.go:61] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:52.905709 1548416 system_pods.go:61] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:52.905714 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:52.905719 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:52.905724 1548416 system_pods.go:61] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:52.905731 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:52.905740 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:52.905753 1548416 system_pods.go:61] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:52.905764 1548416 system_pods.go:74] duration metric: took 177.140213ms to wait for pod list to return data ...
I0214 04:25:52.905777 1548416 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:53.100558 1548416 default_sa.go:45] found service account: "default"
I0214 04:25:53.100586 1548416 default_sa.go:55] duration metric: took 194.801355ms for default service account to be created ...
I0214 04:25:53.100596 1548416 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:53.304778 1548416 system_pods.go:86] 9 kube-system pods found
I0214 04:25:53.304808 1548416 system_pods.go:89] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:53.304814 1548416 system_pods.go:89] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:53.304818 1548416 system_pods.go:89] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:53.304822 1548416 system_pods.go:89] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:53.304826 1548416 system_pods.go:89] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:53.304830 1548416 system_pods.go:89] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:53.304836 1548416 system_pods.go:89] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:53.304843 1548416 system_pods.go:89] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:53.304848 1548416 system_pods.go:89] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:53.304857 1548416 system_pods.go:126] duration metric: took 204.2556ms to wait for k8s-apps to be running ...
I0214 04:25:53.304863 1548416 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:53.304908 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:53.321806 1548416 system_svc.go:56] duration metric: took 16.912625ms WaitForService to wait for kubelet
I0214 04:25:53.321844 1548416 kubeadm.go:576] duration metric: took 6.480687176s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:53.321873 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:53.501541 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:53.501571 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:53.501582 1548416 node_conditions.go:105] duration metric: took 179.703171ms to run NodePressure ...
I0214 04:25:53.501593 1548416 start.go:240] waiting for startup goroutines ...
I0214 04:25:53.501600 1548416 start.go:245] waiting for cluster config update ...
I0214 04:25:53.501610 1548416 start.go:254] writing updated cluster config ...
I0214 04:25:53.501868 1548416 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:53.554017 1548416 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:53.556089 1548416 out.go:177] * Done! kubectl is now configured to use "embed-certs-722906" cluster and "default" namespace by default
I0214 04:25:51.488936 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.988506 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.686041 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:55.677854 1548199 pod_ready.go:81] duration metric: took 4m0.000776482s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
E0214 04:25:55.677886 1548199 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:55.677908 1548199 pod_ready.go:38] duration metric: took 4m39.417217273s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:55.677936 1548199 kubeadm.go:591] duration metric: took 5m19.120995318s to restartPrimaryControlPlane
W0214 04:25:55.678003 1548199 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:55.678033 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:55.989446 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:58.490001 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:00.989098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:03.488351 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:05.491080 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:07.990103 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:09.129870 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (13.451791169s)
I0214 04:26:09.129957 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:09.143478 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:09.153419 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:09.162505 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:09.162527 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:26:09.162576 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:09.171259 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:09.171322 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:09.179961 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:09.188272 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:09.188334 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:09.197398 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:09.206885 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:09.206953 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:09.215702 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:09.224447 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:09.224504 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:09.233076 1548199 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:26:09.449400 1548199 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:10.489135 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:12.490085 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:14.989284 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:16.989501 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:19.489121 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:20.589989 1548199 kubeadm.go:309] [init] Using Kubernetes version: v1.29.0-rc.2
I0214 04:26:20.590079 1548199 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:20.590160 1548199 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:20.590282 1548199 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:20.590404 1548199 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:20.590459 1548199 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:20.592006 1548199 out.go:204] - Generating certificates and keys ...
I0214 04:26:20.592122 1548199 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:20.592229 1548199 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:20.592338 1548199 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:20.592403 1548199 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:20.592503 1548199 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:20.592599 1548199 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:20.592693 1548199 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:20.592787 1548199 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:20.592902 1548199 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:20.592997 1548199 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:20.593045 1548199 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:20.593123 1548199 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:20.593198 1548199 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:20.593294 1548199 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0214 04:26:20.593365 1548199 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:20.593442 1548199 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:20.593534 1548199 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:20.593660 1548199 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:20.593761 1548199 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:20.595405 1548199 out.go:204] - Booting up control plane ...
I0214 04:26:20.595518 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:20.595632 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:20.595748 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:20.595890 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:20.596009 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:20.596086 1548199 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:26:20.596252 1548199 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:20.596349 1548199 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.003185 seconds
I0214 04:26:20.596497 1548199 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:20.596673 1548199 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:20.596762 1548199 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:20.597019 1548199 kubeadm.go:309] [mark-control-plane] Marking the node no-preload-527067 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:26:20.597103 1548199 kubeadm.go:309] [bootstrap-token] Using token: yl18az.ikdg7kzcuqfvy8ic
I0214 04:26:20.598756 1548199 out.go:204] - Configuring RBAC rules ...
I0214 04:26:20.598884 1548199 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:20.598995 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:26:20.599173 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:20.599325 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:20.599486 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:20.599606 1548199 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:20.599753 1548199 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:26:20.599838 1548199 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:20.599907 1548199 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:20.599918 1548199 kubeadm.go:309]
I0214 04:26:20.599999 1548199 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:20.600014 1548199 kubeadm.go:309]
I0214 04:26:20.600130 1548199 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:20.600144 1548199 kubeadm.go:309]
I0214 04:26:20.600185 1548199 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:20.600262 1548199 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:20.600334 1548199 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:20.600344 1548199 kubeadm.go:309]
I0214 04:26:20.600414 1548199 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:26:20.600423 1548199 kubeadm.go:309]
I0214 04:26:20.600486 1548199 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:26:20.600494 1548199 kubeadm.go:309]
I0214 04:26:20.600559 1548199 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:20.600678 1548199 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:20.600743 1548199 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:20.600749 1548199 kubeadm.go:309]
I0214 04:26:20.600828 1548199 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:20.600931 1548199 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:20.600952 1548199 kubeadm.go:309]
I0214 04:26:20.601036 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601125 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:20.601144 1548199 kubeadm.go:309] --control-plane
I0214 04:26:20.601149 1548199 kubeadm.go:309]
I0214 04:26:20.601216 1548199 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:20.601222 1548199 kubeadm.go:309]
I0214 04:26:20.601302 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601453 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:20.601475 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:26:20.601488 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:20.603974 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:20.605318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:20.625217 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:20.665755 1548199 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:20.665828 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:20.665845 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes no-preload-527067 minikube.k8s.io/updated_at=2024_02_14T04_26_20_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=no-preload-527067 minikube.k8s.io/primary=true
I0214 04:26:20.978111 1548199 ops.go:34] apiserver oom_adj: -16
I0214 04:26:20.978350 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.478785 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.490359 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:23.988822 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:21.979082 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.478676 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.978647 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.479016 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.979139 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.478469 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.979026 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.478991 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.979248 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:26.478422 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.989074 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:28.488567 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:26.978971 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.478678 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.978661 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.479360 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.978439 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.479419 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.978677 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.478657 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.979294 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:31.478514 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.489293 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.490551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.982429 1548015 pod_ready.go:81] duration metric: took 4m0.000999321s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
E0214 04:26:32.982455 1548015 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:26:32.982485 1548015 pod_ready.go:38] duration metric: took 4m1.20075372s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:32.982524 1548015 kubeadm.go:591] duration metric: took 5m2.799685673s to restartPrimaryControlPlane
W0214 04:26:32.982589 1548015 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:26:32.982617 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:26:31.979099 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.478987 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.979077 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.479009 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.979314 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.478489 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.612101 1548199 kubeadm.go:1106] duration metric: took 13.946337661s to wait for elevateKubeSystemPrivileges
W0214 04:26:34.612159 1548199 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:26:34.612171 1548199 kubeadm.go:393] duration metric: took 5m58.102428414s to StartCluster
I0214 04:26:34.612196 1548199 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.612300 1548199 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:26:34.615005 1548199 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.615369 1548199 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:26:34.617155 1548199 out.go:177] * Verifying Kubernetes components...
I0214 04:26:34.615466 1548199 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:26:34.615560 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:26:34.618768 1548199 addons.go:69] Setting storage-provisioner=true in profile "no-preload-527067"
I0214 04:26:34.618791 1548199 addons.go:69] Setting metrics-server=true in profile "no-preload-527067"
I0214 04:26:34.618813 1548199 addons.go:234] Setting addon storage-provisioner=true in "no-preload-527067"
I0214 04:26:34.618820 1548199 addons.go:234] Setting addon metrics-server=true in "no-preload-527067"
W0214 04:26:34.618825 1548199 addons.go:243] addon storage-provisioner should already be in state true
W0214 04:26:34.618829 1548199 addons.go:243] addon metrics-server should already be in state true
I0214 04:26:34.618772 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:26:34.618884 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618886 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618775 1548199 addons.go:69] Setting default-storageclass=true in profile "no-preload-527067"
I0214 04:26:34.618993 1548199 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-527067"
I0214 04:26:34.619298 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619308 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619333 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619337 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619341 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619372 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.640257 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32983
I0214 04:26:34.640580 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36149
I0214 04:26:34.640597 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39493
I0214 04:26:34.640873 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.640987 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641373 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641523 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641545 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.641583 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641611 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642323 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642329 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642423 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.642449 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642627 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.642851 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.643118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643159 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.643410 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643444 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.646798 1548199 addons.go:234] Setting addon default-storageclass=true in "no-preload-527067"
W0214 04:26:34.646822 1548199 addons.go:243] addon default-storageclass should already be in state true
I0214 04:26:34.646854 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.647219 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.647255 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.661218 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42977
I0214 04:26:34.661948 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.662433 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.662460 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.662620 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33585
I0214 04:26:34.662742 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43125
I0214 04:26:34.662815 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.662980 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.663003 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663243 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663722 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663743 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.663678 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663990 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.664043 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664472 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664637 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.664688 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.664751 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.665180 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.667379 1548199 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:26:34.668945 1548199 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:34.668969 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:26:34.668989 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.666787 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.670977 1548199 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:26:34.672956 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:26:34.672975 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:26:34.672994 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.673016 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.672384 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673068 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.673095 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673204 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.673357 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.673524 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.676340 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.676867 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.676922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.677027 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.677226 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.677799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.677995 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.688291 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46577
I0214 04:26:34.688787 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.689408 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.689428 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.689974 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.690207 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.691884 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.692131 1548199 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:34.692145 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:26:34.692161 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.695649 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696104 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.696127 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696274 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.696463 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.696600 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.696724 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.961474 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:26:34.991187 1548199 node_ready.go:35] waiting up to 6m0s for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001485 1548199 node_ready.go:49] node "no-preload-527067" has status "Ready":"True"
I0214 04:26:35.001505 1548199 node_ready.go:38] duration metric: took 10.286336ms for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001515 1548199 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:35.008527 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:35.194026 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:26:35.194058 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:26:35.195705 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:35.220973 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:35.241307 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:26:35.241374 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:26:35.312068 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:35.312103 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:26:35.375420 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169901 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170341 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170364 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170376 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170386 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170395 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170472 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170493 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170504 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170514 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170906 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170927 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170931 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170961 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170970 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.240387 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.240440 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.240813 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.240831 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365401 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365431 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.365774 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.365798 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365808 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.365814 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365836 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.366107 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.366128 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.366141 1548199 addons.go:470] Verifying addon metrics-server=true in "no-preload-527067"
I0214 04:26:36.367846 1548199 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:26:36.369323 1548199 addons.go:505] duration metric: took 1.753864307s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:26:37.042437 1548199 pod_ready.go:102] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:38.019213 1548199 pod_ready.go:92] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.019249 1548199 pod_ready.go:81] duration metric: took 3.010693835s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.019263 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027650 1548199 pod_ready.go:92] pod "coredns-76f75df574-m2q5f" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.027677 1548199 pod_ready.go:81] duration metric: took 8.406148ms for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027690 1548199 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.033993 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.034019 1548199 pod_ready.go:81] duration metric: took 6.321413ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.034028 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042724 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.042759 1548199 pod_ready.go:81] duration metric: took 8.716807ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042772 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050793 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.050819 1548199 pod_ready.go:81] duration metric: took 8.039526ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050828 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213505 1548199 pod_ready.go:92] pod "kube-proxy-66w6n" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.213536 1548199 pod_ready.go:81] duration metric: took 1.162700616s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213550 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613918 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.613945 1548199 pod_ready.go:81] duration metric: took 400.387683ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613953 1548199 pod_ready.go:38] duration metric: took 4.6124289s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:39.613972 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:26:39.614036 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:26:39.630218 1548199 api_server.go:72] duration metric: took 5.014782329s to wait for apiserver process to appear ...
I0214 04:26:39.630255 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:26:39.630286 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:26:39.637180 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:26:39.638716 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:26:39.638768 1548199 api_server.go:131] duration metric: took 8.502857ms to wait for apiserver health ...
I0214 04:26:39.638776 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:26:39.824405 1548199 system_pods.go:59] 9 kube-system pods found
I0214 04:26:39.824444 1548199 system_pods.go:61] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:39.824452 1548199 system_pods.go:61] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:39.824459 1548199 system_pods.go:61] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:39.824466 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:39.824473 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:39.824480 1548199 system_pods.go:61] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:39.824486 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:39.824497 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:39.824506 1548199 system_pods.go:61] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:39.824520 1548199 system_pods.go:74] duration metric: took 185.738017ms to wait for pod list to return data ...
I0214 04:26:39.824530 1548199 default_sa.go:34] waiting for default service account to be created ...
I0214 04:26:40.013391 1548199 default_sa.go:45] found service account: "default"
I0214 04:26:40.013415 1548199 default_sa.go:55] duration metric: took 188.875578ms for default service account to be created ...
I0214 04:26:40.013424 1548199 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:26:40.217587 1548199 system_pods.go:86] 9 kube-system pods found
I0214 04:26:40.217616 1548199 system_pods.go:89] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:40.217622 1548199 system_pods.go:89] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:40.217626 1548199 system_pods.go:89] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:40.217630 1548199 system_pods.go:89] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:40.217635 1548199 system_pods.go:89] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:40.217639 1548199 system_pods.go:89] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:40.217644 1548199 system_pods.go:89] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:40.217651 1548199 system_pods.go:89] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:40.217656 1548199 system_pods.go:89] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:40.217665 1548199 system_pods.go:126] duration metric: took 204.236287ms to wait for k8s-apps to be running ...
I0214 04:26:40.217672 1548199 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:26:40.217718 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:40.234093 1548199 system_svc.go:56] duration metric: took 16.409726ms WaitForService to wait for kubelet
I0214 04:26:40.234124 1548199 kubeadm.go:576] duration metric: took 5.61871569s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:26:40.234149 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:26:40.414050 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:26:40.414083 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:26:40.414095 1548199 node_conditions.go:105] duration metric: took 179.940381ms to run NodePressure ...
I0214 04:26:40.414107 1548199 start.go:240] waiting for startup goroutines ...
I0214 04:26:40.414113 1548199 start.go:245] waiting for cluster config update ...
I0214 04:26:40.414123 1548199 start.go:254] writing updated cluster config ...
I0214 04:26:40.414399 1548199 ssh_runner.go:195] Run: rm -f paused
I0214 04:26:40.471952 1548199 start.go:599] kubectl: 1.29.1, cluster: 1.29.0-rc.2 (minor skew: 0)
I0214 04:26:40.474067 1548199 out.go:177] * Done! kubectl is now configured to use "no-preload-527067" cluster and "default" namespace by default
I0214 04:26:39.897152 1548015 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (6.91450391s)
I0214 04:26:39.897269 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:39.912739 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:39.923449 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:39.939932 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:39.939961 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:26:39.940018 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:39.953815 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:39.953883 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:39.962552 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:39.971167 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:39.971216 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:39.979864 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:39.988192 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:39.988315 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:39.997134 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:40.005722 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:40.005762 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:40.015266 1548015 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0214 04:26:40.076413 1548015 kubeadm.go:309] [init] Using Kubernetes version: v1.16.0
I0214 04:26:40.076723 1548015 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:40.230449 1548015 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:40.230618 1548015 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:40.230731 1548015 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:40.478573 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:40.479934 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:40.489997 1548015 kubeadm.go:309] [kubelet-start] Activating the kubelet service
I0214 04:26:40.644188 1548015 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:40.646342 1548015 out.go:204] - Generating certificates and keys ...
I0214 04:26:40.646467 1548015 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:40.646561 1548015 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:40.646688 1548015 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:40.646835 1548015 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:40.646956 1548015 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:40.647034 1548015 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:40.647235 1548015 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:40.647843 1548015 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:40.648304 1548015 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:40.649043 1548015 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:40.649108 1548015 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:40.649182 1548015 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:40.935104 1548015 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:41.023680 1548015 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:41.246180 1548015 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:41.346131 1548015 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:41.346986 1548015 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:41.349022 1548015 out.go:204] - Booting up control plane ...
I0214 04:26:41.349146 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:41.352956 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:41.355013 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:41.356192 1548015 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:41.359118 1548015 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:52.863670 1548015 kubeadm.go:309] [apiclient] All control plane components are healthy after 11.504059 seconds
I0214 04:26:52.863792 1548015 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:52.880996 1548015 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config-1.16" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:53.404015 1548015 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:53.404215 1548015 kubeadm.go:309] [mark-control-plane] Marking the node old-k8s-version-960884 as control-plane by adding the label "node-role.kubernetes.io/master=''"
I0214 04:26:53.916361 1548015 kubeadm.go:309] [bootstrap-token] Using token: 0ncwgq.h72unli3702wifzv
I0214 04:26:53.917805 1548015 out.go:204] - Configuring RBAC rules ...
I0214 04:26:53.917949 1548015 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:53.927093 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:53.932015 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:53.935192 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:53.938316 1548015 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:54.012603 1548015 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:54.352255 1548015 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:54.354368 1548015 kubeadm.go:309]
I0214 04:26:54.354465 1548015 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:54.354478 1548015 kubeadm.go:309]
I0214 04:26:54.354557 1548015 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:54.354569 1548015 kubeadm.go:309]
I0214 04:26:54.354605 1548015 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:54.354686 1548015 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:54.354760 1548015 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:54.354775 1548015 kubeadm.go:309]
I0214 04:26:54.354824 1548015 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:54.354894 1548015 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:54.354972 1548015 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:54.354983 1548015 kubeadm.go:309]
I0214 04:26:54.355115 1548015 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:54.355264 1548015 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:54.355276 1548015 kubeadm.go:309]
I0214 04:26:54.355393 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355557 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:54.355606 1548015 kubeadm.go:309] --control-plane
I0214 04:26:54.355613 1548015 kubeadm.go:309]
I0214 04:26:54.355679 1548015 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:54.355686 1548015 kubeadm.go:309]
I0214 04:26:54.355780 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355925 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:54.356354 1548015 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:54.356485 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:26:54.356504 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:54.358086 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:54.359624 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:54.371756 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:54.389927 1548015 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:54.390013 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes old-k8s-version-960884 minikube.k8s.io/updated_at=2024_02_14T04_26_54_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=old-k8s-version-960884 minikube.k8s.io/primary=true
I0214 04:26:54.390016 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:54.431990 1548015 ops.go:34] apiserver oom_adj: -16
I0214 04:26:54.626609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.126943 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.627715 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.127333 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.626894 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.126758 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.626794 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.127609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.627033 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.126732 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.627253 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.127445 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.627305 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.126733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.627428 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.127101 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.627112 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.127318 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.627564 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.127249 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.627430 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.127707 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.627355 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.127647 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.626733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.126735 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.627135 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.127098 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.626845 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.127164 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.627189 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.127584 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.232804 1548015 kubeadm.go:1106] duration metric: took 15.842870427s to wait for elevateKubeSystemPrivileges
W0214 04:27:10.232858 1548015 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:27:10.232867 1548015 kubeadm.go:393] duration metric: took 5m40.102162281s to StartCluster
I0214 04:27:10.232888 1548015 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.233054 1548015 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:27:10.235716 1548015 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.236044 1548015 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:27:10.237600 1548015 out.go:177] * Verifying Kubernetes components...
I0214 04:27:10.236151 1548015 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:27:10.238873 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:27:10.236262 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:27:10.237637 1548015 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-960884"
I0214 04:27:10.238984 1548015 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-960884"
W0214 04:27:10.238997 1548015 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:27:10.237648 1548015 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-960884"
I0214 04:27:10.239056 1548015 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:10.237659 1548015 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-960884"
I0214 04:27:10.239095 1548015 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-960884"
I0214 04:27:10.239028 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
W0214 04:27:10.239066 1548015 addons.go:243] addon metrics-server should already be in state true
I0214 04:27:10.239210 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.239508 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239514 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239536 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239578 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.259948 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37397
I0214 04:27:10.260188 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33423
I0214 04:27:10.260189 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41519
I0214 04:27:10.260483 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260579 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260588 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.261044 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261057 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261069 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261073 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261137 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261152 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261462 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261531 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261578 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261964 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.262091 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262123 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.262177 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262206 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.265041 1548015 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-960884"
W0214 04:27:10.265057 1548015 addons.go:243] addon default-storageclass should already be in state true
I0214 04:27:10.265079 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.265355 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.265388 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.281666 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35115
I0214 04:27:10.282244 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.282939 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.282959 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.283421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.283696 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.285726 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.287965 1548015 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:27:10.287003 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37937
I0214 04:27:10.289469 1548015 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.289494 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:27:10.289513 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.290515 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.291054 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.291066 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.291421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.291810 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.291838 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.295055 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.295588 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295834 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.296046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.296225 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.296429 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.299942 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37359
I0214 04:27:10.300312 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.300732 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.300749 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.301045 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.301234 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.303089 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.304834 1548015 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:27:10.306097 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:27:10.306115 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:27:10.306132 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.308576 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37931
I0214 04:27:10.308935 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.309498 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.309517 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.309629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.309890 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.310082 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.310137 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.310163 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.310357 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.310556 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.310953 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.311088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.311700 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.311908 1548015 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.311922 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:27:10.311935 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.315147 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315579 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.315639 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315862 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.316084 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.316268 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.316454 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.457777 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:27:10.480620 1548015 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.491995 1548015 node_ready.go:49] node "old-k8s-version-960884" has status "Ready":"True"
I0214 04:27:10.492022 1548015 node_ready.go:38] duration metric: took 11.363355ms for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.492035 1548015 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:10.497386 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:10.561045 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.584516 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.593942 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:27:10.593967 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:27:10.621414 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:27:10.621438 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:27:10.694662 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:10.694688 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:27:10.747668 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:11.306565 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306591 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306723 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306756 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306919 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.306969 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.306988 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.306996 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307152 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307075 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307244 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307255 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307265 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307062 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.307496 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307512 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307685 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307698 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.394434 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.394467 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.394790 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.394815 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523086 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523107 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523443 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.523505 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523519 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523534 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523546 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523818 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523839 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523853 1548015 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:11.525563 1548015 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:27:11.526853 1548015 addons.go:505] duration metric: took 1.290704397s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:27:12.555185 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:15.004085 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:17.005427 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:19.506364 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:20.521073 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.521097 1548015 pod_ready.go:81] duration metric: took 10.02368927s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.521114 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530815 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.530849 1548015 pod_ready.go:81] duration metric: took 9.726579ms for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530866 1548015 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.539987 1548015 pod_ready.go:92] pod "kube-proxy-4jhcb" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.540019 1548015 pod_ready.go:81] duration metric: took 9.143682ms for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.540033 1548015 pod_ready.go:38] duration metric: took 10.047982488s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:20.540055 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:27:20.540113 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:27:20.564418 1548015 api_server.go:72] duration metric: took 10.328326886s to wait for apiserver process to appear ...
I0214 04:27:20.564452 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:27:20.564478 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:27:20.573942 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:27:20.575255 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:27:20.575287 1548015 api_server.go:131] duration metric: took 10.826827ms to wait for apiserver health ...
I0214 04:27:20.575298 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:27:20.581952 1548015 system_pods.go:59] 5 kube-system pods found
I0214 04:27:20.581982 1548015 system_pods.go:61] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.581989 1548015 system_pods.go:61] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.581996 1548015 system_pods.go:61] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.582006 1548015 system_pods.go:61] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.582014 1548015 system_pods.go:61] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.582025 1548015 system_pods.go:74] duration metric: took 6.718437ms to wait for pod list to return data ...
I0214 04:27:20.582034 1548015 default_sa.go:34] waiting for default service account to be created ...
I0214 04:27:20.584695 1548015 default_sa.go:45] found service account: "default"
I0214 04:27:20.584724 1548015 default_sa.go:55] duration metric: took 2.678001ms for default service account to be created ...
I0214 04:27:20.584735 1548015 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:27:20.589847 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.589876 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.589886 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.589896 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.589912 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.589924 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.589950 1548015 retry.go:31] will retry after 248.508062ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:20.844936 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.844971 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.844977 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.844981 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.844988 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.844993 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.845010 1548015 retry.go:31] will retry after 367.089613ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.218037 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.218074 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.218082 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.218089 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.218099 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.218105 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.218126 1548015 retry.go:31] will retry after 419.193903ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.642404 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.642441 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.642447 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.642452 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.642459 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.642465 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.642483 1548015 retry.go:31] will retry after 451.345597ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.099422 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.099453 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.099459 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.099466 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.099474 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.099480 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.099499 1548015 retry.go:31] will retry after 651.082119ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.756099 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.756128 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.756134 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.756148 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.756159 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.756169 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.756189 1548015 retry.go:31] will retry after 586.140581ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:23.348131 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:23.348163 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:23.348168 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:23.348172 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:23.348178 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:23.348183 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:23.348202 1548015 retry.go:31] will retry after 870.913743ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:24.224631 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:24.224665 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:24.224674 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:24.224680 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:24.224690 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:24.224697 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:24.224719 1548015 retry.go:31] will retry after 1.13554102s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:25.365563 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:25.365593 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:25.365598 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:25.365603 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:25.365609 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:25.365614 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:25.365633 1548015 retry.go:31] will retry after 1.737635615s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:27.109613 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:27.109642 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:27.109647 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:27.109651 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:27.109657 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:27.109664 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:27.109684 1548015 retry.go:31] will retry after 1.744560644s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:28.860288 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:28.860319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:28.860327 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:28.860333 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:28.860343 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:28.860350 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:28.860372 1548015 retry.go:31] will retry after 2.781231308s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:31.647467 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:31.647509 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:31.647518 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:31.647525 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:31.647536 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:31.647543 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:31.647566 1548015 retry.go:31] will retry after 3.406936773s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:35.060683 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:35.060716 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:35.060721 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:35.060725 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:35.060735 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:35.060742 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:35.060765 1548015 retry.go:31] will retry after 3.181009478s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:38.247591 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:38.247626 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:38.247634 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:38.247639 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:38.247648 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:38.247655 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:38.247679 1548015 retry.go:31] will retry after 4.973684574s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:43.227832 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:43.227888 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:43.227896 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:43.227902 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:43.227914 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:43.227921 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:43.227947 1548015 retry.go:31] will retry after 6.269902816s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:49.502449 1548015 system_pods.go:86] 6 kube-system pods found
I0214 04:27:49.502483 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:49.502491 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:49.502497 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:49.502503 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Pending
I0214 04:27:49.502511 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:49.502518 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:49.502541 1548015 retry.go:31] will retry after 7.09681765s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:56.607786 1548015 system_pods.go:86] 7 kube-system pods found
I0214 04:27:56.607823 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:56.607833 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:56.607843 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:27:56.607850 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:56.607863 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:27:56.607878 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:56.607894 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:56.607917 1548015 retry.go:31] will retry after 9.404244714s: missing components: etcd, kube-apiserver
I0214 04:28:06.017960 1548015 system_pods.go:86] 8 kube-system pods found
I0214 04:28:06.017990 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:06.017995 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:06.017999 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Pending
I0214 04:28:06.018004 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:06.018008 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:06.018012 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:06.018018 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:06.018025 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:06.018044 1548015 retry.go:31] will retry after 13.524747575s: missing components: etcd, kube-apiserver
I0214 04:28:19.549284 1548015 system_pods.go:86] 9 kube-system pods found
I0214 04:28:19.549319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:19.549331 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:19.549337 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Running
I0214 04:28:19.549351 1548015 system_pods.go:89] "kube-apiserver-old-k8s-version-960884" [a70eef81-e29d-4b42-9bba-e396214086b6] Running
I0214 04:28:19.549357 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:19.549364 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:19.549371 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:19.549383 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:19.549394 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:19.549413 1548015 system_pods.go:126] duration metric: took 58.964669894s to wait for k8s-apps to be running ...
I0214 04:28:19.549427 1548015 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:28:19.549488 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:28:19.575300 1548015 system_svc.go:56] duration metric: took 25.86022ms WaitForService to wait for kubelet
I0214 04:28:19.575336 1548015 kubeadm.go:576] duration metric: took 1m9.339251431s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:28:19.575379 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:28:19.579124 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:28:19.579155 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:28:19.579195 1548015 node_conditions.go:105] duration metric: took 3.807562ms to run NodePressure ...
I0214 04:28:19.579211 1548015 start.go:240] waiting for startup goroutines ...
I0214 04:28:19.579226 1548015 start.go:245] waiting for cluster config update ...
I0214 04:28:19.579242 1548015 start.go:254] writing updated cluster config ...
I0214 04:28:19.579574 1548015 ssh_runner.go:195] Run: rm -f paused
I0214 04:28:19.634648 1548015 start.go:599] kubectl: 1.29.1, cluster: 1.16.0 (minor skew: 13)
I0214 04:28:19.636438 1548015 out.go:177]
W0214 04:28:19.637884 1548015 out.go:239] ! /usr/local/bin/kubectl is version 1.29.1, which may have incompatibilities with Kubernetes 1.16.0.
I0214 04:28:19.639178 1548015 out.go:177] - Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'
I0214 04:28:19.640482 1548015 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-960884" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:20:50 UTC, ends at Wed 2024-02-14 04:34:44 UTC. --
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.437471524Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885284437458232,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=4fd9eed6-aa55-4fa0-95ec-df42618d1654 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.437894608Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=e090b767-f60d-4be4-91d7-8184408f7257 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.437949455Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=e090b767-f60d-4be4-91d7-8184408f7257 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.438298574Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:3,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884507870297006,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount
: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0016fc4c4674b56dbb7ab4eaae5f4c19f216c8ff0018b2c92b25d30eb8c27781,PodSandboxId:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,State:CONTAINER_RUNNING,CreatedAt:1707884485783675322,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{io.kubernetes.container.hash: e26927b8,io.kubernetes.container.restartCount: 1,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5,PodSandboxId:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884484151191349,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,},Annotations:map[string]string{io.kubernetes.container.hash: cefb2541,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\
":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:2,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707884476788095612,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: k
ube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540,PodSandboxId:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884476667656879,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7
9b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,},Annotations:map[string]string{io.kubernetes.container.hash: 43b220a8,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90,PodSandboxId:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707884470424343548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.ui
d: e7a7f326a48baeecb655bbb0ffd6a2e7,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b,PodSandboxId:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16f0,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884470045539790,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,},An
notations:map[string]string{io.kubernetes.container.hash: 52c9cfac,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71,PodSandboxId:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884469879485276,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1
edb723716f081e242a25cd747baa8c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2,PodSandboxId:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884469655345549,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c
202422c726957ceb6007b1d37008f86,},Annotations:map[string]string{io.kubernetes.container.hash: 56bc3a18,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=e090b767-f60d-4be4-91d7-8184408f7257 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.480690110Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=07280497-4bd4-45c8-986a-cd85adc294e6 name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.480826221Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=07280497-4bd4-45c8-986a-cd85adc294e6 name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.482599640Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=4211ee42-a6cf-462b-a925-d6d280b89553 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.482981295Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885284482968762,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=4211ee42-a6cf-462b-a925-d6d280b89553 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.483956372Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=ffc71e1b-2992-40b7-ad35-d77d274f7cf4 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.484030024Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=ffc71e1b-2992-40b7-ad35-d77d274f7cf4 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.484298935Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:3,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884507870297006,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount
: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0016fc4c4674b56dbb7ab4eaae5f4c19f216c8ff0018b2c92b25d30eb8c27781,PodSandboxId:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,State:CONTAINER_RUNNING,CreatedAt:1707884485783675322,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{io.kubernetes.container.hash: e26927b8,io.kubernetes.container.restartCount: 1,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5,PodSandboxId:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884484151191349,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,},Annotations:map[string]string{io.kubernetes.container.hash: cefb2541,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\
":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:2,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707884476788095612,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: k
ube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540,PodSandboxId:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884476667656879,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7
9b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,},Annotations:map[string]string{io.kubernetes.container.hash: 43b220a8,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90,PodSandboxId:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707884470424343548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.ui
d: e7a7f326a48baeecb655bbb0ffd6a2e7,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b,PodSandboxId:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16f0,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884470045539790,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,},An
notations:map[string]string{io.kubernetes.container.hash: 52c9cfac,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71,PodSandboxId:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884469879485276,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1
edb723716f081e242a25cd747baa8c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2,PodSandboxId:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884469655345549,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c
202422c726957ceb6007b1d37008f86,},Annotations:map[string]string{io.kubernetes.container.hash: 56bc3a18,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=ffc71e1b-2992-40b7-ad35-d77d274f7cf4 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.531897199Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=1cd6429b-b3c5-44dd-90c7-f60e30090f96 name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.531999666Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=1cd6429b-b3c5-44dd-90c7-f60e30090f96 name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.533536514Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=a6a8613e-923d-4883-a815-fc339870ff44 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.534030239Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885284534013201,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=a6a8613e-923d-4883-a815-fc339870ff44 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.538001078Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=119d6046-5456-438f-8024-e2053bc84342 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.538079974Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=119d6046-5456-438f-8024-e2053bc84342 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.538372234Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:3,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884507870297006,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount
: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0016fc4c4674b56dbb7ab4eaae5f4c19f216c8ff0018b2c92b25d30eb8c27781,PodSandboxId:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,State:CONTAINER_RUNNING,CreatedAt:1707884485783675322,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{io.kubernetes.container.hash: e26927b8,io.kubernetes.container.restartCount: 1,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5,PodSandboxId:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884484151191349,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,},Annotations:map[string]string{io.kubernetes.container.hash: cefb2541,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\
":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:2,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707884476788095612,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: k
ube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540,PodSandboxId:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884476667656879,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7
9b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,},Annotations:map[string]string{io.kubernetes.container.hash: 43b220a8,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90,PodSandboxId:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707884470424343548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.ui
d: e7a7f326a48baeecb655bbb0ffd6a2e7,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b,PodSandboxId:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16f0,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884470045539790,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,},An
notations:map[string]string{io.kubernetes.container.hash: 52c9cfac,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71,PodSandboxId:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884469879485276,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1
edb723716f081e242a25cd747baa8c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2,PodSandboxId:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884469655345549,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c
202422c726957ceb6007b1d37008f86,},Annotations:map[string]string{io.kubernetes.container.hash: 56bc3a18,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=119d6046-5456-438f-8024-e2053bc84342 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.584010145Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=ef5e81c5-e76f-48f5-abc7-baa14616a5ed name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.584105324Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=ef5e81c5-e76f-48f5-abc7-baa14616a5ed name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.586464640Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=2637012b-40de-447e-888e-c3d49966bd46 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.587027623Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885284587010391,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=2637012b-40de-447e-888e-c3d49966bd46 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.587904422Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=5711faaf-3865-43a5-9cca-0e4e5f99ba3f name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.587986228Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=5711faaf-3865-43a5-9cca-0e4e5f99ba3f name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:44 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:34:44.588169957Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:3,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884507870297006,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount
: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0016fc4c4674b56dbb7ab4eaae5f4c19f216c8ff0018b2c92b25d30eb8c27781,PodSandboxId:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,State:CONTAINER_RUNNING,CreatedAt:1707884485783675322,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{io.kubernetes.container.hash: e26927b8,io.kubernetes.container.restartCount: 1,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5,PodSandboxId:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884484151191349,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,},Annotations:map[string]string{io.kubernetes.container.hash: cefb2541,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\
":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:2,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707884476788095612,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: k
ube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540,PodSandboxId:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884476667656879,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7
9b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,},Annotations:map[string]string{io.kubernetes.container.hash: 43b220a8,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90,PodSandboxId:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707884470424343548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.ui
d: e7a7f326a48baeecb655bbb0ffd6a2e7,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b,PodSandboxId:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16f0,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884470045539790,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,},An
notations:map[string]string{io.kubernetes.container.hash: 52c9cfac,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71,PodSandboxId:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884469879485276,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1
edb723716f081e242a25cd747baa8c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2,PodSandboxId:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884469655345549,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c
202422c726957ceb6007b1d37008f86,},Annotations:map[string]string{io.kubernetes.container.hash: 56bc3a18,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=5711faaf-3865-43a5-9cca-0e4e5f99ba3f name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
d096f7fcb2dc8 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 12 minutes ago Running storage-provisioner 3 0aae40d59181d storage-provisioner
0016fc4c4674b gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 13 minutes ago Running busybox 1 b6be0dda00672 busybox
e173981e71707 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 13 minutes ago Running coredns 1 3a925d2231376 coredns-5dd5756b68-27jph
71629517c493b 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 13 minutes ago Exited storage-provisioner 2 0aae40d59181d storage-provisioner
778678b7dbd2a 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 13 minutes ago Running kube-proxy 1 e4a8cb9c32424 kube-proxy-dbkzv
72296e4b9708d e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 13 minutes ago Running kube-scheduler 1 9512e8ddc8b16 kube-scheduler-default-k8s-diff-port-224675
501b83ee5fe01 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 13 minutes ago Running etcd 1 6f26452c365aa etcd-default-k8s-diff-port-224675
127e4a7f35e1f d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 13 minutes ago Running kube-controller-manager 1 4915ecf464ee3 kube-controller-manager-default-k8s-diff-port-224675
be8456a3075c9 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 13 minutes ago Running kube-apiserver 1 3f947fc834ccc kube-apiserver-default-k8s-diff-port-224675
==> coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 7996ca7cabdb2fd3e37b0463c78d5a492f8d30690ee66a90ae7ff24c50d9d936a24d239b3a5946771521ff70c09a796ffaf6ef8abe5753fd1ad5af38b6cdbb7f
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:34134 - 22903 "HINFO IN 1330231995776351025.9001170261616069943. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.034097316s
==> describe nodes <==
Name: default-k8s-diff-port-224675
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=default-k8s-diff-port-224675
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=default-k8s-diff-port-224675
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_12_52_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:12:49 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: default-k8s-diff-port-224675
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 04:34:41 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:31:58 +0000 Wed, 14 Feb 2024 04:12:46 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:31:58 +0000 Wed, 14 Feb 2024 04:12:46 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:31:58 +0000 Wed, 14 Feb 2024 04:12:46 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:31:58 +0000 Wed, 14 Feb 2024 04:21:25 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.61.188
Hostname: default-k8s-diff-port-224675
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: ec335b0ba57942ada23c54d0ebac91cf
System UUID: ec335b0b-a579-42ad-a23c-54d0ebac91cf
Boot ID: e90d263e-ea87-460a-9b3c-6fb2dc30dc5f
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 21m
kube-system coredns-5dd5756b68-27jph 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 21m
kube-system etcd-default-k8s-diff-port-224675 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 21m
kube-system kube-apiserver-default-k8s-diff-port-224675 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 21m
kube-system kube-controller-manager-default-k8s-diff-port-224675 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 21m
kube-system kube-proxy-dbkzv 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 21m
kube-system kube-scheduler-default-k8s-diff-port-224675 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 21m
kube-system metrics-server-57f55c9bc5-8bqch 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (9%!)(MISSING) 0 (0%!)(MISSING) 20m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 21m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 370Mi (17%!)(MISSING) 170Mi (8%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 21m kube-proxy
Normal Starting 13m kube-proxy
Normal NodeAllocatableEnforced 21m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 21m kubelet Node default-k8s-diff-port-224675 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 21m kubelet Node default-k8s-diff-port-224675 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 21m kubelet Node default-k8s-diff-port-224675 status is now: NodeHasSufficientPID
Normal NodeReady 21m kubelet Node default-k8s-diff-port-224675 status is now: NodeReady
Normal Starting 21m kubelet Starting kubelet.
Normal RegisteredNode 21m node-controller Node default-k8s-diff-port-224675 event: Registered Node default-k8s-diff-port-224675 in Controller
Normal Starting 13m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 13m (x8 over 13m) kubelet Node default-k8s-diff-port-224675 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 13m (x8 over 13m) kubelet Node default-k8s-diff-port-224675 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 13m (x7 over 13m) kubelet Node default-k8s-diff-port-224675 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 13m kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 13m node-controller Node default-k8s-diff-port-224675 event: Registered Node default-k8s-diff-port-224675 in Controller
==> dmesg <==
[Feb14 04:20] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.073387] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.573401] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.483834] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.150941] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000001] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.677564] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000005] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)
[ +5.542499] systemd-fstab-generator[659]: Ignoring "noauto" for root device
[ +0.125463] systemd-fstab-generator[670]: Ignoring "noauto" for root device
[ +0.148507] systemd-fstab-generator[683]: Ignoring "noauto" for root device
[ +0.110703] systemd-fstab-generator[694]: Ignoring "noauto" for root device
[ +0.253903] systemd-fstab-generator[718]: Ignoring "noauto" for root device
[Feb14 04:21] systemd-fstab-generator[819]: Ignoring "noauto" for root device
[ +2.936179] systemd-fstab-generator[951]: Ignoring "noauto" for root device
[ +9.599284] systemd-fstab-generator[1571]: Ignoring "noauto" for root device
[ +5.356032] kauditd_printk_skb: 19 callbacks suppressed
==> etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] <==
{"level":"info","ts":"2024-02-14T04:21:13.192847Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"a1d4c90ecc3171ce received MsgPreVoteResp from a1d4c90ecc3171ce at term 2"}
{"level":"info","ts":"2024-02-14T04:21:13.192884Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"a1d4c90ecc3171ce became candidate at term 3"}
{"level":"info","ts":"2024-02-14T04:21:13.192909Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"a1d4c90ecc3171ce received MsgVoteResp from a1d4c90ecc3171ce at term 3"}
{"level":"info","ts":"2024-02-14T04:21:13.192936Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"a1d4c90ecc3171ce became leader at term 3"}
{"level":"info","ts":"2024-02-14T04:21:13.192962Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: a1d4c90ecc3171ce elected leader a1d4c90ecc3171ce at term 3"}
{"level":"info","ts":"2024-02-14T04:21:13.195967Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"a1d4c90ecc3171ce","local-member-attributes":"{Name:default-k8s-diff-port-224675 ClientURLs:[https://192.168.61.188:2379]}","request-path":"/0/members/a1d4c90ecc3171ce/attributes","cluster-id":"5178d02fe96ee090","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T04:21:13.196078Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:21:13.197369Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T04:21:13.197417Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-02-14T04:21:13.196137Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:21:13.198164Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.61.188:2379"}
{"level":"info","ts":"2024-02-14T04:21:13.198607Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"warn","ts":"2024-02-14T04:21:30.017423Z","caller":"etcdserver/v3_server.go:897","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8200647714936397171,"retry-timeout":"500ms"}
{"level":"info","ts":"2024-02-14T04:21:30.139502Z","caller":"traceutil/trace.go:171","msg":"trace[1487217997] transaction","detail":"{read_only:false; response_revision:562; number_of_response:1; }","duration":"773.488488ms","start":"2024-02-14T04:21:29.365993Z","end":"2024-02-14T04:21:30.139482Z","steps":["trace[1487217997] 'process raft request' (duration: 773.328154ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T04:21:30.140154Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T04:21:29.365977Z","time spent":"773.725226ms","remote":"127.0.0.1:46774","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4139,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" mod_revision:500 > success:<request_put:<key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" value_size:4061 >> failure:<request_range:<key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" > >"}
{"level":"warn","ts":"2024-02-14T04:21:30.443057Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"227.50923ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8200647714936397173 > lease_revoke:<id:71ce8da5d131498d>","response":"size:28"}
{"level":"info","ts":"2024-02-14T04:21:30.443321Z","caller":"traceutil/trace.go:171","msg":"trace[1249764214] linearizableReadLoop","detail":"{readStateIndex:601; appliedIndex:600; }","duration":"926.801191ms","start":"2024-02-14T04:21:29.516504Z","end":"2024-02-14T04:21:30.443306Z","steps":["trace[1249764214] 'read index received' (duration: 623.238461ms)","trace[1249764214] 'applied index is now lower than readState.Index' (duration: 303.560624ms)"],"step_count":2}
{"level":"warn","ts":"2024-02-14T04:21:30.443509Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"927.015963ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" ","response":"range_response_count:1 size:4154"}
{"level":"info","ts":"2024-02-14T04:21:30.443571Z","caller":"traceutil/trace.go:171","msg":"trace[1615742973] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675; range_end:; response_count:1; response_revision:562; }","duration":"927.092324ms","start":"2024-02-14T04:21:29.516471Z","end":"2024-02-14T04:21:30.443563Z","steps":["trace[1615742973] 'agreement among raft nodes before linearized reading' (duration: 926.983126ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T04:21:30.443648Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T04:21:29.516453Z","time spent":"927.183183ms","remote":"127.0.0.1:46774","response type":"/etcdserverpb.KV/Range","request count":0,"request size":72,"response count":1,"response size":4177,"request content":"key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" "}
{"level":"warn","ts":"2024-02-14T04:21:30.443694Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"178.933713ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-02-14T04:21:30.443769Z","caller":"traceutil/trace.go:171","msg":"trace[1629340585] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:562; }","duration":"179.015453ms","start":"2024-02-14T04:21:30.264743Z","end":"2024-02-14T04:21:30.443759Z","steps":["trace[1629340585] 'agreement among raft nodes before linearized reading' (duration: 178.909369ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T04:31:13.241723Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":806}
{"level":"info","ts":"2024-02-14T04:31:13.24508Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":806,"took":"2.764583ms","hash":1520445850}
{"level":"info","ts":"2024-02-14T04:31:13.245179Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1520445850,"revision":806,"compact-revision":-1}
==> kernel <==
04:34:44 up 14 min, 0 users, load average: 0.13, 0.14, 0.13
Linux default-k8s-diff-port-224675 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] <==
I0214 04:31:14.961362 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:31:15.961362 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:31:15.961417 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:31:15.961425 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:31:15.961457 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:31:15.961503 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:31:15.962783 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:32:14.779600 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:32:15.961744 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:32:15.961911 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:32:15.961956 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:32:15.962964 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:32:15.963089 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:32:15.963131 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:33:14.780409 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I0214 04:34:14.780716 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:34:15.963073 1 handler_proxy.go:93] no RequestInfo found in the context
W0214 04:34:15.963297 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:34:15.963388 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
E0214 04:34:15.963408 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:34:15.963419 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:34:15.964696 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
==> kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] <==
I0214 04:28:58.374422 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:29:27.868166 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:29:28.382580 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:29:57.874818 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:29:58.391624 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:30:27.880667 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:30:28.399740 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:30:57.885960 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:30:58.408972 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:31:27.891982 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:31:28.417172 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:31:57.898070 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:31:58.429570 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:32:27.904681 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:32:28.439076 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
I0214 04:32:28.659140 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="363.073µs"
I0214 04:32:42.651123 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="201.152µs"
E0214 04:32:57.910993 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:32:58.448153 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:33:27.918034 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:33:28.459923 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:33:57.923162 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:33:58.470399 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:34:27.930815 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:34:28.479963 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
==> kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] <==
I0214 04:21:16.914794 1 server_others.go:69] "Using iptables proxy"
I0214 04:21:16.944463 1 node.go:141] Successfully retrieved node IP: 192.168.61.188
I0214 04:21:17.102932 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 04:21:17.102987 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:21:17.107037 1 server_others.go:152] "Using iptables Proxier"
I0214 04:21:17.107319 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:21:17.107744 1 server.go:846] "Version info" version="v1.28.4"
I0214 04:21:17.108371 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:21:17.111668 1 config.go:188] "Starting service config controller"
I0214 04:21:17.111944 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:21:17.112093 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:21:17.112362 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:21:17.114966 1 config.go:315] "Starting node config controller"
I0214 04:21:17.115001 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:21:17.212670 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 04:21:17.212798 1 shared_informer.go:318] Caches are synced for service config
I0214 04:21:17.215067 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] <==
I0214 04:21:12.569509 1 serving.go:348] Generated self-signed cert in-memory
W0214 04:21:14.922317 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0214 04:21:14.922560 1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0214 04:21:14.922670 1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
W0214 04:21:14.922697 1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0214 04:21:14.963310 1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"
I0214 04:21:14.963463 1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:21:14.968179 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0214 04:21:14.968295 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 04:21:14.970055 1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
I0214 04:21:14.970161 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0214 04:21:15.069437 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:20:50 UTC, ends at Wed 2024-02-14 04:34:45 UTC. --
Feb 14 04:32:08 default-k8s-diff-port-224675 kubelet[957]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:32:08 default-k8s-diff-port-224675 kubelet[957]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:32:15 default-k8s-diff-port-224675 kubelet[957]: E0214 04:32:15.672436 957 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host" image="fake.domain/registry.k8s.io/echoserver:1.4"
Feb 14 04:32:15 default-k8s-diff-port-224675 kubelet[957]: E0214 04:32:15.672541 957 kuberuntime_image.go:53] "Failed to pull image" err="pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host" image="fake.domain/registry.k8s.io/echoserver:1.4"
Feb 14 04:32:15 default-k8s-diff-port-224675 kubelet[957]: E0214 04:32:15.672813 957 kuberuntime_manager.go:1261] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-kg29q,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:
&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessag
ePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod metrics-server-57f55c9bc5-8bqch_kube-system(95e64837-e855-49a4-adda-14b8dc40ec42): ErrImagePull: pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Feb 14 04:32:15 default-k8s-diff-port-224675 kubelet[957]: E0214 04:32:15.672884 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ErrImagePull: \"pinging container registry fake.domain: Get \\\"https://fake.domain/v2/\\\": dial tcp: lookup fake.domain: no such host\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:32:28 default-k8s-diff-port-224675 kubelet[957]: E0214 04:32:28.636081 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:32:42 default-k8s-diff-port-224675 kubelet[957]: E0214 04:32:42.635826 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:32:57 default-k8s-diff-port-224675 kubelet[957]: E0214 04:32:57.633792 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:33:08 default-k8s-diff-port-224675 kubelet[957]: E0214 04:33:08.666074 957 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:33:08 default-k8s-diff-port-224675 kubelet[957]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:33:08 default-k8s-diff-port-224675 kubelet[957]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:33:08 default-k8s-diff-port-224675 kubelet[957]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:33:11 default-k8s-diff-port-224675 kubelet[957]: E0214 04:33:11.634325 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:33:23 default-k8s-diff-port-224675 kubelet[957]: E0214 04:33:23.634267 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:33:35 default-k8s-diff-port-224675 kubelet[957]: E0214 04:33:35.634043 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:33:47 default-k8s-diff-port-224675 kubelet[957]: E0214 04:33:47.633668 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:33:59 default-k8s-diff-port-224675 kubelet[957]: E0214 04:33:59.634545 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:34:08 default-k8s-diff-port-224675 kubelet[957]: E0214 04:34:08.662849 957 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:34:08 default-k8s-diff-port-224675 kubelet[957]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:34:08 default-k8s-diff-port-224675 kubelet[957]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:34:08 default-k8s-diff-port-224675 kubelet[957]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:34:10 default-k8s-diff-port-224675 kubelet[957]: E0214 04:34:10.634548 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:34:21 default-k8s-diff-port-224675 kubelet[957]: E0214 04:34:21.634398 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:34:32 default-k8s-diff-port-224675 kubelet[957]: E0214 04:34:32.639162 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
==> storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] <==
I0214 04:21:16.974697 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0214 04:21:46.978939 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] <==
I0214 04:21:48.032583 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 04:21:48.049897 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 04:21:48.050034 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 04:22:05.453900 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 04:22:05.454385 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"48c46afb-1e5a-4580-8ece-4394793c40de", APIVersion:"v1", ResourceVersion:"589", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' default-k8s-diff-port-224675_d6befcf5-7647-499a-b7a1-9cc07fba0125 became leader
I0214 04:22:05.454461 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-224675_d6befcf5-7647-499a-b7a1-9cc07fba0125!
I0214 04:22:05.555524 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-224675_d6befcf5-7647-499a-b7a1-9cc07fba0125!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
helpers_test.go:261: (dbg) Run: kubectl --context default-k8s-diff-port-224675 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-57f55c9bc5-8bqch
helpers_test.go:274: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context default-k8s-diff-port-224675 describe pod metrics-server-57f55c9bc5-8bqch
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-224675 describe pod metrics-server-57f55c9bc5-8bqch: exit status 1 (73.319776ms)
** stderr **
Error from server (NotFound): pods "metrics-server-57f55c9bc5-8bqch" not found
** /stderr **
helpers_test.go:279: kubectl --context default-k8s-diff-port-224675 describe pod metrics-server-57f55c9bc5-8bqch: exit status 1
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (543.18s)
=== RUN TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
E0214 04:25:56.222949 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 04:26:13.611846 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 04:26:31.957741 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
start_stop_delete_test.go:274: ***** TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:274: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-722906 -n embed-certs-722906
start_stop_delete_test.go:274: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: showing logs for failed pods as of 2024-02-14 04:34:54.167169722 +0000 UTC m=+6411.131787320
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906
helpers_test.go:244: <<< TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p embed-certs-722906 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p embed-certs-722906 logs -n 25: (1.65217152s)
helpers_test.go:252: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p bridge-528898 sudo cat | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | containerd config dump | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p bridge-528898 sudo find | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p bridge-528898 sudo crio | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:12 UTC |
| | config | | | | | |
| delete | -p bridge-528898 | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| delete | -p | disable-driver-mounts-648156 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | disable-driver-mounts-648156 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:13 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable metrics-server -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | default-k8s-diff-port-224675 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable dashboard -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:26 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable dashboard -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:16:21
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:16:21.016222 1548589 out.go:291] Setting OutFile to fd 1 ...
I0214 04:16:21.016364 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016373 1548589 out.go:304] Setting ErrFile to fd 2...
I0214 04:16:21.016378 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016548 1548589 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:16:21.017128 1548589 out.go:298] Setting JSON to false
I0214 04:16:21.018088 1548589 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":25128,"bootTime":1707859053,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:16:21.018154 1548589 start.go:138] virtualization: kvm guest
I0214 04:16:21.020869 1548589 out.go:177] * [default-k8s-diff-port-224675] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:16:21.022663 1548589 notify.go:220] Checking for updates...
I0214 04:16:21.022671 1548589 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:16:21.024231 1548589 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:16:21.025835 1548589 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:16:21.027384 1548589 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:16:21.028899 1548589 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:16:21.030391 1548589 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:16:21.032286 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:16:21.032695 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.032740 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.048006 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36251
I0214 04:16:21.048486 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.049074 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.049097 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.049529 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.049715 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.049979 1548589 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:16:21.050268 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.050306 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.064529 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34885
I0214 04:16:21.064932 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.065386 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.065417 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.065713 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.065881 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.102150 1548589 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:16:21.104036 1548589 start.go:296] selected driver: kvm2
I0214 04:16:21.104047 1548589 start.go:900] validating driver "kvm2" against &{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisk
s:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.104144 1548589 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:16:21.104799 1548589 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.104878 1548589 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:16:21.119570 1548589 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:16:21.119934 1548589 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:16:21.120000 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:16:21.120015 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:16:21.120050 1548589 start.go:339] cluster config:
{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Names
pace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.120145 1548589 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.122309 1548589 out.go:177] * Starting "default-k8s-diff-port-224675" primary control-plane node in "default-k8s-diff-port-224675" cluster
I0214 04:16:20.509543 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:23.581533 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:21.123776 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:16:21.123806 1548589 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 04:16:21.123816 1548589 cache.go:56] Caching tarball of preloaded images
I0214 04:16:21.123877 1548589 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:16:21.123887 1548589 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 04:16:21.123977 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:16:21.124153 1548589 start.go:360] acquireMachinesLock for default-k8s-diff-port-224675: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:16:29.661593 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:32.733584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:38.813574 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:41.885576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:47.965558 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:51.037514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:57.117639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:00.189564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:06.269549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:09.341644 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:15.421514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:18.493573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:24.573561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:27.645587 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:33.725630 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:36.797500 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:42.877547 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:45.949563 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:52.029594 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:55.101598 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:01.181611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:04.253573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:10.333576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:13.405584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:19.485564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:22.557519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:28.637560 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:31.709570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:37.789577 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:40.861658 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:46.941582 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:50.013561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:56.093507 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:59.165639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:05.245643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:08.317643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:14.397568 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:17.469610 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:23.549636 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:26.621578 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:32.701570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:35.773525 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:41.853530 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:44.925611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:51.005519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:54.077549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:57.080691 1548199 start.go:364] duration metric: took 4m20.251500972s to acquireMachinesLock for "no-preload-527067"
I0214 04:19:57.080766 1548199 start.go:96] Skipping create...Using existing machine configuration
I0214 04:19:57.080773 1548199 fix.go:54] fixHost starting:
I0214 04:19:57.081118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:19:57.081148 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:19:57.096555 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44277
I0214 04:19:57.097002 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:19:57.097550 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:19:57.097577 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:19:57.097855 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:19:57.098034 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:19:57.098149 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:19:57.099876 1548199 fix.go:112] recreateIfNeeded on no-preload-527067: state=Stopped err=<nil>
I0214 04:19:57.099914 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
W0214 04:19:57.100102 1548199 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:19:57.102069 1548199 out.go:177] * Restarting existing kvm2 VM for "no-preload-527067" ...
I0214 04:19:57.077816 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:19:57.077865 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078255 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:19:57.078287 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078566 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:19:57.080537 1548015 machine.go:97] duration metric: took 4m37.408761431s to provisionDockerMachine
I0214 04:19:57.080584 1548015 fix.go:56] duration metric: took 4m37.431215989s for fixHost
I0214 04:19:57.080596 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 4m37.431242855s
W0214 04:19:57.080624 1548015 start.go:713] error starting host: provision: host is not running
W0214 04:19:57.080748 1548015 out.go:239] ! StartHost failed, but will try again: provision: host is not running
I0214 04:19:57.080758 1548015 start.go:728] Will try again in 5 seconds ...
I0214 04:19:57.103328 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Start
I0214 04:19:57.103512 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring networks are active...
I0214 04:19:57.104245 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network default is active
I0214 04:19:57.104698 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network mk-no-preload-527067 is active
I0214 04:19:57.105038 1548199 main.go:141] libmachine: (no-preload-527067) Getting domain xml...
I0214 04:19:57.105698 1548199 main.go:141] libmachine: (no-preload-527067) Creating domain...
I0214 04:19:58.292262 1548199 main.go:141] libmachine: (no-preload-527067) Waiting to get IP...
I0214 04:19:58.293277 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.293718 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.293762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.293632 1549610 retry.go:31] will retry after 307.836827ms: waiting for machine to come up
I0214 04:19:58.603354 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.603935 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.603965 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.603876 1549610 retry.go:31] will retry after 375.894078ms: waiting for machine to come up
I0214 04:19:58.981513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.981981 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.982015 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.981916 1549610 retry.go:31] will retry after 451.678342ms: waiting for machine to come up
I0214 04:19:59.435521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.435921 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.435961 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.435861 1549610 retry.go:31] will retry after 481.719322ms: waiting for machine to come up
I0214 04:19:59.919474 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.919914 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.919949 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.919839 1549610 retry.go:31] will retry after 586.359357ms: waiting for machine to come up
I0214 04:20:00.507667 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:00.508169 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:00.508197 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:00.508112 1549610 retry.go:31] will retry after 703.740251ms: waiting for machine to come up
I0214 04:20:01.213009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:01.213504 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:01.213531 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:01.213452 1549610 retry.go:31] will retry after 979.462057ms: waiting for machine to come up
I0214 04:20:02.082344 1548015 start.go:360] acquireMachinesLock for old-k8s-version-960884: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:20:02.194117 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:02.194497 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:02.194521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:02.194467 1549610 retry.go:31] will retry after 1.278763641s: waiting for machine to come up
I0214 04:20:03.474465 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:03.474892 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:03.474922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:03.474853 1549610 retry.go:31] will retry after 1.500263985s: waiting for machine to come up
I0214 04:20:04.977136 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:04.977601 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:04.977627 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:04.977565 1549610 retry.go:31] will retry after 2.055604163s: waiting for machine to come up
I0214 04:20:07.036030 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:07.036483 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:07.036527 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:07.036415 1549610 retry.go:31] will retry after 2.711272112s: waiting for machine to come up
I0214 04:20:09.750977 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:09.751371 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:09.751404 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:09.751317 1549610 retry.go:31] will retry after 2.924789693s: waiting for machine to come up
I0214 04:20:12.678157 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:12.678553 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:12.678615 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:12.678494 1549610 retry.go:31] will retry after 3.785040141s: waiting for machine to come up
I0214 04:20:16.468466 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468926 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has current primary IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468949 1548199 main.go:141] libmachine: (no-preload-527067) Found IP for machine: 192.168.39.167
I0214 04:20:16.468966 1548199 main.go:141] libmachine: (no-preload-527067) Reserving static IP address...
I0214 04:20:16.469414 1548199 main.go:141] libmachine: (no-preload-527067) Reserved static IP address: 192.168.39.167
I0214 04:20:16.469449 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.469476 1548199 main.go:141] libmachine: (no-preload-527067) Waiting for SSH to be available...
I0214 04:20:16.469513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | skip adding static IP to network mk-no-preload-527067 - found existing host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"}
I0214 04:20:16.469530 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Getting to WaitForSSH function...
I0214 04:20:16.471450 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471707 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.471728 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471812 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH client type: external
I0214 04:20:16.471845 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa (-rw-------)
I0214 04:20:16.471925 1548199 main.go:141] libmachine: (no-preload-527067) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.167 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:16.471947 1548199 main.go:141] libmachine: (no-preload-527067) DBG | About to run SSH command:
I0214 04:20:16.471958 1548199 main.go:141] libmachine: (no-preload-527067) DBG | exit 0
I0214 04:20:16.557177 1548199 main.go:141] libmachine: (no-preload-527067) DBG | SSH cmd err, output: <nil>:
I0214 04:20:16.557638 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetConfigRaw
I0214 04:20:16.558256 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.560907 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561244 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.561290 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561493 1548199 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/config.json ...
I0214 04:20:16.561699 1548199 machine.go:94] provisionDockerMachine start ...
I0214 04:20:16.561722 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:16.561930 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.564237 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564637 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.564664 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.565051 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565394 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.565620 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.565992 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.566004 1548199 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:16.673468 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:16.673502 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.673763 1548199 buildroot.go:166] provisioning hostname "no-preload-527067"
I0214 04:20:16.673799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.674010 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.676849 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677243 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.677291 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677404 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.677612 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677784 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677899 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.678062 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.678523 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.678543 1548199 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-527067 && echo "no-preload-527067" | sudo tee /etc/hostname
I0214 04:20:17.989797 1548416 start.go:364] duration metric: took 4m17.605388932s to acquireMachinesLock for "embed-certs-722906"
I0214 04:20:17.989877 1548416 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:17.989886 1548416 fix.go:54] fixHost starting:
I0214 04:20:17.990389 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:17.990441 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:18.007849 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36303
I0214 04:20:18.008367 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:18.008941 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:20:18.008970 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:18.009367 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:18.009556 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:18.009721 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:20:18.011258 1548416 fix.go:112] recreateIfNeeded on embed-certs-722906: state=Stopped err=<nil>
I0214 04:20:18.011289 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
W0214 04:20:18.011467 1548416 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:18.013874 1548416 out.go:177] * Restarting existing kvm2 VM for "embed-certs-722906" ...
I0214 04:20:16.797274 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-527067
I0214 04:20:16.797308 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.800396 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.800792 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800948 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.801172 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801409 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801569 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.801716 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.802024 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.802041 1548199 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-527067' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-527067/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-527067' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:16.921808 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:16.921851 1548199 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:16.921907 1548199 buildroot.go:174] setting up certificates
I0214 04:20:16.921921 1548199 provision.go:84] configureAuth start
I0214 04:20:16.921942 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.922243 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.924941 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925246 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.925294 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925448 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.927542 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.927839 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.927881 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.928073 1548199 provision.go:143] copyHostCerts
I0214 04:20:16.928185 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:16.928201 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:16.928289 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:16.928403 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:16.928413 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:16.928442 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:16.928502 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:16.928509 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:16.928529 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:16.928578 1548199 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.no-preload-527067 san=[127.0.0.1 192.168.39.167 localhost minikube no-preload-527067]
I0214 04:20:17.305617 1548199 provision.go:177] copyRemoteCerts
I0214 04:20:17.305690 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:17.305716 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.308699 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309038 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.309061 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.309485 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.309657 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.309802 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.394912 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:17.416301 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0214 04:20:17.437138 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:17.457797 1548199 provision.go:87] duration metric: took 535.857617ms to configureAuth
I0214 04:20:17.457828 1548199 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:17.458050 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:20:17.458158 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.460939 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461355 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.461402 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461525 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.461750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.461928 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.462085 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.462252 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.462572 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.462588 1548199 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:17.755399 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:17.755434 1548199 machine.go:97] duration metric: took 1.19371818s to provisionDockerMachine
I0214 04:20:17.755449 1548199 start.go:293] postStartSetup for "no-preload-527067" (driver="kvm2")
I0214 04:20:17.755463 1548199 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:17.755479 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.755812 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:17.755844 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.758654 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.758940 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.758993 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.759135 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.759342 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.759503 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.759639 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.842683 1548199 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:17.847099 1548199 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:17.847127 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:17.847225 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:17.847324 1548199 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:17.847427 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:17.855667 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:17.878842 1548199 start.go:296] duration metric: took 123.375783ms for postStartSetup
I0214 04:20:17.878892 1548199 fix.go:56] duration metric: took 20.79811795s for fixHost
I0214 04:20:17.878923 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.881702 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.882041 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882222 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.882464 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882624 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882782 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.882993 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.883487 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.883502 1548199 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:17.989605 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884417.936736993
I0214 04:20:17.989641 1548199 fix.go:216] guest clock: 1707884417.936736993
I0214 04:20:17.989651 1548199 fix.go:229] Guest: 2024-02-14 04:20:17.936736993 +0000 UTC Remote: 2024-02-14 04:20:17.878897601 +0000 UTC m=+281.200605630 (delta=57.839392ms)
I0214 04:20:17.989679 1548199 fix.go:200] guest clock delta is within tolerance: 57.839392ms
I0214 04:20:17.989697 1548199 start.go:83] releasing machines lock for "no-preload-527067", held for 20.908940374s
I0214 04:20:17.989737 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.990017 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:17.993106 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993551 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.993583 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994292 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994496 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994549 1548199 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:17.994608 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.994767 1548199 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:17.994851 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.997321 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997570 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997602 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997622 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997736 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.997968 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.998111 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.998159 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998305 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.998422 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.998602 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998747 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:18.106735 1548199 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:18.112352 1548199 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:18.256984 1548199 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:18.262909 1548199 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:18.262978 1548199 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:18.279371 1548199 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:18.279399 1548199 start.go:494] detecting cgroup driver to use...
I0214 04:20:18.279462 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:18.294016 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:18.307013 1548199 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:18.307077 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:18.320441 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:18.334729 1548199 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:18.435265 1548199 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:18.543248 1548199 docker.go:233] disabling docker service ...
I0214 04:20:18.543333 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:18.555985 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:18.566967 1548199 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:18.680096 1548199 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:18.798889 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:18.813158 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:18.831387 1548199 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:18.831446 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.841300 1548199 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:18.841352 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.851097 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.860948 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.870710 1548199 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:18.880195 1548199 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:18.889041 1548199 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:18.889111 1548199 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:18.902760 1548199 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:18.912155 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:19.032843 1548199 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:19.218049 1548199 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:19.218136 1548199 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:19.223483 1548199 start.go:562] Will wait 60s for crictl version
I0214 04:20:19.223562 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.227341 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:19.269198 1548199 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:19.269316 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.314795 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.363241 1548199 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on CRI-O 1.24.1 ...
I0214 04:20:18.015330 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Start
I0214 04:20:18.015514 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring networks are active...
I0214 04:20:18.016153 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network default is active
I0214 04:20:18.016585 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network mk-embed-certs-722906 is active
I0214 04:20:18.017058 1548416 main.go:141] libmachine: (embed-certs-722906) Getting domain xml...
I0214 04:20:18.017739 1548416 main.go:141] libmachine: (embed-certs-722906) Creating domain...
I0214 04:20:19.267998 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting to get IP...
I0214 04:20:19.269071 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.269626 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.269744 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.269612 1549739 retry.go:31] will retry after 206.534163ms: waiting for machine to come up
I0214 04:20:19.478352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.478984 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.479109 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.479039 1549739 retry.go:31] will retry after 329.891336ms: waiting for machine to come up
I0214 04:20:19.810738 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.811201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.811225 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.811148 1549739 retry.go:31] will retry after 297.899998ms: waiting for machine to come up
I0214 04:20:20.110861 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.111307 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.111340 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.111260 1549739 retry.go:31] will retry after 483.120653ms: waiting for machine to come up
I0214 04:20:19.364761 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:19.367698 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368111 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:19.368141 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368326 1548199 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 04:20:19.372316 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:19.384595 1548199 kubeadm.go:877] updating cluster {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m
0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:19.384737 1548199 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:20:19.384782 1548199 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:19.428992 1548199 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.29.0-rc.2". assuming images are not preloaded.
I0214 04:20:19.429025 1548199 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.29.0-rc.2 registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 registry.k8s.io/kube-scheduler:v1.29.0-rc.2 registry.k8s.io/kube-proxy:v1.29.0-rc.2 registry.k8s.io/pause:3.9 registry.k8s.io/etcd:3.5.10-0 registry.k8s.io/coredns/coredns:v1.11.1 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.429150 1548199 image.go:134] retrieving image: registry.k8s.io/pause:3.9
I0214 04:20:19.429159 1548199 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.429177 1548199 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.429328 1548199 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.429332 1548199 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.429351 1548199 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.431104 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.431106 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.431123 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.431216 1548199 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.431226 1548199 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
I0214 04:20:19.431239 1548199 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.431291 1548199 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.431826 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.613887 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.614261 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.626641 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.9
I0214 04:20:19.630913 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.638603 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.652797 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.654940 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.656778 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.698298 1548199 cache_images.go:116] "registry.k8s.io/etcd:3.5.10-0" needs transfer: "registry.k8s.io/etcd:3.5.10-0" does not exist at hash "a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7" in container runtime
I0214 04:20:19.698355 1548199 cri.go:218] Removing image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.698414 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.757753 1548199 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" does not exist at hash "bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f" in container runtime
I0214 04:20:19.757810 1548199 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.757870 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941144 1548199 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" does not exist at hash "4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210" in container runtime
I0214 04:20:19.941166 1548199 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.11.1" needs transfer: "registry.k8s.io/coredns/coredns:v1.11.1" does not exist at hash "cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4" in container runtime
I0214 04:20:19.941188 1548199 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime
I0214 04:20:19.941198 1548199 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.941201 1548199 cri.go:218] Removing image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.941205 1548199 cri.go:218] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941337 1548199 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" does not exist at hash "d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d" in container runtime
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941382 1548199 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.941415 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941482 1548199 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-proxy:v1.29.0-rc.2" does not exist at hash "cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834" in container runtime
I0214 04:20:19.941506 1548199 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.941537 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941549 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.941643 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.955388 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.955421 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.969125 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.969198 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.969166 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:20.061499 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
I0214 04:20:20.061591 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.061633 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.061699 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.094179 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094180 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
I0214 04:20:20.094312 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094395 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:20.124555 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
I0214 04:20:20.124585 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124670 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:20.124703 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124677 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124746 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/etcd_3.5.10-0 (exists)
I0214 04:20:20.124760 1548199 crio.go:257] Loading image: /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124793 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124803 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2 (exists)
I0214 04:20:20.124829 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124877 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2 (exists)
I0214 04:20:20.124902 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/storage-provisioner_v5 (exists)
I0214 04:20:20.136587 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/coredns_v1.11.1 (exists)
I0214 04:20:20.136626 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2 (exists)
I0214 04:20:20.595903 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.596479 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.596504 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.596431 1549739 retry.go:31] will retry after 541.170149ms: waiting for machine to come up
I0214 04:20:21.139128 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.139587 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.139619 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.139543 1549739 retry.go:31] will retry after 609.736734ms: waiting for machine to come up
I0214 04:20:21.750821 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.751430 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.751476 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.751373 1549739 retry.go:31] will retry after 889.762874ms: waiting for machine to come up
I0214 04:20:22.642380 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:22.642915 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:22.642966 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:22.642850 1549739 retry.go:31] will retry after 1.310308388s: waiting for machine to come up
I0214 04:20:23.954650 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:23.955082 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:23.955114 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:23.955032 1549739 retry.go:31] will retry after 1.186449176s: waiting for machine to come up
I0214 04:20:25.143888 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:25.144379 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:25.144409 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:25.144331 1549739 retry.go:31] will retry after 1.870374645s: waiting for machine to come up
I0214 04:20:24.103814 1548199 ssh_runner.go:235] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (3.97895084s)
I0214 04:20:24.103870 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2 (exists)
I0214 04:20:24.104023 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0: (3.979201042s)
I0214 04:20:24.104052 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 from cache
I0214 04:20:24.104094 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:24.104197 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:27.017422 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:27.017923 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:27.017949 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:27.017821 1549739 retry.go:31] will retry after 2.372344988s: waiting for machine to come up
I0214 04:20:29.391597 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:29.392177 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:29.392212 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:29.392127 1549739 retry.go:31] will retry after 2.760319549s: waiting for machine to come up
I0214 04:20:27.189223 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2: (3.084990766s)
I0214 04:20:27.189276 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 from cache
I0214 04:20:27.189310 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:27.189404 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:29.355802 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2: (2.166363074s)
I0214 04:20:29.355840 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 from cache
I0214 04:20:29.355881 1548199 crio.go:257] Loading image: /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:29.355951 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:30.013381 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
I0214 04:20:30.013438 1548199 crio.go:257] Loading image: /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:30.013501 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:32.155254 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:32.155727 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:32.155753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:32.155677 1549739 retry.go:31] will retry after 4.524050008s: waiting for machine to come up
I0214 04:20:31.977727 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1: (1.964188552s)
I0214 04:20:31.977769 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 from cache
I0214 04:20:31.977802 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:31.977872 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:34.535494 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2: (2.557583724s)
I0214 04:20:34.535538 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 from cache
I0214 04:20:34.535571 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:34.535624 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:35.791070 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (1.255414762s)
I0214 04:20:35.791122 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 from cache
I0214 04:20:35.791154 1548199 cache_images.go:123] Successfully loaded all cached images
I0214 04:20:35.791166 1548199 cache_images.go:92] duration metric: took 16.362124396s to LoadCachedImages
I0214 04:20:35.791179 1548199 kubeadm.go:928] updating node { 192.168.39.167 8443 v1.29.0-rc.2 crio true true} ...
I0214 04:20:35.791336 1548199 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-527067 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.167
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:35.791437 1548199 ssh_runner.go:195] Run: crio config
I0214 04:20:35.848895 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:20:35.848923 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:35.848935 1548199 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:35.848985 1548199 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.167 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-527067 NodeName:no-preload-527067 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.167"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.167 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:35.849152 1548199 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.167
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-527067"
kubeletExtraArgs:
node-ip: 192.168.39.167
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.167"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:35.849221 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0214 04:20:35.859377 1548199 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:35.859443 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:35.868486 1548199 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0214 04:20:35.885091 1548199 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0214 04:20:35.901749 1548199 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2166 bytes)
I0214 04:20:35.919596 1548199 ssh_runner.go:195] Run: grep 192.168.39.167 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:35.923203 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.167 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:35.934756 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:36.048443 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:36.063403 1548199 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067 for IP: 192.168.39.167
I0214 04:20:36.063423 1548199 certs.go:194] generating shared ca certs ...
I0214 04:20:36.063440 1548199 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:36.063607 1548199 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:36.063675 1548199 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:36.063691 1548199 certs.go:256] generating profile certs ...
I0214 04:20:36.063805 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/client.key
I0214 04:20:36.063903 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key.79c0eebd
I0214 04:20:36.063964 1548199 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key
I0214 04:20:36.064127 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:36.064168 1548199 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:36.064182 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:36.064220 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:36.064249 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:36.064281 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:36.064332 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:36.065313 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:36.101889 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:36.135234 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:36.168832 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:36.204188 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 04:20:36.230823 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 04:20:36.254917 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:36.282014 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:36.303131 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:36.323933 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:36.344419 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:36.365038 1548199 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:36.380645 1548199 ssh_runner.go:195] Run: openssl version
I0214 04:20:36.386091 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:36.395680 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399890 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399959 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.405132 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:36.415168 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:36.424870 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.428976 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.429025 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.434401 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:36.443848 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:36.453658 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457908 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457963 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.463066 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:36.472994 1548199 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:36.477141 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:36.482809 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:36.488342 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:36.493884 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:36.499087 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:36.504410 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:36.509751 1548199 kubeadm.go:391] StartCluster: {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29
.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s
Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:36.509849 1548199 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:36.509914 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.547323 1548199 cri.go:89] found id: ""
I0214 04:20:36.547408 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:36.556907 1548199 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:36.556928 1548199 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:36.556935 1548199 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:36.557012 1548199 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:36.566003 1548199 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:36.567328 1548199 kubeconfig.go:125] found "no-preload-527067" server: "https://192.168.39.167:8443"
I0214 04:20:36.570250 1548199 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:36.578772 1548199 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.167
I0214 04:20:36.578805 1548199 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:36.578819 1548199 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:36.578868 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.615271 1548199 cri.go:89] found id: ""
I0214 04:20:36.615369 1548199 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:36.631254 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:36.640513 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:36.640544 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:20:36.640605 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:36.649213 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:36.649289 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:36.658011 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:36.667277 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:36.667461 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:36.677535 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:36.686189 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:36.686248 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:36.696716 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:36.706405 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:36.706442 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:36.715622 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:36.725241 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.074017 1548589 start.go:364] duration metric: took 4m16.949827565s to acquireMachinesLock for "default-k8s-diff-port-224675"
I0214 04:20:38.074099 1548589 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:38.074107 1548589 fix.go:54] fixHost starting:
I0214 04:20:38.074546 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:38.074596 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:38.092223 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32909
I0214 04:20:38.092628 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:38.093091 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:20:38.093112 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:38.093545 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:38.093743 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:38.093902 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:20:38.095356 1548589 fix.go:112] recreateIfNeeded on default-k8s-diff-port-224675: state=Stopped err=<nil>
I0214 04:20:38.095385 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
W0214 04:20:38.095570 1548589 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:38.097728 1548589 out.go:177] * Restarting existing kvm2 VM for "default-k8s-diff-port-224675" ...
I0214 04:20:36.682303 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.682827 1548416 main.go:141] libmachine: (embed-certs-722906) Found IP for machine: 192.168.50.108
I0214 04:20:36.682865 1548416 main.go:141] libmachine: (embed-certs-722906) Reserving static IP address...
I0214 04:20:36.682884 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has current primary IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.683294 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.683326 1548416 main.go:141] libmachine: (embed-certs-722906) Reserved static IP address: 192.168.50.108
I0214 04:20:36.683352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | skip adding static IP to network mk-embed-certs-722906 - found existing host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"}
I0214 04:20:36.683370 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Getting to WaitForSSH function...
I0214 04:20:36.683386 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting for SSH to be available...
I0214 04:20:36.685555 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.685877 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.685912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.686044 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH client type: external
I0214 04:20:36.686073 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa (-rw-------)
I0214 04:20:36.686108 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.108 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:36.686121 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | About to run SSH command:
I0214 04:20:36.686136 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | exit 0
I0214 04:20:36.777374 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | SSH cmd err, output: <nil>:
I0214 04:20:36.777749 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetConfigRaw
I0214 04:20:36.778583 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:36.781415 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.781891 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.781918 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.782292 1548416 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/config.json ...
I0214 04:20:36.782531 1548416 machine.go:94] provisionDockerMachine start ...
I0214 04:20:36.782576 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:36.782816 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.785327 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.785737 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785996 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.786168 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786327 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786501 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.786710 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.787196 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.787214 1548416 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:36.905657 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:36.905687 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.905964 1548416 buildroot.go:166] provisioning hostname "embed-certs-722906"
I0214 04:20:36.905990 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.906183 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.909442 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.909874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.909912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.910070 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.910262 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910445 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910582 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.910738 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.911264 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.911289 1548416 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-722906 && echo "embed-certs-722906" | sudo tee /etc/hostname
I0214 04:20:37.046181 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-722906
I0214 04:20:37.046216 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.049414 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.049785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.049819 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.050075 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.050291 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050646 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.050842 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.051191 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.051235 1548416 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-722906' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-722906/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-722906' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:37.177589 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:37.177622 1548416 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:37.177646 1548416 buildroot.go:174] setting up certificates
I0214 04:20:37.177657 1548416 provision.go:84] configureAuth start
I0214 04:20:37.177668 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:37.178023 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:37.181013 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181404 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.181435 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181606 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.183959 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184300 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.184329 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184472 1548416 provision.go:143] copyHostCerts
I0214 04:20:37.184534 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:37.184544 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:37.184594 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:37.184678 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:37.184685 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:37.184710 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:37.184785 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:37.184794 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:37.184813 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:37.184881 1548416 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.embed-certs-722906 san=[127.0.0.1 192.168.50.108 embed-certs-722906 localhost minikube]
I0214 04:20:37.334150 1548416 provision.go:177] copyRemoteCerts
I0214 04:20:37.334225 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:37.334258 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.336874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337245 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.337299 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337492 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.337693 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.337868 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.338016 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.424211 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:37.448257 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0214 04:20:37.472132 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:20:37.496606 1548416 provision.go:87] duration metric: took 318.923431ms to configureAuth
I0214 04:20:37.496633 1548416 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:37.496815 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:37.496904 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.499706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500129 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.500174 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500359 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.500566 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500738 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500873 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.501094 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.501587 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.501614 1548416 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:37.814749 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:37.814781 1548416 machine.go:97] duration metric: took 1.032234304s to provisionDockerMachine
I0214 04:20:37.814796 1548416 start.go:293] postStartSetup for "embed-certs-722906" (driver="kvm2")
I0214 04:20:37.814811 1548416 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:37.814848 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:37.815206 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:37.815237 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.818201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818621 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.818644 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818819 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.819026 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.819221 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.819386 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.913636 1548416 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:37.919126 1548416 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:37.919153 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:37.919231 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:37.919328 1548416 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:37.919441 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:37.930902 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:37.955477 1548416 start.go:296] duration metric: took 140.651894ms for postStartSetup
I0214 04:20:37.955515 1548416 fix.go:56] duration metric: took 19.965630101s for fixHost
I0214 04:20:37.955546 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.958406 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.958844 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.958883 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.959025 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.959250 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959490 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.959876 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.960220 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.960236 1548416 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:38.073852 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884438.021225394
I0214 04:20:38.073878 1548416 fix.go:216] guest clock: 1707884438.021225394
I0214 04:20:38.073897 1548416 fix.go:229] Guest: 2024-02-14 04:20:38.021225394 +0000 UTC Remote: 2024-02-14 04:20:37.955524144 +0000 UTC m=+277.725419033 (delta=65.70125ms)
I0214 04:20:38.073926 1548416 fix.go:200] guest clock delta is within tolerance: 65.70125ms
I0214 04:20:38.073936 1548416 start.go:83] releasing machines lock for "embed-certs-722906", held for 20.084084933s
I0214 04:20:38.073965 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.074261 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:38.077151 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077577 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.077612 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077814 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078403 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078604 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078683 1548416 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:38.078733 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.078839 1548416 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:38.078867 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.081284 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081692 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.081758 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081784 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081870 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082041 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082218 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082256 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.082293 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.082336 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.082457 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082607 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082726 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082903 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.190317 1548416 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:38.196626 1548416 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:38.349673 1548416 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:38.356571 1548416 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:38.356677 1548416 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:38.377847 1548416 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:38.377877 1548416 start.go:494] detecting cgroup driver to use...
I0214 04:20:38.377956 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:38.395591 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:38.411254 1548416 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:38.411337 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:38.429922 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:38.446585 1548416 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:38.576797 1548416 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:38.708684 1548416 docker.go:233] disabling docker service ...
I0214 04:20:38.708752 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:38.723898 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:38.736512 1548416 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:38.864382 1548416 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:38.978645 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:38.995888 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:39.015920 1548416 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:39.015998 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.028138 1548416 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:39.028205 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.041203 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.054736 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.064851 1548416 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:39.074475 1548416 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:39.085772 1548416 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:39.085839 1548416 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:39.102669 1548416 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:39.117041 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:39.248406 1548416 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:39.438738 1548416 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:39.438820 1548416 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:39.445895 1548416 start.go:562] Will wait 60s for crictl version
I0214 04:20:39.445969 1548416 ssh_runner.go:195] Run: which crictl
I0214 04:20:39.450199 1548416 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:39.491583 1548416 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:39.491674 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.534681 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.593285 1548416 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:39.594908 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:39.598263 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.598753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:39.598785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.599034 1548416 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0214 04:20:39.603478 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:39.621148 1548416 kubeadm.go:877] updating cluster {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:
false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:39.621309 1548416 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:39.621379 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:39.676783 1548416 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:39.676909 1548416 ssh_runner.go:195] Run: which lz4
I0214 04:20:39.681410 1548416 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:39.686690 1548416 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:39.686727 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:20:38.099207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Start
I0214 04:20:38.099430 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring networks are active...
I0214 04:20:38.100228 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network default is active
I0214 04:20:38.100585 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network mk-default-k8s-diff-port-224675 is active
I0214 04:20:38.101059 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Getting domain xml...
I0214 04:20:38.101854 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Creating domain...
I0214 04:20:39.454986 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting to get IP...
I0214 04:20:39.456025 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456576 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456614 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.456520 1549871 retry.go:31] will retry after 292.69131ms: waiting for machine to come up
I0214 04:20:39.751334 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751908 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751956 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.751858 1549871 retry.go:31] will retry after 340.869303ms: waiting for machine to come up
I0214 04:20:40.094535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095142 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.095051 1549871 retry.go:31] will retry after 293.465495ms: waiting for machine to come up
I0214 04:20:40.390912 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391346 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391377 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.391290 1549871 retry.go:31] will retry after 457.62012ms: waiting for machine to come up
I0214 04:20:40.851151 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851616 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851645 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.851547 1549871 retry.go:31] will retry after 539.345518ms: waiting for machine to come up
I0214 04:20:36.851047 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.089975 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.238873301s)
I0214 04:20:38.090005 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.309755 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.378436 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.478394 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:38.478509 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:38.979577 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.478754 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.979574 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.479243 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.978672 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:41.006970 1548199 api_server.go:72] duration metric: took 2.528578043s to wait for apiserver process to appear ...
I0214 04:20:41.007003 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:41.007024 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.008150 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:20:41.507776 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.762516 1548416 crio.go:444] duration metric: took 2.081156311s to copy over tarball
I0214 04:20:41.762608 1548416 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:20:44.980302 1548416 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.217656042s)
I0214 04:20:44.980335 1548416 crio.go:451] duration metric: took 3.217784443s to extract the tarball
I0214 04:20:44.980346 1548416 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:20:45.024706 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:45.082193 1548416 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:20:45.082217 1548416 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:20:45.082225 1548416 kubeadm.go:928] updating node { 192.168.50.108 8443 v1.28.4 crio true true} ...
I0214 04:20:45.082349 1548416 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-722906 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.50.108
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:45.082447 1548416 ssh_runner.go:195] Run: crio config
I0214 04:20:45.147931 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:45.147969 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:45.147982 1548416 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:45.148006 1548416 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.108 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-722906 NodeName:embed-certs-722906 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.108"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.108 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:45.148164 1548416 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.108
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-722906"
kubeletExtraArgs:
node-ip: 192.168.50.108
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.108"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:45.148232 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:20:45.158479 1548416 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:45.158553 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:45.167772 1548416 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)
I0214 04:20:45.184110 1548416 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:20:45.200469 1548416 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
I0214 04:20:45.217332 1548416 ssh_runner.go:195] Run: grep 192.168.50.108 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:45.221512 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.108 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:45.233317 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:41.392312 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393904 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:41.393756 1549871 retry.go:31] will retry after 729.897424ms: waiting for machine to come up
I0214 04:20:42.125952 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126513 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126542 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:42.126448 1549871 retry.go:31] will retry after 1.070487026s: waiting for machine to come up
I0214 04:20:43.198768 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199234 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199269 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:43.199179 1549871 retry.go:31] will retry after 1.144751625s: waiting for machine to come up
I0214 04:20:44.345532 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345958 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345989 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:44.345929 1549871 retry.go:31] will retry after 1.430046726s: waiting for machine to come up
I0214 04:20:45.778221 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778683 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778713 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:45.778628 1549871 retry.go:31] will retry after 2.320641186s: waiting for machine to come up
I0214 04:20:46.508190 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:46.508231 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:45.341316 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:45.781473 1548416 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906 for IP: 192.168.50.108
I0214 04:20:45.781494 1548416 certs.go:194] generating shared ca certs ...
I0214 04:20:45.781513 1548416 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:45.781690 1548416 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:45.781760 1548416 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:45.781777 1548416 certs.go:256] generating profile certs ...
I0214 04:20:45.781960 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/client.key
I0214 04:20:45.782154 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key.de29a2e4
I0214 04:20:45.782215 1548416 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key
I0214 04:20:45.782395 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:45.782438 1548416 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:45.782453 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:45.782491 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:45.782537 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:45.782570 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:45.782625 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:45.783482 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:45.822613 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:45.853037 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:45.898215 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:45.938947 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0214 04:20:45.965143 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:20:45.994794 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:46.018374 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:46.044018 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:46.067499 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:46.090920 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:46.114475 1548416 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:46.132051 1548416 ssh_runner.go:195] Run: openssl version
I0214 04:20:46.137746 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:46.147403 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152220 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152298 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.158254 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:46.167536 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:46.179112 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184157 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184219 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.190110 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:46.200066 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:46.210093 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214882 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214955 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.220636 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:46.230395 1548416 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:46.235238 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:46.241337 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:46.247195 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:46.253414 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:46.259696 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:46.266214 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:46.272246 1548416 kubeadm.go:391] StartCluster: {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fal
se MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:46.272384 1548416 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:46.272458 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.322213 1548416 cri.go:89] found id: ""
I0214 04:20:46.322303 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:46.334965 1548416 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:46.334993 1548416 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:46.334999 1548416 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:46.335055 1548416 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:46.344493 1548416 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:46.345570 1548416 kubeconfig.go:125] found "embed-certs-722906" server: "https://192.168.50.108:8443"
I0214 04:20:46.347818 1548416 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:46.357313 1548416 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.50.108
I0214 04:20:46.357349 1548416 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:46.357365 1548416 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:46.357429 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.403854 1548416 cri.go:89] found id: ""
I0214 04:20:46.403945 1548416 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:46.418730 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:46.432468 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:46.432491 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:20:46.432541 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:46.441218 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:46.441346 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:46.450078 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:46.458158 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:46.458261 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:46.472089 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:46.480354 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:46.480425 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:46.489174 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:46.497321 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:46.497406 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:46.506204 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:46.517469 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:46.646342 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.587291 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.799709 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.882294 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.990798 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:47.990913 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.491970 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.991676 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.491048 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.991348 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.100608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:48.101075 1549871 retry.go:31] will retry after 2.658096517s: waiting for machine to come up
I0214 04:20:50.762784 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763407 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:50.763316 1549871 retry.go:31] will retry after 2.514722067s: waiting for machine to come up
I0214 04:20:51.508782 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:51.508854 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:50.491707 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:50.511999 1548416 api_server.go:72] duration metric: took 2.521202011s to wait for apiserver process to appear ...
I0214 04:20:50.512032 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:50.512056 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.915403 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:20:53.915447 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:20:53.915465 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.961623 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:53.961686 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.012877 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.029797 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.029829 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.512349 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.517512 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.517539 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.013148 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.019019 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:55.019067 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.512961 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.520464 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:20:55.529064 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:20:55.529096 1548416 api_server.go:131] duration metric: took 5.017056759s to wait for apiserver health ...
I0214 04:20:55.529107 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:55.529117 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:55.531379 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:20:53.279582 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280038 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:53.279941 1549871 retry.go:31] will retry after 3.362064709s: waiting for machine to come up
I0214 04:20:56.510005 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:56.510055 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:58.174260 1548015 start.go:364] duration metric: took 56.091842509s to acquireMachinesLock for "old-k8s-version-960884"
I0214 04:20:58.174320 1548015 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:58.174329 1548015 fix.go:54] fixHost starting:
I0214 04:20:58.174723 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:58.174759 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:58.194079 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41161
I0214 04:20:58.194519 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:58.195088 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:20:58.195119 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:58.195478 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:58.195686 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:20:58.195855 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:20:58.197422 1548015 fix.go:112] recreateIfNeeded on old-k8s-version-960884: state=Stopped err=<nil>
I0214 04:20:58.197454 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
W0214 04:20:58.197646 1548015 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:58.200239 1548015 out.go:177] * Restarting existing kvm2 VM for "old-k8s-version-960884" ...
I0214 04:20:58.201659 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Start
I0214 04:20:58.201846 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring networks are active...
I0214 04:20:58.202622 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network default is active
I0214 04:20:58.202951 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network mk-old-k8s-version-960884 is active
I0214 04:20:58.203335 1548015 main.go:141] libmachine: (old-k8s-version-960884) Getting domain xml...
I0214 04:20:58.204058 1548015 main.go:141] libmachine: (old-k8s-version-960884) Creating domain...
I0214 04:20:59.499603 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting to get IP...
I0214 04:20:59.500457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.500948 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.501078 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.500925 1550044 retry.go:31] will retry after 268.008751ms: waiting for machine to come up
I0214 04:20:56.646632 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647206 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has current primary IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Found IP for machine: 192.168.61.188
I0214 04:20:56.647242 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserving static IP address...
I0214 04:20:56.647731 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserved static IP address: 192.168.61.188
I0214 04:20:56.647765 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for SSH to be available...
I0214 04:20:56.647794 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.647835 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | skip adding static IP to network mk-default-k8s-diff-port-224675 - found existing host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"}
I0214 04:20:56.647855 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Getting to WaitForSSH function...
I0214 04:20:56.650403 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.650820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.650856 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.651067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH client type: external
I0214 04:20:56.651100 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa (-rw-------)
I0214 04:20:56.651166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.188 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:56.651192 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | About to run SSH command:
I0214 04:20:56.651207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | exit 0
I0214 04:20:56.745447 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | SSH cmd err, output: <nil>:
I0214 04:20:56.745839 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetConfigRaw
I0214 04:20:56.746577 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:56.749052 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749421 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.749460 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749749 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:20:56.750003 1548589 machine.go:94] provisionDockerMachine start ...
I0214 04:20:56.750032 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:56.750283 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.752289 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.752669 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752745 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.752923 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753226 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.753428 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.753775 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.753787 1548589 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:56.885360 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:56.885414 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885730 1548589 buildroot.go:166] provisioning hostname "default-k8s-diff-port-224675"
I0214 04:20:56.885763 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885965 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.889200 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889612 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.889646 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.889979 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890304 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.890522 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.890994 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.891016 1548589 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-224675 && echo "default-k8s-diff-port-224675" | sudo tee /etc/hostname
I0214 04:20:57.036037 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-224675
I0214 04:20:57.036072 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.039174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039572 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.039608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039755 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.039972 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040163 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040409 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.040613 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.040946 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.040964 1548589 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-224675' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-224675/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-224675' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:57.182677 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:57.182717 1548589 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:57.182783 1548589 buildroot.go:174] setting up certificates
I0214 04:20:57.182802 1548589 provision.go:84] configureAuth start
I0214 04:20:57.182822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:57.183166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:57.186475 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.186873 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.186913 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.187230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.189476 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189790 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.189822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189971 1548589 provision.go:143] copyHostCerts
I0214 04:20:57.190038 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:57.190049 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:57.190098 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:57.190266 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:57.190280 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:57.190314 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:57.190386 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:57.190394 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:57.190412 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:57.190461 1548589 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-224675 san=[127.0.0.1 192.168.61.188 default-k8s-diff-port-224675 localhost minikube]
I0214 04:20:57.387080 1548589 provision.go:177] copyRemoteCerts
I0214 04:20:57.387149 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:57.387175 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.390293 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.390630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.391007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.391181 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.391322 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.485912 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:57.512761 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0214 04:20:57.536095 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:57.558680 1548589 provision.go:87] duration metric: took 375.857715ms to configureAuth
I0214 04:20:57.558710 1548589 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:57.558918 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:57.559003 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.562067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562500 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.562537 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562704 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.562907 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563106 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563246 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.563461 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.563823 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.563850 1548589 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:57.893504 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:57.893536 1548589 machine.go:97] duration metric: took 1.143516422s to provisionDockerMachine
I0214 04:20:57.893548 1548589 start.go:293] postStartSetup for "default-k8s-diff-port-224675" (driver="kvm2")
I0214 04:20:57.893559 1548589 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:57.893575 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:57.893941 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:57.893974 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.896371 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896764 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.896795 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896910 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.897116 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.897286 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.897442 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.996592 1548589 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:58.000872 1548589 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:58.000900 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:58.000983 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:58.001088 1548589 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:58.001183 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:58.011272 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:58.034964 1548589 start.go:296] duration metric: took 141.398226ms for postStartSetup
I0214 04:20:58.035023 1548589 fix.go:56] duration metric: took 19.960915344s for fixHost
I0214 04:20:58.035053 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.037914 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038291 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.038324 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038581 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.038811 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.038999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.039138 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.039329 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:58.039672 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:58.039684 1548589 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:58.174082 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884458.118396657
I0214 04:20:58.174110 1548589 fix.go:216] guest clock: 1707884458.118396657
I0214 04:20:58.174121 1548589 fix.go:229] Guest: 2024-02-14 04:20:58.118396657 +0000 UTC Remote: 2024-02-14 04:20:58.035028403 +0000 UTC m=+277.067763536 (delta=83.368254ms)
I0214 04:20:58.174148 1548589 fix.go:200] guest clock delta is within tolerance: 83.368254ms
I0214 04:20:58.174154 1548589 start.go:83] releasing machines lock for "default-k8s-diff-port-224675", held for 20.100083449s
I0214 04:20:58.174185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.174605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:58.177237 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177662 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.177693 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177891 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178381 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178690 1548589 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:58.178744 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.178844 1548589 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:58.178867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.181490 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181819 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.181842 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182009 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.182292 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.182352 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.182420 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182520 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182582 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.182999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.183208 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.183377 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.279272 1548589 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:58.306096 1548589 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:58.464434 1548589 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:58.471146 1548589 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:58.471214 1548589 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:58.488300 1548589 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:58.488334 1548589 start.go:494] detecting cgroup driver to use...
I0214 04:20:58.488423 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:58.506634 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:58.521226 1548589 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:58.521315 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:58.536720 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:58.549326 1548589 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:58.661636 1548589 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:58.783909 1548589 docker.go:233] disabling docker service ...
I0214 04:20:58.784000 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:58.796379 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:58.807498 1548589 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:58.924871 1548589 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:59.041964 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:59.055151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:59.082093 1548589 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:59.082175 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.095126 1548589 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:59.095227 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.104759 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.117356 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.126315 1548589 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:59.135891 1548589 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:59.146513 1548589 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:59.146572 1548589 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:59.162055 1548589 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:59.172668 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:59.323690 1548589 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:59.554209 1548589 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:59.554296 1548589 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:59.559401 1548589 start.go:562] Will wait 60s for crictl version
I0214 04:20:59.559471 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:20:59.563786 1548589 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:59.606476 1548589 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:59.606583 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.676861 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.739175 1548589 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:55.532872 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:20:55.548094 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:20:55.582319 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:20:55.595384 1548416 system_pods.go:59] 8 kube-system pods found
I0214 04:20:55.595415 1548416 system_pods.go:61] "coredns-5dd5756b68-4njjf" [3526e55f-d197-40a9-a939-bdc324aa0214] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:20:55.595422 1548416 system_pods.go:61] "etcd-embed-certs-722906" [cc60420b-dd77-4385-86f9-d2ddaa5a9b22] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:20:55.595429 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [850aef3c-4402-4e33-a81d-2d4bd97c5503] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:20:55.595435 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [5f2cc407-f67a-4779-ab0d-1a739e070df4] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:20:55.595443 1548416 system_pods.go:61] "kube-proxy-4wk86" [de0506d7-756a-4ce1-ab3c-54aaf8c041ad] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:20:55.595449 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [05db3b4a-941a-4aaf-88e3-35ec35176042] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:20:55.595458 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-5nqbv" [7784c464-f718-4eb0-b9dd-ebb579ead3bc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:20:55.595464 1548416 system_pods.go:61] "storage-provisioner" [d272841c-697d-4708-bce6-6fcad0d9d2b4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:20:55.595471 1548416 system_pods.go:74] duration metric: took 13.129235ms to wait for pod list to return data ...
I0214 04:20:55.595482 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:20:55.601854 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:20:55.601918 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:20:55.601935 1548416 node_conditions.go:105] duration metric: took 6.44739ms to run NodePressure ...
I0214 04:20:55.601957 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:55.954027 1548416 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:20:55.970665 1548416 kubeadm.go:733] kubelet initialised
I0214 04:20:55.970695 1548416 kubeadm.go:734] duration metric: took 16.634129ms waiting for restarted kubelet to initialise ...
I0214 04:20:55.970708 1548416 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:20:55.978062 1548416 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:20:57.985711 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.989728 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.740766 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:59.744066 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744437 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:59.744465 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744727 1548589 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0214 04:20:59.750187 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:59.763984 1548589 kubeadm.go:877] updating cluster {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat
ion:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:59.764177 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:59.764235 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:59.814567 1548589 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:59.814655 1548589 ssh_runner.go:195] Run: which lz4
I0214 04:20:59.819563 1548589 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:59.824793 1548589 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:59.824844 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:21:01.511247 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:01.511301 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:01.665765 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": read tcp 192.168.39.1:46006->192.168.39.167:8443: read: connection reset by peer
I0214 04:20:59.770509 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.770916 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.770941 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.770880 1550044 retry.go:31] will retry after 254.3155ms: waiting for machine to come up
I0214 04:21:00.027295 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.028116 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.028281 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.028236 1550044 retry.go:31] will retry after 304.399751ms: waiting for machine to come up
I0214 04:21:00.334939 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.335679 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.335710 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.335610 1550044 retry.go:31] will retry after 495.017444ms: waiting for machine to come up
I0214 04:21:00.833716 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.834301 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.834332 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.834259 1550044 retry.go:31] will retry after 586.036153ms: waiting for machine to come up
I0214 04:21:01.422440 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:01.423042 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:01.423073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:01.423002 1550044 retry.go:31] will retry after 893.296492ms: waiting for machine to come up
I0214 04:21:02.318089 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:02.318517 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:02.318553 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:02.318444 1550044 retry.go:31] will retry after 890.603828ms: waiting for machine to come up
I0214 04:21:03.210695 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:03.211183 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:03.211219 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:03.211140 1550044 retry.go:31] will retry after 1.068479468s: waiting for machine to come up
I0214 04:21:04.281009 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:04.281818 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:04.281859 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:04.281713 1550044 retry.go:31] will retry after 1.48876639s: waiting for machine to come up
I0214 04:21:00.490145 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:00.490174 1548416 pod_ready.go:81] duration metric: took 4.512078435s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:21:00.490188 1548416 pod_ready.go:78] waiting up to 4m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:02.498108 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:04.500186 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:01.782168 1548589 crio.go:444] duration metric: took 1.962621296s to copy over tarball
I0214 04:21:01.782265 1548589 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:05.094954 1548589 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.312628523s)
I0214 04:21:05.094995 1548589 crio.go:451] duration metric: took 3.312794343s to extract the tarball
I0214 04:21:05.095005 1548589 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:05.138877 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:05.189028 1548589 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:21:05.189067 1548589 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:21:05.189079 1548589 kubeadm.go:928] updating node { 192.168.61.188 8444 v1.28.4 crio true true} ...
I0214 04:21:05.189273 1548589 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=default-k8s-diff-port-224675 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.188
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:05.189360 1548589 ssh_runner.go:195] Run: crio config
I0214 04:21:05.268931 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:05.268970 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:05.268985 1548589 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:05.269014 1548589 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.188 APIServerPort:8444 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-224675 NodeName:default-k8s-diff-port-224675 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.188"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.188 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cer
ts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:21:05.269248 1548589 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.188
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-224675"
kubeletExtraArgs:
node-ip: 192.168.61.188
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.188"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:05.269373 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:21:05.282570 1548589 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:05.282677 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:05.294227 1548589 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (328 bytes)
I0214 04:21:05.314442 1548589 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:05.335296 1548589 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0214 04:21:05.355453 1548589 ssh_runner.go:195] Run: grep 192.168.61.188 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:05.359558 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.188 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:05.374035 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:05.500958 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:05.517736 1548589 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675 for IP: 192.168.61.188
I0214 04:21:05.517761 1548589 certs.go:194] generating shared ca certs ...
I0214 04:21:05.517784 1548589 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:05.518063 1548589 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:05.518133 1548589 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:05.518149 1548589 certs.go:256] generating profile certs ...
I0214 04:21:05.518278 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/client.key
I0214 04:21:05.518378 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key.107453ef
I0214 04:21:05.518440 1548589 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key
I0214 04:21:05.518591 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:05.518663 1548589 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:05.518679 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:05.518715 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:05.518750 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:05.518786 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:05.518843 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:05.519732 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:05.563956 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:05.600031 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:05.637740 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:05.690706 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0214 04:21:05.737661 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:05.775249 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:05.808393 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:21:05.835096 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:05.859782 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:05.885907 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:05.912030 1548589 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:05.929758 1548589 ssh_runner.go:195] Run: openssl version
I0214 04:21:05.935156 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:05.945003 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949769 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949864 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.955524 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:05.965551 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:05.975674 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980561 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980621 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.986257 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:05.997315 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:06.007670 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012694 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012766 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:02.007691 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.008567 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:02.507730 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.508577 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.007700 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:03.008475 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.507127 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.797126 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.797164 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:07.797184 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.883078 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.883120 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:08.007346 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.097373 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.097412 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:08.507874 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.516200 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.516246 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:09.007697 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:09.012802 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:21:09.021792 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:21:09.021833 1548199 api_server.go:131] duration metric: took 28.01482277s to wait for apiserver health ...
I0214 04:21:09.021845 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:21:09.021853 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:09.023946 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:05.771858 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:05.772454 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:05.772494 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:05.772403 1550044 retry.go:31] will retry after 2.280902204s: waiting for machine to come up
I0214 04:21:08.054571 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:08.055138 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:08.055173 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:08.055076 1550044 retry.go:31] will retry after 1.815235532s: waiting for machine to come up
I0214 04:21:06.844839 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:07.283580 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.283613 1548416 pod_ready.go:81] duration metric: took 6.793414916s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.283638 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294673 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.294704 1548416 pod_ready.go:81] duration metric: took 11.057139ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294719 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303085 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.303113 1548416 pod_ready.go:81] duration metric: took 8.385115ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303125 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310622 1548416 pod_ready.go:92] pod "kube-proxy-4wk86" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.310649 1548416 pod_ready.go:81] duration metric: took 7.515057ms for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310661 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.323237 1548416 pod_ready.go:102] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:09.821404 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:09.821523 1548416 pod_ready.go:81] duration metric: took 2.510851991s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.821565 1548416 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:06.018693 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:06.380858 1548589 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:06.387108 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:06.393578 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:06.399652 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:06.405980 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:06.412267 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:06.419780 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:06.427216 1548589 kubeadm.go:391] StartCluster: {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration
:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:06.427363 1548589 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:06.427422 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.497747 1548589 cri.go:89] found id: ""
I0214 04:21:06.497834 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:06.516612 1548589 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:06.516658 1548589 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:06.516667 1548589 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:06.516733 1548589 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:06.529291 1548589 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:06.531168 1548589 kubeconfig.go:125] found "default-k8s-diff-port-224675" server: "https://192.168.61.188:8444"
I0214 04:21:06.535161 1548589 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:06.546663 1548589 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.61.188
I0214 04:21:06.546708 1548589 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:06.546726 1548589 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:06.546803 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.597843 1548589 cri.go:89] found id: ""
I0214 04:21:06.597935 1548589 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:06.616190 1548589 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:06.628139 1548589 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:06.628171 1548589 kubeadm.go:156] found existing configuration files:
I0214 04:21:06.628236 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I0214 04:21:06.638453 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:06.638512 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:06.648959 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I0214 04:21:06.660706 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:06.660788 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:06.671857 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I0214 04:21:06.682340 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:06.682407 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:06.692058 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I0214 04:21:06.701943 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:06.702022 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:06.711790 1548589 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:06.721996 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:06.889535 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.226025 1548589 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.336439873s)
I0214 04:21:08.226061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.459929 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.556113 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.663379 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:08.663488 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.164266 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.664203 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.163698 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.663743 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.689408 1548589 api_server.go:72] duration metric: took 2.026029304s to wait for apiserver process to appear ...
I0214 04:21:10.689439 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:10.689466 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:10.690130 1548589 api_server.go:269] stopped: https://192.168.61.188:8444/healthz: Get "https://192.168.61.188:8444/healthz": dial tcp 192.168.61.188:8444: connect: connection refused
I0214 04:21:09.025318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:09.044094 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:09.065032 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:09.077574 1548199 system_pods.go:59] 8 kube-system pods found
I0214 04:21:09.077615 1548199 system_pods.go:61] "coredns-76f75df574-kszkn" [e042e368-b6a1-481d-ac0e-a41fded08d17] Running
I0214 04:21:09.077624 1548199 system_pods.go:61] "etcd-no-preload-527067" [f9eb0545-49ea-4302-89ba-f897701543c8] Running
I0214 04:21:09.077632 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [294a622e-a6af-46f1-b011-4d932202c48c] Running
I0214 04:21:09.077641 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [cb6ca785-3638-4e5c-8950-bddb982904b4] Running
I0214 04:21:09.077648 1548199 system_pods.go:61] "kube-proxy-x55kr" [b523c872-d6f6-4522-b3f0-669b55d4784c] Running
I0214 04:21:09.077656 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [7e451830-0a27-4fa9-8ebd-36ae39aa0214] Running
I0214 04:21:09.077669 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-jq29b" [0c974098-1c0c-482e-a187-95f35842b947] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:09.077686 1548199 system_pods.go:61] "storage-provisioner" [d4ce4210-3a50-4839-9266-54a8a6725728] Running
I0214 04:21:09.077698 1548199 system_pods.go:74] duration metric: took 12.635754ms to wait for pod list to return data ...
I0214 04:21:09.077713 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:09.080917 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:09.080955 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:09.080972 1548199 node_conditions.go:105] duration metric: took 3.250174ms to run NodePressure ...
I0214 04:21:09.080995 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:09.378306 1548199 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:09.384151 1548199 retry.go:31] will retry after 170.068456ms: kubelet not initialised
I0214 04:21:09.560919 1548199 retry.go:31] will retry after 290.437429ms: kubelet not initialised
I0214 04:21:09.859277 1548199 retry.go:31] will retry after 624.738868ms: kubelet not initialised
I0214 04:21:10.492136 1548199 retry.go:31] will retry after 533.792177ms: kubelet not initialised
I0214 04:21:11.034100 1548199 retry.go:31] will retry after 1.244408489s: kubelet not initialised
I0214 04:21:09.872580 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:09.873073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:09.873109 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:09.873043 1550044 retry.go:31] will retry after 2.578927184s: waiting for machine to come up
I0214 04:21:12.454474 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:12.454906 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:12.454940 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:12.454858 1550044 retry.go:31] will retry after 3.936870017s: waiting for machine to come up
I0214 04:21:11.833118 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:14.329353 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:11.190349 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.926174 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.926304 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:14.926353 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.981084 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.981133 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:15.190448 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.196250 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.196274 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:15.690479 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.698329 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.698362 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:16.190232 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:16.195910 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:21:16.205529 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:21:16.205562 1548589 api_server.go:131] duration metric: took 5.516113354s to wait for apiserver health ...
I0214 04:21:16.205575 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:16.205584 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:16.207433 1548589 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:12.289467 1548199 retry.go:31] will retry after 1.910737554s: kubelet not initialised
I0214 04:21:14.207622 1548199 retry.go:31] will retry after 2.041648758s: kubelet not initialised
I0214 04:21:16.260641 1548199 kubeadm.go:733] kubelet initialised
I0214 04:21:16.260666 1548199 kubeadm.go:734] duration metric: took 6.882327169s waiting for restarted kubelet to initialise ...
I0214 04:21:16.260677 1548199 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.271440 1548199 pod_ready.go:78] waiting up to 4m0s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.208874 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:16.223699 1548589 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:16.242002 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:16.258621 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:21:16.258672 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:21:16.258684 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:21:16.258702 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:21:16.258720 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:21:16.258735 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:21:16.258745 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:21:16.258757 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:16.258773 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:21:16.258782 1548589 system_pods.go:74] duration metric: took 16.754069ms to wait for pod list to return data ...
I0214 04:21:16.258804 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:16.262763 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:16.262799 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:16.262812 1548589 node_conditions.go:105] duration metric: took 4.002558ms to run NodePressure ...
I0214 04:21:16.262833 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:16.517025 1548589 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:16.522602 1548589 kubeadm.go:733] kubelet initialised
I0214 04:21:16.522681 1548589 kubeadm.go:734] duration metric: took 5.568582ms waiting for restarted kubelet to initialise ...
I0214 04:21:16.522703 1548589 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.529946 1548589 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.535926 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535952 1548589 pod_ready.go:81] duration metric: took 5.972224ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.535962 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535971 1548589 pod_ready.go:78] waiting up to 4m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.541171 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541207 1548589 pod_ready.go:81] duration metric: took 5.225365ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.541221 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541229 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.546186 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546218 1548589 pod_ready.go:81] duration metric: took 4.980231ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.546231 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546239 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.646668 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646709 1548589 pod_ready.go:81] duration metric: took 100.455975ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.646726 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646735 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.049656 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049690 1548589 pod_ready.go:81] duration metric: took 402.946278ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.049704 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049713 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.445638 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445677 1548589 pod_ready.go:81] duration metric: took 395.952591ms for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.445694 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445703 1548589 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.847249 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847282 1548589 pod_ready.go:81] duration metric: took 401.569704ms for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.847311 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847322 1548589 pod_ready.go:38] duration metric: took 1.324598748s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:17.847345 1548589 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:21:17.861893 1548589 ops.go:34] apiserver oom_adj: -16
I0214 04:21:17.861926 1548589 kubeadm.go:591] duration metric: took 11.345250928s to restartPrimaryControlPlane
I0214 04:21:17.861937 1548589 kubeadm.go:393] duration metric: took 11.434732694s to StartCluster
I0214 04:21:17.861963 1548589 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.862046 1548589 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:21:17.864089 1548589 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.864357 1548589 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:21:17.866315 1548589 out.go:177] * Verifying Kubernetes components...
I0214 04:21:17.864450 1548589 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:21:17.864662 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:21:17.867813 1548589 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867813 1548589 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867893 1548589 addons.go:234] Setting addon storage-provisioner=true in "default-k8s-diff-port-224675"
W0214 04:21:17.867911 1548589 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:21:17.867931 1548589 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-224675"
I0214 04:21:17.867822 1548589 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867990 1548589 addons.go:234] Setting addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:17.867995 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
W0214 04:21:17.868002 1548589 addons.go:243] addon metrics-server should already be in state true
I0214 04:21:17.868067 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.868372 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868405 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868471 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868586 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868630 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:17.885511 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35721
I0214 04:21:17.886123 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.886736 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.886761 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.887121 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.887700 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.887744 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.888429 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36919
I0214 04:21:17.888436 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37749
I0214 04:21:17.888934 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.888943 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.889459 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889479 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889628 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889638 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889897 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.890090 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.894107 1548589 addons.go:234] Setting addon default-storageclass=true in "default-k8s-diff-port-224675"
W0214 04:21:17.894129 1548589 addons.go:243] addon default-storageclass should already be in state true
I0214 04:21:17.894158 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.894527 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.894573 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.897686 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.898250 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.898277 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.905863 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43347
I0214 04:21:17.906256 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.906706 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.906719 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.907066 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.907252 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.909082 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.912129 1548589 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:17.913850 1548589 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:17.913867 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:21:17.913882 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.913431 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41665
I0214 04:21:17.914856 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.915448 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.915472 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.916246 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.916924 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.916952 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.917227 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917496 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.917535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917782 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.917997 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.918516 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44391
I0214 04:21:17.918650 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.919229 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.919243 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.919838 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.919858 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.920242 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.921364 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.922929 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.925090 1548589 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:21:16.394555 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:16.395079 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:16.395118 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:16.395000 1550044 retry.go:31] will retry after 4.184306662s: waiting for machine to come up
I0214 04:21:17.930415 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:21:17.930435 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:21:17.930457 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.934174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934210 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.934233 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934380 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.937367 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42083
I0214 04:21:17.937375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.937552 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.937951 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.937949 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.938390 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.938405 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.938789 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.939000 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.940318 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.940561 1548589 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:17.940575 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:21:17.940588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.943188 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943558 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.943600 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943816 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.943954 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.944088 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.944168 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:18.108100 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:18.126785 1548589 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:18.199680 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:21:18.199711 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:21:18.211800 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:18.225027 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:21:18.225053 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:21:18.244323 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.244358 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:21:18.276796 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.350125 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:19.154449 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154480 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.154805 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.154827 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.154841 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154853 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.155094 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.155200 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.155172 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.163519 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.163539 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.163825 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.163880 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.561946 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.28509634s)
I0214 04:21:19.562006 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562027 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562344 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.562355 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562371 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562386 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562395 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562697 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562718 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562731 1548589 addons.go:470] Verifying addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:19.632363 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.282192396s)
I0214 04:21:19.632421 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632434 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.632756 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.632777 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.632777 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.632787 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632796 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.633163 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.633192 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.633209 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.635385 1548589 out.go:177] * Enabled addons: default-storageclass, metrics-server, storage-provisioner
I0214 04:21:16.330627 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:18.829917 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:19.636745 1548589 addons.go:505] duration metric: took 1.772300134s for enable addons: enabled=[default-storageclass metrics-server storage-provisioner]
I0214 04:21:20.130535 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:18.278986 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.279953 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.581058 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581627 1548015 main.go:141] libmachine: (old-k8s-version-960884) Found IP for machine: 192.168.72.206
I0214 04:21:20.581661 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has current primary IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581676 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserving static IP address...
I0214 04:21:20.582088 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.582127 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | skip adding static IP to network mk-old-k8s-version-960884 - found existing host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"}
I0214 04:21:20.582141 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserved static IP address: 192.168.72.206
I0214 04:21:20.582161 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting for SSH to be available...
I0214 04:21:20.582177 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Getting to WaitForSSH function...
I0214 04:21:20.584389 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584675 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.584703 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584856 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH client type: external
I0214 04:21:20.584883 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa (-rw-------)
I0214 04:21:20.584919 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.206 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:21:20.584935 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | About to run SSH command:
I0214 04:21:20.584946 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | exit 0
I0214 04:21:20.681801 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | SSH cmd err, output: <nil>:
I0214 04:21:20.682218 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetConfigRaw
I0214 04:21:20.683002 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:20.686419 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.686997 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.687032 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.687340 1548015 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/config.json ...
I0214 04:21:20.687596 1548015 machine.go:94] provisionDockerMachine start ...
I0214 04:21:20.687624 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:20.687892 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.690877 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691276 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.691307 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691491 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.691695 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.691868 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.692066 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.692276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.692587 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.692598 1548015 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:21:20.821994 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:21:20.822030 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822348 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:21:20.822383 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822629 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.825677 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826050 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.826081 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826289 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.826531 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826688 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826859 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.827085 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.827569 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.827591 1548015 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-960884 && echo "old-k8s-version-960884" | sudo tee /etc/hostname
I0214 04:21:20.970187 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-960884
I0214 04:21:20.970224 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.972969 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973418 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.973457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973649 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.973838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.973991 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.974112 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.974276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.974644 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.974663 1548015 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-960884' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-960884/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-960884' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:21:21.109947 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:21:21.109989 1548015 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:21:21.110028 1548015 buildroot.go:174] setting up certificates
I0214 04:21:21.110040 1548015 provision.go:84] configureAuth start
I0214 04:21:21.110055 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:21.110430 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:21.113401 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113720 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.113755 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.116563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.116901 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.116928 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.117065 1548015 provision.go:143] copyHostCerts
I0214 04:21:21.117136 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:21:21.117149 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:21:21.117216 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:21:21.117349 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:21:21.117363 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:21:21.117397 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:21:21.117479 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:21:21.117495 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:21:21.117525 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:21:21.117600 1548015 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-960884 san=[127.0.0.1 192.168.72.206 localhost minikube old-k8s-version-960884]
I0214 04:21:21.249602 1548015 provision.go:177] copyRemoteCerts
I0214 04:21:21.249679 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:21:21.249705 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.252629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253091 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.253120 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253338 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.253535 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.253683 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.253817 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.352374 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:21:21.376684 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0214 04:21:21.400100 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:21:21.422025 1548015 provision.go:87] duration metric: took 311.969213ms to configureAuth
I0214 04:21:21.422062 1548015 buildroot.go:189] setting minikube options for container-runtime
I0214 04:21:21.422289 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:21:21.422388 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.425363 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425732 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.425769 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425922 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.426103 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426259 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426369 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.426526 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.426855 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.426883 1548015 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:21:21.762573 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:21:21.762683 1548015 machine.go:97] duration metric: took 1.075066333s to provisionDockerMachine
I0214 04:21:21.762703 1548015 start.go:293] postStartSetup for "old-k8s-version-960884" (driver="kvm2")
I0214 04:21:21.762722 1548015 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:21:21.762772 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:21.763195 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:21:21.763254 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.766548 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.766932 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.766960 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.767123 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.767363 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.767558 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.767724 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.864283 1548015 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:21:21.869125 1548015 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:21:21.869155 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:21:21.869235 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:21:21.869404 1548015 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:21:21.869542 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:21:21.879233 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:21.901977 1548015 start.go:296] duration metric: took 139.253065ms for postStartSetup
I0214 04:21:21.902024 1548015 fix.go:56] duration metric: took 23.727695033s for fixHost
I0214 04:21:21.902051 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.904963 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905391 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.905429 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905645 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.905838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906175 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.906361 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.906733 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.906748 1548015 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:21:22.034574 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884481.977175244
I0214 04:21:22.034604 1548015 fix.go:216] guest clock: 1707884481.977175244
I0214 04:21:22.034613 1548015 fix.go:229] Guest: 2024-02-14 04:21:21.977175244 +0000 UTC Remote: 2024-02-14 04:21:21.902028761 +0000 UTC m=+362.408004482 (delta=75.146483ms)
I0214 04:21:22.034653 1548015 fix.go:200] guest clock delta is within tolerance: 75.146483ms
I0214 04:21:22.034658 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 23.860366317s
I0214 04:21:22.034685 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.034987 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:22.038178 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038662 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.038693 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038881 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039433 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039661 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039752 1548015 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:21:22.039824 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.039923 1548015 ssh_runner.go:195] Run: cat /version.json
I0214 04:21:22.039956 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.042871 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.042905 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043230 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043269 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043303 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043320 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043406 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043515 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043651 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043738 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043831 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043988 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.044088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.155962 1548015 ssh_runner.go:195] Run: systemctl --version
I0214 04:21:22.161514 1548015 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:21:22.307311 1548015 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:21:22.313795 1548015 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:21:22.313886 1548015 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:21:22.331192 1548015 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:21:22.331219 1548015 start.go:494] detecting cgroup driver to use...
I0214 04:21:22.331295 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:21:22.348525 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:21:22.360700 1548015 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:21:22.360765 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:21:22.373323 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:21:22.386326 1548015 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:21:22.500712 1548015 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:21:22.628951 1548015 docker.go:233] disabling docker service ...
I0214 04:21:22.629047 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:21:22.644389 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:21:22.656100 1548015 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:21:22.771454 1548015 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:21:22.890367 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:21:22.906025 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:21:22.923645 1548015 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0214 04:21:22.923718 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.934179 1548015 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:21:22.934261 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.945371 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.955276 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.965963 1548015 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:21:22.977213 1548015 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:21:22.987180 1548015 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:21:22.987242 1548015 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:21:23.001621 1548015 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:21:23.011279 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:23.138894 1548015 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:21:23.320312 1548015 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:21:23.320405 1548015 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:21:23.331416 1548015 start.go:562] Will wait 60s for crictl version
I0214 04:21:23.331498 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:23.336532 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:21:23.383038 1548015 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:21:23.383147 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.439429 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.497766 1548015 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.24.1 ...
I0214 04:21:23.499416 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:23.502453 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.502863 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:23.502890 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.503096 1548015 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:21:23.507846 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:23.521497 1548015 kubeadm.go:877] updating cluster {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0
s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:21:23.521668 1548015 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0214 04:21:23.521743 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:23.563000 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:23.563077 1548015 ssh_runner.go:195] Run: which lz4
I0214 04:21:23.567232 1548015 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:21:23.571918 1548015 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:21:23.571956 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0214 04:21:20.832765 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:23.331172 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:22.131519 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:24.132734 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:25.632316 1548589 node_ready.go:49] node "default-k8s-diff-port-224675" has status "Ready":"True"
I0214 04:21:25.632355 1548589 node_ready.go:38] duration metric: took 7.505537722s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:25.632378 1548589 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:25.644082 1548589 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663622 1548589 pod_ready.go:92] pod "coredns-5dd5756b68-27jph" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.663652 1548589 pod_ready.go:81] duration metric: took 19.53614ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663665 1548589 pod_ready.go:78] waiting up to 6m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684330 1548589 pod_ready.go:92] pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.684364 1548589 pod_ready.go:81] duration metric: took 20.690068ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684381 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701825 1548589 pod_ready.go:92] pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.701861 1548589 pod_ready.go:81] duration metric: took 17.469749ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701880 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720092 1548589 pod_ready.go:92] pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.720116 1548589 pod_ready.go:81] duration metric: took 18.227307ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720126 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:22.282916 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:24.790590 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:25.407536 1548015 crio.go:444] duration metric: took 1.840347288s to copy over tarball
I0214 04:21:25.407632 1548015 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:28.466951 1548015 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.059268232s)
I0214 04:21:28.466988 1548015 crio.go:451] duration metric: took 3.059413422s to extract the tarball
I0214 04:21:28.466998 1548015 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:28.508517 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:28.568984 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:28.569019 1548015 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:21:28.569089 1548015 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.569113 1548015 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.569124 1548015 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.569194 1548015 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0214 04:21:28.569261 1548015 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.569341 1548015 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.569195 1548015 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.569577 1548015 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570792 1548015 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.570765 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570822 1548015 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0214 04:21:28.570828 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.570830 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.570764 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.570777 1548015 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.570853 1548015 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.761944 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.765651 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.768487 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0214 04:21:28.777658 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.789124 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.831672 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0214 04:21:28.834241 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.835723 1548015 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0214 04:21:28.835774 1548015 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.835821 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.846042 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.894678 1548015 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0214 04:21:28.894728 1548015 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.894778 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944386 1548015 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0214 04:21:28.944443 1548015 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.944481 1548015 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0214 04:21:28.944507 1548015 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0214 04:21:28.944509 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944535 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989723 1548015 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0214 04:21:28.989774 1548015 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0214 04:21:28.989812 1548015 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.989821 1548015 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0214 04:21:28.989853 1548015 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.989779 1548015 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.989907 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989931 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989873 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989933 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:29.110089 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:29.110123 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0214 04:21:29.110142 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0214 04:21:29.110230 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0214 04:21:29.110281 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0214 04:21:29.110339 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:29.110389 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:29.250488 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0214 04:21:29.250791 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0214 04:21:29.254821 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0214 04:21:29.254967 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0214 04:21:29.255074 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0214 04:21:29.255084 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0214 04:21:29.255142 1548015 cache_images.go:92] duration metric: took 686.107956ms to LoadCachedImages
W0214 04:21:29.255222 1548015 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0: no such file or directory
I0214 04:21:29.255239 1548015 kubeadm.go:928] updating node { 192.168.72.206 8443 v1.16.0 crio true true} ...
I0214 04:21:29.255399 1548015 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-960884 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.206
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:29.255479 1548015 ssh_runner.go:195] Run: crio config
I0214 04:21:29.317891 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:29.317923 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:29.317935 1548015 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:29.317961 1548015 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.206 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-960884 NodeName:old-k8s-version-960884 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.206"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.206 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0214 04:21:29.318104 1548015 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.206
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-960884"
kubeletExtraArgs:
node-ip: 192.168.72.206
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.206"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-960884
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.72.206:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:29.318193 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0214 04:21:29.327452 1548015 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:29.327531 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:29.337200 1548015 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0214 04:21:29.352775 1548015 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:29.370691 1548015 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2181 bytes)
I0214 04:21:29.391607 1548015 ssh_runner.go:195] Run: grep 192.168.72.206 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:29.395665 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.206 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:29.409170 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:29.518566 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:29.534160 1548015 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884 for IP: 192.168.72.206
I0214 04:21:29.534202 1548015 certs.go:194] generating shared ca certs ...
I0214 04:21:29.534231 1548015 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:29.534487 1548015 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:29.534575 1548015 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:29.534595 1548015 certs.go:256] generating profile certs ...
I0214 04:21:29.534721 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/client.key
I0214 04:21:29.534813 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key.83e6709b
I0214 04:21:29.534879 1548015 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key
I0214 04:21:29.535019 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:29.535076 1548015 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:29.535089 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:29.535122 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:29.535155 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:29.535198 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:29.535265 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:29.536212 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:25.332784 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:27.830166 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:26.031649 1548589 pod_ready.go:92] pod "kube-proxy-dbkzv" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:26.031684 1548589 pod_ready.go:81] duration metric: took 311.550001ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:26.031698 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:28.040585 1548589 pod_ready.go:102] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:30.465468 1548589 pod_ready.go:92] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:30.465504 1548589 pod_ready.go:81] duration metric: took 4.433796246s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:30.465519 1548589 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:27.279574 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.552593 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.576065 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:29.714093 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:29.748054 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:29.777699 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0214 04:21:29.804606 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:29.829987 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:29.853803 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0214 04:21:29.878360 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:29.901845 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:29.926801 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:29.951044 1548015 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:29.970807 1548015 ssh_runner.go:195] Run: openssl version
I0214 04:21:29.977053 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:29.990302 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996045 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996150 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:30.002320 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:30.014065 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:30.027194 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032670 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032739 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.039164 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:30.051920 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:30.064135 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070013 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070096 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.076531 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:30.087989 1548015 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:30.094182 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:30.100653 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:30.106827 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:30.112695 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:30.118991 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:30.124783 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:30.130728 1548015 kubeadm.go:391] StartCluster: {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s M
ount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:30.130856 1548015 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:30.130920 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.172760 1548015 cri.go:89] found id: ""
I0214 04:21:30.172844 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:30.182798 1548015 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:30.182820 1548015 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:30.182833 1548015 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:30.182890 1548015 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:30.191987 1548015 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:30.193332 1548015 kubeconfig.go:125] found "old-k8s-version-960884" server: "https://192.168.72.206:8443"
I0214 04:21:30.195906 1548015 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:30.204941 1548015 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.72.206
I0214 04:21:30.204971 1548015 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:30.204983 1548015 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:30.205030 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.246746 1548015 cri.go:89] found id: ""
I0214 04:21:30.246835 1548015 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:30.265837 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:30.277949 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:30.277986 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:21:30.278049 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:21:30.287840 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:30.287899 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:30.298734 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:21:30.307885 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:30.307983 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:30.317668 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:21:30.326303 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:30.326366 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:30.335884 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:21:30.344902 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:30.345020 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:30.355826 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:30.366201 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:30.517881 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.202023 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.400048 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.491748 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.625368 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:31.625475 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.126481 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.626533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.126533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.625871 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.658063 1548015 api_server.go:72] duration metric: took 2.032718395s to wait for apiserver process to appear ...
I0214 04:21:33.658096 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:33.658118 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:30.329984 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.830531 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.831590 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.475902 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.973325 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:31.780474 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.281836 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:36.284001 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.658562 1548015 api_server.go:269] stopped: https://192.168.72.206:8443/healthz: Get "https://192.168.72.206:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:38.658613 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.453628 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.453667 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:39.453686 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.476016 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.476042 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:37.330750 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.829556 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.659245 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.678800 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:39.678842 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.158920 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.165230 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:40.165286 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.659134 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.666024 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:21:40.674534 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:21:40.674571 1548015 api_server.go:131] duration metric: took 7.016466266s to wait for apiserver health ...
I0214 04:21:40.674584 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:40.674594 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:40.676474 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:36.974542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.474238 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.781991 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.280560 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:40.677823 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:40.689136 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:40.709008 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:40.719306 1548015 system_pods.go:59] 7 kube-system pods found
I0214 04:21:40.719343 1548015 system_pods.go:61] "coredns-5644d7b6d9-9ph4x" [6f0623c3-2524-4ba1-b0f2-43c8cdf5d3b2] Running
I0214 04:21:40.719350 1548015 system_pods.go:61] "etcd-old-k8s-version-960884" [6b8c8c75-cb3e-4b82-bc58-51b05ed826a7] Running
I0214 04:21:40.719357 1548015 system_pods.go:61] "kube-apiserver-old-k8s-version-960884" [2d8f7b59-3872-4499-9504-1f030e7c8094] Running
I0214 04:21:40.719364 1548015 system_pods.go:61] "kube-controller-manager-old-k8s-version-960884" [78c409e9-42ac-447c-99c6-6f9b687c2d36] Running
I0214 04:21:40.719378 1548015 system_pods.go:61] "kube-proxy-csc94" [091dfdb5-e19e-40c3-8d1a-e27448a61134] Running
I0214 04:21:40.719384 1548015 system_pods.go:61] "kube-scheduler-old-k8s-version-960884" [7cd0a53c-f839-4886-8902-95a9617c0223] Running
I0214 04:21:40.719390 1548015 system_pods.go:61] "storage-provisioner" [1531bf30-b7cb-46dd-8059-139eda59ab91] Running
I0214 04:21:40.719402 1548015 system_pods.go:74] duration metric: took 10.361661ms to wait for pod list to return data ...
I0214 04:21:40.719419 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:40.723811 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:40.723849 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:40.723864 1548015 node_conditions.go:105] duration metric: took 4.43897ms to run NodePressure ...
I0214 04:21:40.723893 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:40.977897 1548015 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:40.981121 1548015 retry.go:31] will retry after 128.555505ms: kubelet not initialised
I0214 04:21:41.115327 1548015 retry.go:31] will retry after 372.280627ms: kubelet not initialised
I0214 04:21:41.502405 1548015 retry.go:31] will retry after 313.632774ms: kubelet not initialised
I0214 04:21:41.825529 1548015 retry.go:31] will retry after 544.787289ms: kubelet not initialised
I0214 04:21:42.384758 1548015 retry.go:31] will retry after 1.43607177s: kubelet not initialised
I0214 04:21:43.832903 1548015 retry.go:31] will retry after 1.235835339s: kubelet not initialised
I0214 04:21:42.329232 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.330406 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.974395 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.477378 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:43.778781 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.778914 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.073614 1548015 retry.go:31] will retry after 4.115318211s: kubelet not initialised
I0214 04:21:49.193659 1548015 retry.go:31] will retry after 3.071167603s: kubelet not initialised
I0214 04:21:46.829802 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.331008 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:46.974416 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.473600 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:48.278392 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:50.279104 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.271827 1548015 retry.go:31] will retry after 4.905866185s: kubelet not initialised
I0214 04:21:51.331690 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.829509 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:51.973092 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.974274 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.280558 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:54.782002 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:55.278849 1548199 pod_ready.go:92] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.278875 1548199 pod_ready.go:81] duration metric: took 39.007391751s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.278887 1548199 pod_ready.go:78] waiting up to 4m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284671 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.284698 1548199 pod_ready.go:81] duration metric: took 5.804847ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284711 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289743 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.289762 1548199 pod_ready.go:81] duration metric: took 5.043413ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289770 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294751 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.294769 1548199 pod_ready.go:81] duration metric: took 4.99309ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294778 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299781 1548199 pod_ready.go:92] pod "kube-proxy-x55kr" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.299805 1548199 pod_ready.go:81] duration metric: took 5.020271ms for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299817 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677017 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.677045 1548199 pod_ready.go:81] duration metric: took 377.218998ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677059 1548199 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
I0214 04:21:57.184269 1548015 retry.go:31] will retry after 9.183740474s: kubelet not initialised
I0214 04:21:56.331498 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.828024 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:56.473208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.475219 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.974208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:57.684889 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.187231 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.829899 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.329789 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.474087 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:05.973662 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:02.683519 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:04.686765 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:06.375294 1548015 retry.go:31] will retry after 10.020373951s: kubelet not initialised
I0214 04:22:05.330250 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.829740 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.830530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.978588 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:10.473694 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.184721 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:11.185656 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.329405 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.829220 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.474366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.975443 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:13.683763 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:15.683805 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:16.402320 1548015 retry.go:31] will retry after 15.374173134s: kubelet not initialised
I0214 04:22:16.829525 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.330075 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:17.474403 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.973780 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:18.185466 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:20.186291 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.829432 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:23.834007 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.976320 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.474283 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:22.684964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.685062 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.685477 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.329169 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.329997 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.476641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.973366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:30.974012 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:29.184272 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.184459 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.781677 1548015 kubeadm.go:733] kubelet initialised
I0214 04:22:31.781704 1548015 kubeadm.go:734] duration metric: took 50.803779674s waiting for restarted kubelet to initialise ...
I0214 04:22:31.781719 1548015 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:22:31.786850 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791542 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.791560 1548015 pod_ready.go:81] duration metric: took 4.686316ms for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791568 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796485 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.796505 1548015 pod_ready.go:81] duration metric: took 4.931563ms for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796514 1548015 pod_ready.go:78] waiting up to 4m0s for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805785 1548015 pod_ready.go:92] pod "etcd-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.805802 1548015 pod_ready.go:81] duration metric: took 9.282838ms for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805810 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810054 1548015 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.810071 1548015 pod_ready.go:81] duration metric: took 4.255532ms for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810082 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182215 1548015 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.182243 1548015 pod_ready.go:81] duration metric: took 372.153995ms for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182252 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582145 1548015 pod_ready.go:92] pod "kube-proxy-csc94" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.582173 1548015 pod_ready.go:81] duration metric: took 399.915006ms for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582181 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981350 1548015 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.981378 1548015 pod_ready.go:81] duration metric: took 399.188492ms for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981415 1548015 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
I0214 04:22:30.830906 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.330140 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.473744 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.973699 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.186827 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.686309 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:34.989538 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.488713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.488883 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.828958 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.829284 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.829823 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.974025 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.473910 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.688964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.185392 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:41.989551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.487817 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.329132 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.329344 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.475040 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.972605 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.187968 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.683996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.685030 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.488902 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.489494 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.829203 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.829494 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.973991 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:49.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.685120 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.686084 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.988398 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:52.988448 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.332998 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.829030 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.979340 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.476506 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.184251 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:55.685108 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.990421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:57.488098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:59.489487 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.328826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.973425 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.973762 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.185513 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.684633 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.989929 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:04.489964 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.828826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.832159 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.473241 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:03.474787 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.474970 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.685927 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.184376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:06.494093 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:08.989439 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.328777 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.828637 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.829373 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.973237 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.975687 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.184628 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.184711 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.187647 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.488966 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.988214 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.830718 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.329069 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:12.474693 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.977568 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.189114 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:15.684342 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.490073 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.989036 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.329532 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.332792 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:17.475839 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:19.972797 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.184713 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.683768 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.489160 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.489440 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.829097 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.830033 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.830536 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.974815 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.976133 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.684285 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.685554 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:25.988251 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.988908 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.329244 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.330485 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:26.475964 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:28.982419 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.184598 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.683919 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.684156 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.991522 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:32.488915 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.829760 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.329419 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.473542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.973595 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.973745 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.685000 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.685530 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.988612 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.988713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.989808 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.829339 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:39.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.473757 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.474119 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.184045 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.185960 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.488363 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.989158 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.329290 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.329388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.975321 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.473736 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.683468 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:44.690416 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:46.489697 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:48.989092 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.829184 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.831722 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.474154 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.974446 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.184559 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.186644 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.687583 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.489421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:53.988562 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:50.329667 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.338563 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.829530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.472871 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.473807 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.184095 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.687057 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.488978 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.989503 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.829824 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.329912 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.474847 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.973570 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:00.973652 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.184086 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.488818 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.987787 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.830119 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:04.329491 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:02.973916 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.473218 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.686039 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.184833 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.988871 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.989591 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.329626 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.330752 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.973857 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.474126 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.185966 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.684238 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.489965 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.989505 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.829538 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.830552 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.834481 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.973081 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.474984 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.686130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.184428 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.989770 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.488555 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.828863 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.974045 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:20.474441 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.185605 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.684728 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.685632 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.988389 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.989011 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.491174 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.829015 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:23.830388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:22.974348 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:25.473908 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.183571 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.184732 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.989443 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:29.489238 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.329468 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.829440 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:27.973912 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.472580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.184943 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.684148 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.489461 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.989426 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.328521 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.474634 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:34.476234 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.684963 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.185485 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.488685 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.489813 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.829187 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.829640 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.973580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.974641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.684542 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.186898 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.490022 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.988898 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.328976 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.329745 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.829057 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:41.473013 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:43.473476 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:45.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.683866 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.684597 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:46.687189 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.994614 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.489146 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.329572 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.831061 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.474959 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.973243 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.187340 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.684163 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.988804 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.989029 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.489969 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.328728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.328898 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.473423 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.975259 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.184131 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.184881 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.490033 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.989280 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.329901 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.827955 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:57.473867 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:59.973370 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.684729 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.684873 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.487690 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.988399 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.828728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:02.829737 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.973785 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:04.472611 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.183568 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.184388 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.988477 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.989996 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.329020 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.829709 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.821931 1548416 pod_ready.go:81] duration metric: took 4m0.000330437s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
E0214 04:25:09.821969 1548416 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:09.821992 1548416 pod_ready.go:38] duration metric: took 4m13.851272943s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:09.822023 1548416 kubeadm.go:591] duration metric: took 4m23.487018823s to restartPrimaryControlPlane
W0214 04:25:09.822227 1548416 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:09.822321 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:06.472962 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:08.473224 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.475222 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.184478 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.185147 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:11.186402 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.490868 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.989663 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.974982 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.472802 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:13.187130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.685270 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.489955 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.988265 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.473792 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:19.974720 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:18.185036 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:20.687587 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.917450 1548416 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (14.095094363s)
I0214 04:25:23.917578 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:23.933147 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:25:23.944003 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:25:23.954648 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:25:23.954670 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:25:23.954721 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:25:23.964628 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:25:23.964687 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:25:23.975077 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:25:23.985324 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:25:23.985395 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:25:23.994917 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:25:24.003630 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:25:24.003677 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:25:24.012938 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:25:24.021462 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:25:24.021516 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:25:24.030687 1548416 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:25:24.084345 1548416 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:25:24.084459 1548416 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:25:24.247090 1548416 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:25:24.247242 1548416 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:25:24.247374 1548416 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:25:24.485795 1548416 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:25:19.988669 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:21.988724 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.989786 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.487801 1548416 out.go:204] - Generating certificates and keys ...
I0214 04:25:24.487929 1548416 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:25:24.488045 1548416 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:25:24.488156 1548416 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:25:24.488237 1548416 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:25:24.488319 1548416 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:25:24.488383 1548416 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:25:24.488535 1548416 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:25:24.489833 1548416 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:25:24.491055 1548416 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:25:24.492160 1548416 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:25:24.492954 1548416 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:25:24.493057 1548416 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:25:24.698026 1548416 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:25:24.804410 1548416 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:25:24.911827 1548416 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:25:25.071754 1548416 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:25:25.072362 1548416 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:25:25.074829 1548416 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:25:25.076806 1548416 out.go:204] - Booting up control plane ...
I0214 04:25:25.076910 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:25:25.077012 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:25:25.077429 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:25:25.093739 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:25:25.094504 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:25:25.094594 1548416 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:25:25.245976 1548416 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:25:22.473854 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.474402 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.183996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:25.186464 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.489150 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.489653 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.974174 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.975072 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.473411 1548589 pod_ready.go:81] duration metric: took 4m0.007878225s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:25:30.473436 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0214 04:25:30.473443 1548589 pod_ready.go:38] duration metric: took 4m4.841053907s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:30.473469 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:30.473534 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:30.473603 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:30.529327 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:30.529352 1548589 cri.go:89] found id: ""
I0214 04:25:30.529362 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:30.529463 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.538030 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:30.538092 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:30.589897 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:30.589925 1548589 cri.go:89] found id: ""
I0214 04:25:30.589936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:30.590005 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.595536 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:30.595652 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:30.650191 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:30.650224 1548589 cri.go:89] found id: ""
I0214 04:25:30.650235 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:30.650305 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.666693 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:30.666780 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:30.725870 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:30.725896 1548589 cri.go:89] found id: ""
I0214 04:25:30.725906 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:30.725982 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.731165 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:30.731252 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:30.772330 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:30.772361 1548589 cri.go:89] found id: ""
I0214 04:25:30.772372 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:30.772432 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.777656 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:30.777735 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:30.825727 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:30.825760 1548589 cri.go:89] found id: ""
I0214 04:25:30.825771 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:30.825849 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.830555 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:30.830636 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:30.885427 1548589 cri.go:89] found id: ""
I0214 04:25:30.885461 1548589 logs.go:276] 0 containers: []
W0214 04:25:30.885471 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:30.885480 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:30.885549 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:30.932894 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:30.932928 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:30.932935 1548589 cri.go:89] found id: ""
I0214 04:25:30.932945 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:30.933011 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.937903 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.941946 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:30.941972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:30.957244 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:30.957298 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:31.006421 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:31.006469 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:27.687719 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.184052 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:33.251700 1548416 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.005690 seconds
I0214 04:25:33.251865 1548416 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:25:33.279172 1548416 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:25:33.813646 1548416 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:25:33.813879 1548416 kubeadm.go:309] [mark-control-plane] Marking the node embed-certs-722906 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:25:34.330117 1548416 kubeadm.go:309] [bootstrap-token] Using token: ljwfse.zvxgc1v12nz5i5q8
I0214 04:25:30.490723 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:32.490888 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.331680 1548416 out.go:204] - Configuring RBAC rules ...
I0214 04:25:34.331854 1548416 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:25:34.338019 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:25:34.346414 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:25:34.356280 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:25:34.363364 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:25:34.367537 1548416 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:25:34.386334 1548416 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:25:34.635264 1548416 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:25:34.746128 1548416 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:25:34.747640 1548416 kubeadm.go:309]
I0214 04:25:34.747718 1548416 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:25:34.747729 1548416 kubeadm.go:309]
I0214 04:25:34.747815 1548416 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:25:34.747825 1548416 kubeadm.go:309]
I0214 04:25:34.747855 1548416 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:25:34.747919 1548416 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:25:34.747991 1548416 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:25:34.748001 1548416 kubeadm.go:309]
I0214 04:25:34.748053 1548416 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:25:34.748057 1548416 kubeadm.go:309]
I0214 04:25:34.748096 1548416 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:25:34.748102 1548416 kubeadm.go:309]
I0214 04:25:34.748166 1548416 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:25:34.748221 1548416 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:25:34.748286 1548416 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:25:34.748293 1548416 kubeadm.go:309]
I0214 04:25:34.748388 1548416 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:25:34.748476 1548416 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:25:34.748483 1548416 kubeadm.go:309]
I0214 04:25:34.748576 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748694 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:25:34.748719 1548416 kubeadm.go:309] --control-plane
I0214 04:25:34.748725 1548416 kubeadm.go:309]
I0214 04:25:34.748824 1548416 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:25:34.748831 1548416 kubeadm.go:309]
I0214 04:25:34.748897 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748999 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:25:34.752065 1548416 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:25:34.752103 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:25:34.752116 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:25:34.753766 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:25:34.754902 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:25:34.796511 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:25:34.854873 1548416 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:25:34.855010 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:34.855147 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-722906 minikube.k8s.io/updated_at=2024_02_14T04_25_34_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=embed-certs-722906 minikube.k8s.io/primary=true
I0214 04:25:34.950220 1548416 ops.go:34] apiserver oom_adj: -16
I0214 04:25:35.202083 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:31.057754 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:31.057788 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:31.119551 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:31.119592 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:31.180933 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:31.180972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:31.236512 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:31.236559 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:31.290709 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:31.290749 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:31.343989 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:31.344029 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:31.391042 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:31.391076 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:31.436728 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:31.436768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:31.924773 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:31.924835 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:32.076912 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:32.076958 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.634522 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:34.660761 1548589 api_server.go:72] duration metric: took 4m16.796363202s to wait for apiserver process to appear ...
I0214 04:25:34.660794 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:34.660846 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:34.660918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:34.730857 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.730891 1548589 cri.go:89] found id: ""
I0214 04:25:34.730902 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:34.730963 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.735849 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:34.735918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:34.791895 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:34.791926 1548589 cri.go:89] found id: ""
I0214 04:25:34.791936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:34.791999 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.798706 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:34.798792 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:34.848256 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:34.848280 1548589 cri.go:89] found id: ""
I0214 04:25:34.848288 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:34.848339 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.853629 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:34.853699 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:34.908476 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:34.908509 1548589 cri.go:89] found id: ""
I0214 04:25:34.908521 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:34.908586 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.913799 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:34.913881 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:34.956647 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:34.956733 1548589 cri.go:89] found id: ""
I0214 04:25:34.956747 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:34.956799 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.961972 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:34.962058 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:35.005734 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.005763 1548589 cri.go:89] found id: ""
I0214 04:25:35.005772 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:35.005824 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.012134 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:35.012215 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:35.057761 1548589 cri.go:89] found id: ""
I0214 04:25:35.057788 1548589 logs.go:276] 0 containers: []
W0214 04:25:35.057795 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:35.057801 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:35.057902 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:35.100965 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.100992 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.100996 1548589 cri.go:89] found id: ""
I0214 04:25:35.101003 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:35.101058 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.105885 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.110123 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:35.110151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:35.189435 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:35.189477 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:35.206289 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:35.206328 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:35.263399 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:35.263450 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.329373 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:35.329410 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.370980 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:35.371016 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:35.519971 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:35.520010 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.565453 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:35.565488 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:35.622596 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:35.622626 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:35.679526 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:35.679563 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:35.726343 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:35.726386 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:35.774533 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:35.774578 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:35.819726 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:35.819758 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:32.186812 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.686565 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.989832 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:37.489923 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:35.702927 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.203043 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.702176 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.203031 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.702509 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.203045 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.703098 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.203120 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.702193 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:40.202469 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.718371 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:25:38.726571 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:25:38.728501 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:25:38.728531 1548589 api_server.go:131] duration metric: took 4.067727996s to wait for apiserver health ...
I0214 04:25:38.728543 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:38.728574 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:38.728639 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:38.777478 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:38.777506 1548589 cri.go:89] found id: ""
I0214 04:25:38.777516 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:38.777582 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.785109 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:38.785170 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:38.829370 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:38.829398 1548589 cri.go:89] found id: ""
I0214 04:25:38.829409 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:38.829475 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.834285 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:38.834359 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:38.879921 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:38.879967 1548589 cri.go:89] found id: ""
I0214 04:25:38.879978 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:38.880045 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.884937 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:38.884994 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:38.929638 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:38.929663 1548589 cri.go:89] found id: ""
I0214 04:25:38.929672 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:38.929739 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.934420 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:38.934485 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:38.982428 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:38.982464 1548589 cri.go:89] found id: ""
I0214 04:25:38.982476 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:38.982541 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.987942 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:38.988014 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:39.027009 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:39.027041 1548589 cri.go:89] found id: ""
I0214 04:25:39.027051 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:39.027115 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.031258 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:39.031312 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:39.074333 1548589 cri.go:89] found id: ""
I0214 04:25:39.074363 1548589 logs.go:276] 0 containers: []
W0214 04:25:39.074374 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:39.074382 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:39.074445 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:39.121097 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.121119 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.121125 1548589 cri.go:89] found id: ""
I0214 04:25:39.121132 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:39.121192 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.125559 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.129744 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:39.129768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:39.169819 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:39.169857 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:39.217193 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:39.217224 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:39.267119 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:39.267173 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:39.333382 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:39.333426 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.380541 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:39.380575 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.426020 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:39.426061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:39.787418 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:39.787471 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:39.850366 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:39.850412 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:39.970082 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:39.970127 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:40.014849 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:40.014876 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:40.064556 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:40.064597 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:40.116058 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:40.116092 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:37.187809 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:39.684638 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.642784 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:25:42.642824 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.642836 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.642847 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.642854 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.642860 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.642866 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.642876 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.642889 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.642900 1548589 system_pods.go:74] duration metric: took 3.914348976s to wait for pod list to return data ...
I0214 04:25:42.642913 1548589 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:42.647178 1548589 default_sa.go:45] found service account: "default"
I0214 04:25:42.647199 1548589 default_sa.go:55] duration metric: took 4.279291ms for default service account to be created ...
I0214 04:25:42.647208 1548589 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:42.656453 1548589 system_pods.go:86] 8 kube-system pods found
I0214 04:25:42.656474 1548589 system_pods.go:89] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.656480 1548589 system_pods.go:89] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.656485 1548589 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.656490 1548589 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.656494 1548589 system_pods.go:89] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.656498 1548589 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.656504 1548589 system_pods.go:89] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.656509 1548589 system_pods.go:89] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.656517 1548589 system_pods.go:126] duration metric: took 9.303804ms to wait for k8s-apps to be running ...
I0214 04:25:42.656523 1548589 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:42.656567 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:42.675938 1548589 system_svc.go:56] duration metric: took 19.40332ms WaitForService to wait for kubelet
I0214 04:25:42.675968 1548589 kubeadm.go:576] duration metric: took 4m24.811581461s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:42.675997 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:42.680017 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:42.680051 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:42.680099 1548589 node_conditions.go:105] duration metric: took 4.09496ms to run NodePressure ...
I0214 04:25:42.680116 1548589 start.go:240] waiting for startup goroutines ...
I0214 04:25:42.680129 1548589 start.go:245] waiting for cluster config update ...
I0214 04:25:42.680147 1548589 start.go:254] writing updated cluster config ...
I0214 04:25:42.680530 1548589 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:42.736509 1548589 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:42.739295 1548589 out.go:177] * Done! kubectl is now configured to use "default-k8s-diff-port-224675" cluster and "default" namespace by default
I0214 04:25:39.988499 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.487797 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.488009 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:40.702290 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.202214 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.702270 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.202407 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.702166 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.202987 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.702484 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.202110 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.702114 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:45.202558 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.184826 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.685376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.685510 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:45.702721 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.202291 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.703068 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.837652 1548416 kubeadm.go:1106] duration metric: took 11.982686598s to wait for elevateKubeSystemPrivileges
W0214 04:25:46.837704 1548416 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:25:46.837716 1548416 kubeadm.go:393] duration metric: took 5m0.565491944s to StartCluster
I0214 04:25:46.837742 1548416 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.837855 1548416 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:25:46.840795 1548416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.841125 1548416 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:25:46.842696 1548416 out.go:177] * Verifying Kubernetes components...
I0214 04:25:46.841205 1548416 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:25:46.841387 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:25:46.844126 1548416 addons.go:69] Setting default-storageclass=true in profile "embed-certs-722906"
I0214 04:25:46.844139 1548416 addons.go:69] Setting metrics-server=true in profile "embed-certs-722906"
I0214 04:25:46.844161 1548416 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-722906"
I0214 04:25:46.844186 1548416 addons.go:234] Setting addon metrics-server=true in "embed-certs-722906"
W0214 04:25:46.844201 1548416 addons.go:243] addon metrics-server should already be in state true
I0214 04:25:46.844238 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844126 1548416 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-722906"
I0214 04:25:46.844300 1548416 addons.go:234] Setting addon storage-provisioner=true in "embed-certs-722906"
W0214 04:25:46.844326 1548416 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:25:46.844126 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:25:46.844363 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844562 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844592 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844663 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844699 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844736 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844799 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.861369 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43067
I0214 04:25:46.861608 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41001
I0214 04:25:46.862027 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862176 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862591 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862626 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.862672 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862689 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.863022 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863215 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37963
I0214 04:25:46.863398 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863596 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.863763 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.864032 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.864056 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.864428 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.864568 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.864611 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.864955 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.865007 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.867986 1548416 addons.go:234] Setting addon default-storageclass=true in "embed-certs-722906"
W0214 04:25:46.868013 1548416 addons.go:243] addon default-storageclass should already be in state true
I0214 04:25:46.868058 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.868432 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.868487 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.881291 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39701
I0214 04:25:46.882035 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.882540 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.882555 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.883263 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34619
I0214 04:25:46.883304 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.883548 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.883717 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.884554 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.884580 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.885036 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.885241 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.885647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.885718 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35895
I0214 04:25:46.887988 1548416 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:25:46.886555 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.886681 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.889304 1548416 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:46.889318 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:25:46.889335 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.890487 1548416 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:25:46.489212 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:48.990116 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.890206 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.891625 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.891590 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:25:46.891694 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:25:46.891710 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.892169 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.892674 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893285 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.893311 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.893494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.893556 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.893583 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893734 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.893993 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.894174 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.894439 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.894862 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.894886 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.895040 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.895172 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.895286 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.895362 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.912395 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38507
I0214 04:25:46.912945 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.913571 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.913598 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.913955 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.914139 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.915701 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.915924 1548416 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:46.915936 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:25:46.915949 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.918689 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919161 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.919259 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919614 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.919795 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.919991 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.920118 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:47.174988 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:25:47.211043 1548416 node_ready.go:35] waiting up to 6m0s for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248873 1548416 node_ready.go:49] node "embed-certs-722906" has status "Ready":"True"
I0214 04:25:47.248902 1548416 node_ready.go:38] duration metric: took 37.827003ms for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248914 1548416 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:47.291049 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:47.295308 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:47.304396 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:25:47.304431 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:25:47.312577 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:47.352103 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:25:47.352142 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:25:47.652975 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:47.653009 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:25:47.701829 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:49.316545 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.106061464s)
I0214 04:25:49.397232 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397245 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.084547595s)
I0214 04:25:49.397335 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397353 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397607 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397715 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397743 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397752 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397771 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397807 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397824 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397839 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397694 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.397987 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.398013 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398033 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.398118 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398132 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.454369 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.454395 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.454743 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.454768 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.658753 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.956862479s)
I0214 04:25:49.658827 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.658845 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659187 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659205 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659217 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.659226 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659474 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659492 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659501 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.659504 1548416 addons.go:470] Verifying addon metrics-server=true in "embed-certs-722906"
I0214 04:25:49.662582 1548416 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:25:49.664096 1548416 addons.go:505] duration metric: took 2.82289258s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:25:48.687996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:51.185303 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:50.303857 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:50.303890 1548416 pod_ready.go:81] duration metric: took 3.008544941s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:50.303906 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312602 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.312630 1548416 pod_ready.go:81] duration metric: took 1.008715179s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312643 1548416 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318888 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.318913 1548416 pod_ready.go:81] duration metric: took 6.260888ms for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318925 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326339 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.326358 1548416 pod_ready.go:81] duration metric: took 7.425473ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326366 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336131 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.336157 1548416 pod_ready.go:81] duration metric: took 9.784766ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336170 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344427 1548416 pod_ready.go:92] pod "kube-proxy-tzpr9" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.344452 1548416 pod_ready.go:81] duration metric: took 1.008276095s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344461 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703142 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.703165 1548416 pod_ready.go:81] duration metric: took 358.6975ms for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703173 1548416 pod_ready.go:38] duration metric: took 5.454247611s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:52.703187 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:52.703240 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:52.721042 1548416 api_server.go:72] duration metric: took 5.879877619s to wait for apiserver process to appear ...
I0214 04:25:52.721069 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:52.721091 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:25:52.727234 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:25:52.728584 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:25:52.728607 1548416 api_server.go:131] duration metric: took 7.530707ms to wait for apiserver health ...
I0214 04:25:52.728617 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:52.905660 1548416 system_pods.go:59] 9 kube-system pods found
I0214 04:25:52.905694 1548416 system_pods.go:61] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:52.905702 1548416 system_pods.go:61] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:52.905709 1548416 system_pods.go:61] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:52.905714 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:52.905719 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:52.905724 1548416 system_pods.go:61] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:52.905731 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:52.905740 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:52.905753 1548416 system_pods.go:61] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:52.905764 1548416 system_pods.go:74] duration metric: took 177.140213ms to wait for pod list to return data ...
I0214 04:25:52.905777 1548416 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:53.100558 1548416 default_sa.go:45] found service account: "default"
I0214 04:25:53.100586 1548416 default_sa.go:55] duration metric: took 194.801355ms for default service account to be created ...
I0214 04:25:53.100596 1548416 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:53.304778 1548416 system_pods.go:86] 9 kube-system pods found
I0214 04:25:53.304808 1548416 system_pods.go:89] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:53.304814 1548416 system_pods.go:89] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:53.304818 1548416 system_pods.go:89] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:53.304822 1548416 system_pods.go:89] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:53.304826 1548416 system_pods.go:89] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:53.304830 1548416 system_pods.go:89] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:53.304836 1548416 system_pods.go:89] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:53.304843 1548416 system_pods.go:89] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:53.304848 1548416 system_pods.go:89] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:53.304857 1548416 system_pods.go:126] duration metric: took 204.2556ms to wait for k8s-apps to be running ...
I0214 04:25:53.304863 1548416 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:53.304908 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:53.321806 1548416 system_svc.go:56] duration metric: took 16.912625ms WaitForService to wait for kubelet
I0214 04:25:53.321844 1548416 kubeadm.go:576] duration metric: took 6.480687176s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:53.321873 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:53.501541 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:53.501571 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:53.501582 1548416 node_conditions.go:105] duration metric: took 179.703171ms to run NodePressure ...
I0214 04:25:53.501593 1548416 start.go:240] waiting for startup goroutines ...
I0214 04:25:53.501600 1548416 start.go:245] waiting for cluster config update ...
I0214 04:25:53.501610 1548416 start.go:254] writing updated cluster config ...
I0214 04:25:53.501868 1548416 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:53.554017 1548416 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:53.556089 1548416 out.go:177] * Done! kubectl is now configured to use "embed-certs-722906" cluster and "default" namespace by default
I0214 04:25:51.488936 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.988506 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.686041 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:55.677854 1548199 pod_ready.go:81] duration metric: took 4m0.000776482s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
E0214 04:25:55.677886 1548199 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:55.677908 1548199 pod_ready.go:38] duration metric: took 4m39.417217273s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:55.677936 1548199 kubeadm.go:591] duration metric: took 5m19.120995318s to restartPrimaryControlPlane
W0214 04:25:55.678003 1548199 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:55.678033 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:55.989446 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:58.490001 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:00.989098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:03.488351 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:05.491080 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:07.990103 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:09.129870 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (13.451791169s)
I0214 04:26:09.129957 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:09.143478 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:09.153419 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:09.162505 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:09.162527 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:26:09.162576 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:09.171259 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:09.171322 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:09.179961 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:09.188272 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:09.188334 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:09.197398 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:09.206885 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:09.206953 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:09.215702 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:09.224447 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:09.224504 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:09.233076 1548199 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:26:09.449400 1548199 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:10.489135 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:12.490085 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:14.989284 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:16.989501 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:19.489121 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:20.589989 1548199 kubeadm.go:309] [init] Using Kubernetes version: v1.29.0-rc.2
I0214 04:26:20.590079 1548199 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:20.590160 1548199 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:20.590282 1548199 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:20.590404 1548199 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:20.590459 1548199 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:20.592006 1548199 out.go:204] - Generating certificates and keys ...
I0214 04:26:20.592122 1548199 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:20.592229 1548199 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:20.592338 1548199 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:20.592403 1548199 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:20.592503 1548199 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:20.592599 1548199 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:20.592693 1548199 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:20.592787 1548199 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:20.592902 1548199 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:20.592997 1548199 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:20.593045 1548199 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:20.593123 1548199 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:20.593198 1548199 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:20.593294 1548199 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0214 04:26:20.593365 1548199 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:20.593442 1548199 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:20.593534 1548199 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:20.593660 1548199 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:20.593761 1548199 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:20.595405 1548199 out.go:204] - Booting up control plane ...
I0214 04:26:20.595518 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:20.595632 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:20.595748 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:20.595890 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:20.596009 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:20.596086 1548199 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:26:20.596252 1548199 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:20.596349 1548199 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.003185 seconds
I0214 04:26:20.596497 1548199 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:20.596673 1548199 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:20.596762 1548199 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:20.597019 1548199 kubeadm.go:309] [mark-control-plane] Marking the node no-preload-527067 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:26:20.597103 1548199 kubeadm.go:309] [bootstrap-token] Using token: yl18az.ikdg7kzcuqfvy8ic
I0214 04:26:20.598756 1548199 out.go:204] - Configuring RBAC rules ...
I0214 04:26:20.598884 1548199 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:20.598995 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:26:20.599173 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:20.599325 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:20.599486 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:20.599606 1548199 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:20.599753 1548199 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:26:20.599838 1548199 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:20.599907 1548199 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:20.599918 1548199 kubeadm.go:309]
I0214 04:26:20.599999 1548199 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:20.600014 1548199 kubeadm.go:309]
I0214 04:26:20.600130 1548199 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:20.600144 1548199 kubeadm.go:309]
I0214 04:26:20.600185 1548199 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:20.600262 1548199 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:20.600334 1548199 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:20.600344 1548199 kubeadm.go:309]
I0214 04:26:20.600414 1548199 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:26:20.600423 1548199 kubeadm.go:309]
I0214 04:26:20.600486 1548199 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:26:20.600494 1548199 kubeadm.go:309]
I0214 04:26:20.600559 1548199 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:20.600678 1548199 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:20.600743 1548199 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:20.600749 1548199 kubeadm.go:309]
I0214 04:26:20.600828 1548199 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:20.600931 1548199 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:20.600952 1548199 kubeadm.go:309]
I0214 04:26:20.601036 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601125 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:20.601144 1548199 kubeadm.go:309] --control-plane
I0214 04:26:20.601149 1548199 kubeadm.go:309]
I0214 04:26:20.601216 1548199 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:20.601222 1548199 kubeadm.go:309]
I0214 04:26:20.601302 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601453 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:20.601475 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:26:20.601488 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:20.603974 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:20.605318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:20.625217 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:20.665755 1548199 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:20.665828 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:20.665845 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes no-preload-527067 minikube.k8s.io/updated_at=2024_02_14T04_26_20_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=no-preload-527067 minikube.k8s.io/primary=true
I0214 04:26:20.978111 1548199 ops.go:34] apiserver oom_adj: -16
I0214 04:26:20.978350 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.478785 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.490359 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:23.988822 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:21.979082 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.478676 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.978647 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.479016 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.979139 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.478469 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.979026 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.478991 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.979248 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:26.478422 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.989074 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:28.488567 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:26.978971 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.478678 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.978661 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.479360 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.978439 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.479419 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.978677 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.478657 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.979294 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:31.478514 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.489293 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.490551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.982429 1548015 pod_ready.go:81] duration metric: took 4m0.000999321s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
E0214 04:26:32.982455 1548015 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:26:32.982485 1548015 pod_ready.go:38] duration metric: took 4m1.20075372s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:32.982524 1548015 kubeadm.go:591] duration metric: took 5m2.799685673s to restartPrimaryControlPlane
W0214 04:26:32.982589 1548015 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:26:32.982617 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:26:31.979099 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.478987 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.979077 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.479009 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.979314 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.478489 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.612101 1548199 kubeadm.go:1106] duration metric: took 13.946337661s to wait for elevateKubeSystemPrivileges
W0214 04:26:34.612159 1548199 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:26:34.612171 1548199 kubeadm.go:393] duration metric: took 5m58.102428414s to StartCluster
I0214 04:26:34.612196 1548199 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.612300 1548199 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:26:34.615005 1548199 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.615369 1548199 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:26:34.617155 1548199 out.go:177] * Verifying Kubernetes components...
I0214 04:26:34.615466 1548199 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:26:34.615560 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:26:34.618768 1548199 addons.go:69] Setting storage-provisioner=true in profile "no-preload-527067"
I0214 04:26:34.618791 1548199 addons.go:69] Setting metrics-server=true in profile "no-preload-527067"
I0214 04:26:34.618813 1548199 addons.go:234] Setting addon storage-provisioner=true in "no-preload-527067"
I0214 04:26:34.618820 1548199 addons.go:234] Setting addon metrics-server=true in "no-preload-527067"
W0214 04:26:34.618825 1548199 addons.go:243] addon storage-provisioner should already be in state true
W0214 04:26:34.618829 1548199 addons.go:243] addon metrics-server should already be in state true
I0214 04:26:34.618772 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:26:34.618884 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618886 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618775 1548199 addons.go:69] Setting default-storageclass=true in profile "no-preload-527067"
I0214 04:26:34.618993 1548199 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-527067"
I0214 04:26:34.619298 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619308 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619333 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619337 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619341 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619372 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.640257 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32983
I0214 04:26:34.640580 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36149
I0214 04:26:34.640597 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39493
I0214 04:26:34.640873 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.640987 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641373 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641523 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641545 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.641583 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641611 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642323 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642329 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642423 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.642449 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642627 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.642851 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.643118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643159 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.643410 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643444 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.646798 1548199 addons.go:234] Setting addon default-storageclass=true in "no-preload-527067"
W0214 04:26:34.646822 1548199 addons.go:243] addon default-storageclass should already be in state true
I0214 04:26:34.646854 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.647219 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.647255 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.661218 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42977
I0214 04:26:34.661948 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.662433 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.662460 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.662620 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33585
I0214 04:26:34.662742 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43125
I0214 04:26:34.662815 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.662980 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.663003 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663243 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663722 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663743 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.663678 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663990 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.664043 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664472 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664637 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.664688 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.664751 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.665180 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.667379 1548199 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:26:34.668945 1548199 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:34.668969 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:26:34.668989 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.666787 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.670977 1548199 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:26:34.672956 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:26:34.672975 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:26:34.672994 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.673016 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.672384 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673068 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.673095 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673204 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.673357 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.673524 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.676340 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.676867 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.676922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.677027 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.677226 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.677799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.677995 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.688291 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46577
I0214 04:26:34.688787 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.689408 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.689428 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.689974 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.690207 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.691884 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.692131 1548199 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:34.692145 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:26:34.692161 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.695649 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696104 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.696127 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696274 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.696463 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.696600 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.696724 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.961474 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:26:34.991187 1548199 node_ready.go:35] waiting up to 6m0s for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001485 1548199 node_ready.go:49] node "no-preload-527067" has status "Ready":"True"
I0214 04:26:35.001505 1548199 node_ready.go:38] duration metric: took 10.286336ms for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001515 1548199 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:35.008527 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:35.194026 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:26:35.194058 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:26:35.195705 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:35.220973 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:35.241307 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:26:35.241374 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:26:35.312068 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:35.312103 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:26:35.375420 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169901 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170341 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170364 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170376 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170386 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170395 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170472 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170493 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170504 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170514 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170906 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170927 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170931 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170961 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170970 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.240387 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.240440 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.240813 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.240831 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365401 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365431 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.365774 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.365798 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365808 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.365814 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365836 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.366107 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.366128 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.366141 1548199 addons.go:470] Verifying addon metrics-server=true in "no-preload-527067"
I0214 04:26:36.367846 1548199 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:26:36.369323 1548199 addons.go:505] duration metric: took 1.753864307s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:26:37.042437 1548199 pod_ready.go:102] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:38.019213 1548199 pod_ready.go:92] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.019249 1548199 pod_ready.go:81] duration metric: took 3.010693835s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.019263 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027650 1548199 pod_ready.go:92] pod "coredns-76f75df574-m2q5f" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.027677 1548199 pod_ready.go:81] duration metric: took 8.406148ms for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027690 1548199 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.033993 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.034019 1548199 pod_ready.go:81] duration metric: took 6.321413ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.034028 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042724 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.042759 1548199 pod_ready.go:81] duration metric: took 8.716807ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042772 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050793 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.050819 1548199 pod_ready.go:81] duration metric: took 8.039526ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050828 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213505 1548199 pod_ready.go:92] pod "kube-proxy-66w6n" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.213536 1548199 pod_ready.go:81] duration metric: took 1.162700616s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213550 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613918 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.613945 1548199 pod_ready.go:81] duration metric: took 400.387683ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613953 1548199 pod_ready.go:38] duration metric: took 4.6124289s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:39.613972 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:26:39.614036 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:26:39.630218 1548199 api_server.go:72] duration metric: took 5.014782329s to wait for apiserver process to appear ...
I0214 04:26:39.630255 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:26:39.630286 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:26:39.637180 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:26:39.638716 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:26:39.638768 1548199 api_server.go:131] duration metric: took 8.502857ms to wait for apiserver health ...
I0214 04:26:39.638776 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:26:39.824405 1548199 system_pods.go:59] 9 kube-system pods found
I0214 04:26:39.824444 1548199 system_pods.go:61] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:39.824452 1548199 system_pods.go:61] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:39.824459 1548199 system_pods.go:61] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:39.824466 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:39.824473 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:39.824480 1548199 system_pods.go:61] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:39.824486 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:39.824497 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:39.824506 1548199 system_pods.go:61] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:39.824520 1548199 system_pods.go:74] duration metric: took 185.738017ms to wait for pod list to return data ...
I0214 04:26:39.824530 1548199 default_sa.go:34] waiting for default service account to be created ...
I0214 04:26:40.013391 1548199 default_sa.go:45] found service account: "default"
I0214 04:26:40.013415 1548199 default_sa.go:55] duration metric: took 188.875578ms for default service account to be created ...
I0214 04:26:40.013424 1548199 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:26:40.217587 1548199 system_pods.go:86] 9 kube-system pods found
I0214 04:26:40.217616 1548199 system_pods.go:89] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:40.217622 1548199 system_pods.go:89] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:40.217626 1548199 system_pods.go:89] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:40.217630 1548199 system_pods.go:89] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:40.217635 1548199 system_pods.go:89] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:40.217639 1548199 system_pods.go:89] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:40.217644 1548199 system_pods.go:89] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:40.217651 1548199 system_pods.go:89] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:40.217656 1548199 system_pods.go:89] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:40.217665 1548199 system_pods.go:126] duration metric: took 204.236287ms to wait for k8s-apps to be running ...
I0214 04:26:40.217672 1548199 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:26:40.217718 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:40.234093 1548199 system_svc.go:56] duration metric: took 16.409726ms WaitForService to wait for kubelet
I0214 04:26:40.234124 1548199 kubeadm.go:576] duration metric: took 5.61871569s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:26:40.234149 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:26:40.414050 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:26:40.414083 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:26:40.414095 1548199 node_conditions.go:105] duration metric: took 179.940381ms to run NodePressure ...
I0214 04:26:40.414107 1548199 start.go:240] waiting for startup goroutines ...
I0214 04:26:40.414113 1548199 start.go:245] waiting for cluster config update ...
I0214 04:26:40.414123 1548199 start.go:254] writing updated cluster config ...
I0214 04:26:40.414399 1548199 ssh_runner.go:195] Run: rm -f paused
I0214 04:26:40.471952 1548199 start.go:599] kubectl: 1.29.1, cluster: 1.29.0-rc.2 (minor skew: 0)
I0214 04:26:40.474067 1548199 out.go:177] * Done! kubectl is now configured to use "no-preload-527067" cluster and "default" namespace by default
I0214 04:26:39.897152 1548015 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (6.91450391s)
I0214 04:26:39.897269 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:39.912739 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:39.923449 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:39.939932 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:39.939961 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:26:39.940018 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:39.953815 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:39.953883 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:39.962552 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:39.971167 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:39.971216 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:39.979864 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:39.988192 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:39.988315 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:39.997134 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:40.005722 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:40.005762 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:40.015266 1548015 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0214 04:26:40.076413 1548015 kubeadm.go:309] [init] Using Kubernetes version: v1.16.0
I0214 04:26:40.076723 1548015 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:40.230449 1548015 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:40.230618 1548015 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:40.230731 1548015 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:40.478573 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:40.479934 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:40.489997 1548015 kubeadm.go:309] [kubelet-start] Activating the kubelet service
I0214 04:26:40.644188 1548015 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:40.646342 1548015 out.go:204] - Generating certificates and keys ...
I0214 04:26:40.646467 1548015 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:40.646561 1548015 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:40.646688 1548015 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:40.646835 1548015 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:40.646956 1548015 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:40.647034 1548015 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:40.647235 1548015 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:40.647843 1548015 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:40.648304 1548015 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:40.649043 1548015 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:40.649108 1548015 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:40.649182 1548015 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:40.935104 1548015 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:41.023680 1548015 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:41.246180 1548015 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:41.346131 1548015 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:41.346986 1548015 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:41.349022 1548015 out.go:204] - Booting up control plane ...
I0214 04:26:41.349146 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:41.352956 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:41.355013 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:41.356192 1548015 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:41.359118 1548015 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:52.863670 1548015 kubeadm.go:309] [apiclient] All control plane components are healthy after 11.504059 seconds
I0214 04:26:52.863792 1548015 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:52.880996 1548015 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config-1.16" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:53.404015 1548015 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:53.404215 1548015 kubeadm.go:309] [mark-control-plane] Marking the node old-k8s-version-960884 as control-plane by adding the label "node-role.kubernetes.io/master=''"
I0214 04:26:53.916361 1548015 kubeadm.go:309] [bootstrap-token] Using token: 0ncwgq.h72unli3702wifzv
I0214 04:26:53.917805 1548015 out.go:204] - Configuring RBAC rules ...
I0214 04:26:53.917949 1548015 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:53.927093 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:53.932015 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:53.935192 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:53.938316 1548015 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:54.012603 1548015 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:54.352255 1548015 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:54.354368 1548015 kubeadm.go:309]
I0214 04:26:54.354465 1548015 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:54.354478 1548015 kubeadm.go:309]
I0214 04:26:54.354557 1548015 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:54.354569 1548015 kubeadm.go:309]
I0214 04:26:54.354605 1548015 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:54.354686 1548015 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:54.354760 1548015 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:54.354775 1548015 kubeadm.go:309]
I0214 04:26:54.354824 1548015 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:54.354894 1548015 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:54.354972 1548015 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:54.354983 1548015 kubeadm.go:309]
I0214 04:26:54.355115 1548015 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:54.355264 1548015 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:54.355276 1548015 kubeadm.go:309]
I0214 04:26:54.355393 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355557 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:54.355606 1548015 kubeadm.go:309] --control-plane
I0214 04:26:54.355613 1548015 kubeadm.go:309]
I0214 04:26:54.355679 1548015 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:54.355686 1548015 kubeadm.go:309]
I0214 04:26:54.355780 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355925 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:54.356354 1548015 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:54.356485 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:26:54.356504 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:54.358086 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:54.359624 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:54.371756 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:54.389927 1548015 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:54.390013 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes old-k8s-version-960884 minikube.k8s.io/updated_at=2024_02_14T04_26_54_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=old-k8s-version-960884 minikube.k8s.io/primary=true
I0214 04:26:54.390016 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:54.431990 1548015 ops.go:34] apiserver oom_adj: -16
I0214 04:26:54.626609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.126943 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.627715 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.127333 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.626894 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.126758 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.626794 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.127609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.627033 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.126732 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.627253 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.127445 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.627305 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.126733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.627428 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.127101 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.627112 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.127318 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.627564 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.127249 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.627430 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.127707 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.627355 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.127647 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.626733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.126735 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.627135 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.127098 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.626845 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.127164 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.627189 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.127584 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.232804 1548015 kubeadm.go:1106] duration metric: took 15.842870427s to wait for elevateKubeSystemPrivileges
W0214 04:27:10.232858 1548015 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:27:10.232867 1548015 kubeadm.go:393] duration metric: took 5m40.102162281s to StartCluster
I0214 04:27:10.232888 1548015 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.233054 1548015 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:27:10.235716 1548015 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.236044 1548015 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:27:10.237600 1548015 out.go:177] * Verifying Kubernetes components...
I0214 04:27:10.236151 1548015 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:27:10.238873 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:27:10.236262 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:27:10.237637 1548015 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-960884"
I0214 04:27:10.238984 1548015 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-960884"
W0214 04:27:10.238997 1548015 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:27:10.237648 1548015 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-960884"
I0214 04:27:10.239056 1548015 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:10.237659 1548015 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-960884"
I0214 04:27:10.239095 1548015 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-960884"
I0214 04:27:10.239028 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
W0214 04:27:10.239066 1548015 addons.go:243] addon metrics-server should already be in state true
I0214 04:27:10.239210 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.239508 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239514 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239536 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239578 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.259948 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37397
I0214 04:27:10.260188 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33423
I0214 04:27:10.260189 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41519
I0214 04:27:10.260483 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260579 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260588 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.261044 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261057 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261069 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261073 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261137 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261152 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261462 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261531 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261578 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261964 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.262091 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262123 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.262177 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262206 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.265041 1548015 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-960884"
W0214 04:27:10.265057 1548015 addons.go:243] addon default-storageclass should already be in state true
I0214 04:27:10.265079 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.265355 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.265388 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.281666 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35115
I0214 04:27:10.282244 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.282939 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.282959 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.283421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.283696 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.285726 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.287965 1548015 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:27:10.287003 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37937
I0214 04:27:10.289469 1548015 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.289494 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:27:10.289513 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.290515 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.291054 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.291066 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.291421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.291810 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.291838 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.295055 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.295588 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295834 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.296046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.296225 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.296429 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.299942 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37359
I0214 04:27:10.300312 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.300732 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.300749 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.301045 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.301234 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.303089 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.304834 1548015 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:27:10.306097 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:27:10.306115 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:27:10.306132 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.308576 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37931
I0214 04:27:10.308935 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.309498 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.309517 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.309629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.309890 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.310082 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.310137 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.310163 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.310357 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.310556 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.310953 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.311088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.311700 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.311908 1548015 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.311922 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:27:10.311935 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.315147 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315579 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.315639 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315862 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.316084 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.316268 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.316454 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.457777 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:27:10.480620 1548015 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.491995 1548015 node_ready.go:49] node "old-k8s-version-960884" has status "Ready":"True"
I0214 04:27:10.492022 1548015 node_ready.go:38] duration metric: took 11.363355ms for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.492035 1548015 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:10.497386 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:10.561045 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.584516 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.593942 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:27:10.593967 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:27:10.621414 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:27:10.621438 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:27:10.694662 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:10.694688 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:27:10.747668 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:11.306565 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306591 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306723 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306756 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306919 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.306969 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.306988 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.306996 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307152 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307075 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307244 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307255 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307265 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307062 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.307496 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307512 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307685 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307698 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.394434 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.394467 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.394790 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.394815 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523086 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523107 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523443 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.523505 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523519 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523534 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523546 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523818 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523839 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523853 1548015 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:11.525563 1548015 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:27:11.526853 1548015 addons.go:505] duration metric: took 1.290704397s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:27:12.555185 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:15.004085 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:17.005427 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:19.506364 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:20.521073 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.521097 1548015 pod_ready.go:81] duration metric: took 10.02368927s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.521114 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530815 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.530849 1548015 pod_ready.go:81] duration metric: took 9.726579ms for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530866 1548015 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.539987 1548015 pod_ready.go:92] pod "kube-proxy-4jhcb" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.540019 1548015 pod_ready.go:81] duration metric: took 9.143682ms for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.540033 1548015 pod_ready.go:38] duration metric: took 10.047982488s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:20.540055 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:27:20.540113 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:27:20.564418 1548015 api_server.go:72] duration metric: took 10.328326886s to wait for apiserver process to appear ...
I0214 04:27:20.564452 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:27:20.564478 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:27:20.573942 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:27:20.575255 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:27:20.575287 1548015 api_server.go:131] duration metric: took 10.826827ms to wait for apiserver health ...
I0214 04:27:20.575298 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:27:20.581952 1548015 system_pods.go:59] 5 kube-system pods found
I0214 04:27:20.581982 1548015 system_pods.go:61] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.581989 1548015 system_pods.go:61] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.581996 1548015 system_pods.go:61] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.582006 1548015 system_pods.go:61] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.582014 1548015 system_pods.go:61] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.582025 1548015 system_pods.go:74] duration metric: took 6.718437ms to wait for pod list to return data ...
I0214 04:27:20.582034 1548015 default_sa.go:34] waiting for default service account to be created ...
I0214 04:27:20.584695 1548015 default_sa.go:45] found service account: "default"
I0214 04:27:20.584724 1548015 default_sa.go:55] duration metric: took 2.678001ms for default service account to be created ...
I0214 04:27:20.584735 1548015 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:27:20.589847 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.589876 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.589886 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.589896 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.589912 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.589924 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.589950 1548015 retry.go:31] will retry after 248.508062ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:20.844936 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.844971 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.844977 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.844981 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.844988 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.844993 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.845010 1548015 retry.go:31] will retry after 367.089613ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.218037 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.218074 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.218082 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.218089 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.218099 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.218105 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.218126 1548015 retry.go:31] will retry after 419.193903ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.642404 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.642441 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.642447 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.642452 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.642459 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.642465 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.642483 1548015 retry.go:31] will retry after 451.345597ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.099422 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.099453 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.099459 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.099466 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.099474 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.099480 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.099499 1548015 retry.go:31] will retry after 651.082119ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.756099 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.756128 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.756134 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.756148 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.756159 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.756169 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.756189 1548015 retry.go:31] will retry after 586.140581ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:23.348131 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:23.348163 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:23.348168 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:23.348172 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:23.348178 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:23.348183 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:23.348202 1548015 retry.go:31] will retry after 870.913743ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:24.224631 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:24.224665 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:24.224674 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:24.224680 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:24.224690 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:24.224697 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:24.224719 1548015 retry.go:31] will retry after 1.13554102s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:25.365563 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:25.365593 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:25.365598 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:25.365603 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:25.365609 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:25.365614 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:25.365633 1548015 retry.go:31] will retry after 1.737635615s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:27.109613 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:27.109642 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:27.109647 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:27.109651 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:27.109657 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:27.109664 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:27.109684 1548015 retry.go:31] will retry after 1.744560644s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:28.860288 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:28.860319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:28.860327 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:28.860333 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:28.860343 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:28.860350 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:28.860372 1548015 retry.go:31] will retry after 2.781231308s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:31.647467 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:31.647509 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:31.647518 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:31.647525 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:31.647536 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:31.647543 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:31.647566 1548015 retry.go:31] will retry after 3.406936773s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:35.060683 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:35.060716 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:35.060721 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:35.060725 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:35.060735 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:35.060742 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:35.060765 1548015 retry.go:31] will retry after 3.181009478s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:38.247591 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:38.247626 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:38.247634 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:38.247639 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:38.247648 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:38.247655 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:38.247679 1548015 retry.go:31] will retry after 4.973684574s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:43.227832 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:43.227888 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:43.227896 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:43.227902 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:43.227914 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:43.227921 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:43.227947 1548015 retry.go:31] will retry after 6.269902816s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:49.502449 1548015 system_pods.go:86] 6 kube-system pods found
I0214 04:27:49.502483 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:49.502491 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:49.502497 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:49.502503 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Pending
I0214 04:27:49.502511 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:49.502518 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:49.502541 1548015 retry.go:31] will retry after 7.09681765s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:56.607786 1548015 system_pods.go:86] 7 kube-system pods found
I0214 04:27:56.607823 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:56.607833 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:56.607843 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:27:56.607850 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:56.607863 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:27:56.607878 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:56.607894 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:56.607917 1548015 retry.go:31] will retry after 9.404244714s: missing components: etcd, kube-apiserver
I0214 04:28:06.017960 1548015 system_pods.go:86] 8 kube-system pods found
I0214 04:28:06.017990 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:06.017995 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:06.017999 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Pending
I0214 04:28:06.018004 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:06.018008 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:06.018012 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:06.018018 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:06.018025 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:06.018044 1548015 retry.go:31] will retry after 13.524747575s: missing components: etcd, kube-apiserver
I0214 04:28:19.549284 1548015 system_pods.go:86] 9 kube-system pods found
I0214 04:28:19.549319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:19.549331 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:19.549337 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Running
I0214 04:28:19.549351 1548015 system_pods.go:89] "kube-apiserver-old-k8s-version-960884" [a70eef81-e29d-4b42-9bba-e396214086b6] Running
I0214 04:28:19.549357 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:19.549364 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:19.549371 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:19.549383 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:19.549394 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:19.549413 1548015 system_pods.go:126] duration metric: took 58.964669894s to wait for k8s-apps to be running ...
I0214 04:28:19.549427 1548015 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:28:19.549488 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:28:19.575300 1548015 system_svc.go:56] duration metric: took 25.86022ms WaitForService to wait for kubelet
I0214 04:28:19.575336 1548015 kubeadm.go:576] duration metric: took 1m9.339251431s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:28:19.575379 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:28:19.579124 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:28:19.579155 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:28:19.579195 1548015 node_conditions.go:105] duration metric: took 3.807562ms to run NodePressure ...
I0214 04:28:19.579211 1548015 start.go:240] waiting for startup goroutines ...
I0214 04:28:19.579226 1548015 start.go:245] waiting for cluster config update ...
I0214 04:28:19.579242 1548015 start.go:254] writing updated cluster config ...
I0214 04:28:19.579574 1548015 ssh_runner.go:195] Run: rm -f paused
I0214 04:28:19.634648 1548015 start.go:599] kubectl: 1.29.1, cluster: 1.16.0 (minor skew: 13)
I0214 04:28:19.636438 1548015 out.go:177]
W0214 04:28:19.637884 1548015 out.go:239] ! /usr/local/bin/kubectl is version 1.29.1, which may have incompatibilities with Kubernetes 1.16.0.
I0214 04:28:19.639178 1548015 out.go:177] - Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'
I0214 04:28:19.640482 1548015 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-960884" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:20:30 UTC, ends at Wed 2024-02-14 04:34:55 UTC. --
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.260599445Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885295260588565,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=a3090dc2-6218-4a49-96db-eef5333de59d name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.261573739Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=4252f56a-8e35-4b76-bf81-0b5d8186df37 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.261637004Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=4252f56a-8e35-4b76-bf81-0b5d8186df37 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.261935662Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2,PodSandboxId:399ed54004aeead89c09a00b22eb8866e6c441a46a6f60954af60ec8bb8867fe,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884750938784831,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 91a5aa8f-0a2e-4bf3-995f-24013154be0f,},Annotations:map[string]string{io.kubernetes.container.hash: 842ab4e7,io.kubernetes.container.restartCount: 0,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4,PodSandboxId:a655ac5930f6682eb53130dfa58c97527ee9089cdce2842f9863bf5dd5302f42,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884750795178420,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tzpr9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4251f9f9-12fc-4189-8bb2-2570aa4b4109,},Annotations:map[string]string{io.kubernetes.container.hash: 67c1ccd6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessag
ePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0,PodSandboxId:18a890b28165e78fe539998cd7819b7b395fcb67fbb14964ace2aac61c089416,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749980537510,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-kh9dr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 426598eb-a63c-4572-ac6a-d912bfee04d1,},Annotations:map[string]string{io.kubernetes.container.hash: 83c3a98e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-
tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff,PodSandboxId:3e893b5990020e41c1dc7201e2626e85325c3a6ee48d0c0a13b6a2b466c953e2,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749406792627,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-62wp6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6b69aa94-f092-4150-
81a8-7e8cdfdfd8e0,},Annotations:map[string]string{io.kubernetes.container.hash: 2db85508,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5,PodSandboxId:01ce811744dcd0debf64c88ff0f1786213fcea7e63594eec9bc0973512b608f0,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:17078847271
66411811,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c0407601f78837f837672474ea583b9f,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae,PodSandboxId:96fca915be3ebc647ac55f4fdcdc0a5532e343d0a64675c8070e60ac902be239,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884727031523466,Labels:map[string]str
ing{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: be6b5fbcbe63546b7efc20f181b9b68f,},Annotations:map[string]string{io.kubernetes.container.hash: bc67f715,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7,PodSandboxId:ee92d020059d5af8af986d66d3232cd3a8348ff68054155f9e16dea31ac55a38,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884726803884664,Labels:map[string]string{io.kuber
netes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224b77a740d55a2900d2e7dffbb562cf,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e,PodSandboxId:a610329aa84eb6a2ea9c178149b22c3b6a3d674416dcfa7be09831325eb2049f,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884726696981254,Labels:map[string]string{
io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a8d2c0cdb4658917c261ee1a915a360,},Annotations:map[string]string{io.kubernetes.container.hash: d7a8df02,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=4252f56a-8e35-4b76-bf81-0b5d8186df37 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.302248873Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=350e3c8a-7ab0-4f89-8aad-ee388a8133bd name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.302346837Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=350e3c8a-7ab0-4f89-8aad-ee388a8133bd name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.303849027Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=91626c5a-86f1-4af8-992d-4579eeb3b2e9 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.304364310Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885295304349399,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=91626c5a-86f1-4af8-992d-4579eeb3b2e9 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.305078508Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=6ca270b3-3358-496d-b965-cf7b6f7442f2 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.305143018Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=6ca270b3-3358-496d-b965-cf7b6f7442f2 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.305420196Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2,PodSandboxId:399ed54004aeead89c09a00b22eb8866e6c441a46a6f60954af60ec8bb8867fe,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884750938784831,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 91a5aa8f-0a2e-4bf3-995f-24013154be0f,},Annotations:map[string]string{io.kubernetes.container.hash: 842ab4e7,io.kubernetes.container.restartCount: 0,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4,PodSandboxId:a655ac5930f6682eb53130dfa58c97527ee9089cdce2842f9863bf5dd5302f42,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884750795178420,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tzpr9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4251f9f9-12fc-4189-8bb2-2570aa4b4109,},Annotations:map[string]string{io.kubernetes.container.hash: 67c1ccd6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessag
ePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0,PodSandboxId:18a890b28165e78fe539998cd7819b7b395fcb67fbb14964ace2aac61c089416,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749980537510,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-kh9dr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 426598eb-a63c-4572-ac6a-d912bfee04d1,},Annotations:map[string]string{io.kubernetes.container.hash: 83c3a98e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-
tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff,PodSandboxId:3e893b5990020e41c1dc7201e2626e85325c3a6ee48d0c0a13b6a2b466c953e2,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749406792627,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-62wp6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6b69aa94-f092-4150-
81a8-7e8cdfdfd8e0,},Annotations:map[string]string{io.kubernetes.container.hash: 2db85508,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5,PodSandboxId:01ce811744dcd0debf64c88ff0f1786213fcea7e63594eec9bc0973512b608f0,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:17078847271
66411811,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c0407601f78837f837672474ea583b9f,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae,PodSandboxId:96fca915be3ebc647ac55f4fdcdc0a5532e343d0a64675c8070e60ac902be239,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884727031523466,Labels:map[string]str
ing{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: be6b5fbcbe63546b7efc20f181b9b68f,},Annotations:map[string]string{io.kubernetes.container.hash: bc67f715,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7,PodSandboxId:ee92d020059d5af8af986d66d3232cd3a8348ff68054155f9e16dea31ac55a38,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884726803884664,Labels:map[string]string{io.kuber
netes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224b77a740d55a2900d2e7dffbb562cf,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e,PodSandboxId:a610329aa84eb6a2ea9c178149b22c3b6a3d674416dcfa7be09831325eb2049f,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884726696981254,Labels:map[string]string{
io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a8d2c0cdb4658917c261ee1a915a360,},Annotations:map[string]string{io.kubernetes.container.hash: d7a8df02,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=6ca270b3-3358-496d-b965-cf7b6f7442f2 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.348893652Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=680276a2-65f4-4df2-8cb4-d6230b0129a2 name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.349013544Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=680276a2-65f4-4df2-8cb4-d6230b0129a2 name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.350882228Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=09130b11-6443-4ae5-9466-c5a47e2d86d8 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.351442661Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885295351423187,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=09130b11-6443-4ae5-9466-c5a47e2d86d8 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.352511773Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=6491a9bb-9261-4f36-b3bf-0163347ccc05 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.352572441Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=6491a9bb-9261-4f36-b3bf-0163347ccc05 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.352901542Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2,PodSandboxId:399ed54004aeead89c09a00b22eb8866e6c441a46a6f60954af60ec8bb8867fe,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884750938784831,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 91a5aa8f-0a2e-4bf3-995f-24013154be0f,},Annotations:map[string]string{io.kubernetes.container.hash: 842ab4e7,io.kubernetes.container.restartCount: 0,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4,PodSandboxId:a655ac5930f6682eb53130dfa58c97527ee9089cdce2842f9863bf5dd5302f42,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884750795178420,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tzpr9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4251f9f9-12fc-4189-8bb2-2570aa4b4109,},Annotations:map[string]string{io.kubernetes.container.hash: 67c1ccd6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessag
ePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0,PodSandboxId:18a890b28165e78fe539998cd7819b7b395fcb67fbb14964ace2aac61c089416,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749980537510,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-kh9dr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 426598eb-a63c-4572-ac6a-d912bfee04d1,},Annotations:map[string]string{io.kubernetes.container.hash: 83c3a98e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-
tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff,PodSandboxId:3e893b5990020e41c1dc7201e2626e85325c3a6ee48d0c0a13b6a2b466c953e2,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749406792627,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-62wp6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6b69aa94-f092-4150-
81a8-7e8cdfdfd8e0,},Annotations:map[string]string{io.kubernetes.container.hash: 2db85508,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5,PodSandboxId:01ce811744dcd0debf64c88ff0f1786213fcea7e63594eec9bc0973512b608f0,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:17078847271
66411811,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c0407601f78837f837672474ea583b9f,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae,PodSandboxId:96fca915be3ebc647ac55f4fdcdc0a5532e343d0a64675c8070e60ac902be239,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884727031523466,Labels:map[string]str
ing{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: be6b5fbcbe63546b7efc20f181b9b68f,},Annotations:map[string]string{io.kubernetes.container.hash: bc67f715,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7,PodSandboxId:ee92d020059d5af8af986d66d3232cd3a8348ff68054155f9e16dea31ac55a38,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884726803884664,Labels:map[string]string{io.kuber
netes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224b77a740d55a2900d2e7dffbb562cf,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e,PodSandboxId:a610329aa84eb6a2ea9c178149b22c3b6a3d674416dcfa7be09831325eb2049f,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884726696981254,Labels:map[string]string{
io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a8d2c0cdb4658917c261ee1a915a360,},Annotations:map[string]string{io.kubernetes.container.hash: d7a8df02,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=6491a9bb-9261-4f36-b3bf-0163347ccc05 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.396174677Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=46530ba1-c3d5-4829-b2e1-b9e31582dedc name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.396232813Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=46530ba1-c3d5-4829-b2e1-b9e31582dedc name=/runtime.v1.RuntimeService/Version
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.398975398Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=c010cf51-6643-45d0-9a4a-3967dabbd1d9 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.399352118Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885295399340561,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=c010cf51-6643-45d0-9a4a-3967dabbd1d9 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.400034408Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=20321db3-b74b-45d8-bd2b-0bd85272a11e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.400078282Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=20321db3-b74b-45d8-bd2b-0bd85272a11e name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:34:55 embed-certs-722906 crio[739]: time="2024-02-14 04:34:55.400925280Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2,PodSandboxId:399ed54004aeead89c09a00b22eb8866e6c441a46a6f60954af60ec8bb8867fe,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884750938784831,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 91a5aa8f-0a2e-4bf3-995f-24013154be0f,},Annotations:map[string]string{io.kubernetes.container.hash: 842ab4e7,io.kubernetes.container.restartCount: 0,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4,PodSandboxId:a655ac5930f6682eb53130dfa58c97527ee9089cdce2842f9863bf5dd5302f42,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884750795178420,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tzpr9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4251f9f9-12fc-4189-8bb2-2570aa4b4109,},Annotations:map[string]string{io.kubernetes.container.hash: 67c1ccd6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessag
ePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0,PodSandboxId:18a890b28165e78fe539998cd7819b7b395fcb67fbb14964ace2aac61c089416,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749980537510,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-kh9dr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 426598eb-a63c-4572-ac6a-d912bfee04d1,},Annotations:map[string]string{io.kubernetes.container.hash: 83c3a98e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-
tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff,PodSandboxId:3e893b5990020e41c1dc7201e2626e85325c3a6ee48d0c0a13b6a2b466c953e2,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749406792627,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-62wp6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6b69aa94-f092-4150-
81a8-7e8cdfdfd8e0,},Annotations:map[string]string{io.kubernetes.container.hash: 2db85508,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5,PodSandboxId:01ce811744dcd0debf64c88ff0f1786213fcea7e63594eec9bc0973512b608f0,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:17078847271
66411811,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c0407601f78837f837672474ea583b9f,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae,PodSandboxId:96fca915be3ebc647ac55f4fdcdc0a5532e343d0a64675c8070e60ac902be239,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884727031523466,Labels:map[string]str
ing{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: be6b5fbcbe63546b7efc20f181b9b68f,},Annotations:map[string]string{io.kubernetes.container.hash: bc67f715,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7,PodSandboxId:ee92d020059d5af8af986d66d3232cd3a8348ff68054155f9e16dea31ac55a38,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884726803884664,Labels:map[string]string{io.kuber
netes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224b77a740d55a2900d2e7dffbb562cf,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e,PodSandboxId:a610329aa84eb6a2ea9c178149b22c3b6a3d674416dcfa7be09831325eb2049f,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884726696981254,Labels:map[string]string{
io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a8d2c0cdb4658917c261ee1a915a360,},Annotations:map[string]string{io.kubernetes.container.hash: d7a8df02,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=20321db3-b74b-45d8-bd2b-0bd85272a11e name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
416652fe94935 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 9 minutes ago Running storage-provisioner 0 399ed54004aee storage-provisioner
dc38b5e773abf 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 9 minutes ago Running kube-proxy 0 a655ac5930f66 kube-proxy-tzpr9
3ab2cb83dc155 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 9 minutes ago Running coredns 0 18a890b28165e coredns-5dd5756b68-kh9dr
674c44e33c068 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 9 minutes ago Running coredns 0 3e893b5990020 coredns-5dd5756b68-62wp6
7b8bf11381bce e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 9 minutes ago Running kube-scheduler 2 01ce811744dcd kube-scheduler-embed-certs-722906
d928e364c3628 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 9 minutes ago Running etcd 2 96fca915be3eb etcd-embed-certs-722906
0bd903937bcd9 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 9 minutes ago Running kube-controller-manager 2 ee92d020059d5 kube-controller-manager-embed-certs-722906
97c20a995e70a 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 9 minutes ago Running kube-apiserver 2 a610329aa84eb kube-apiserver-embed-certs-722906
==> coredns [3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
==> coredns [674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
==> describe nodes <==
Name: embed-certs-722906
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=embed-certs-722906
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=embed-certs-722906
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_25_34_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:25:31 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: embed-certs-722906
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 04:34:46 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:31:00 +0000 Wed, 14 Feb 2024 04:25:28 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:31:00 +0000 Wed, 14 Feb 2024 04:25:28 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:31:00 +0000 Wed, 14 Feb 2024 04:25:28 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:31:00 +0000 Wed, 14 Feb 2024 04:25:45 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.50.108
Hostname: embed-certs-722906
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: e20bf1c60aca4355bf54cc2398d9da4e
System UUID: e20bf1c6-0aca-4355-bf54-cc2398d9da4e
Boot ID: db9fd014-c4c3-46e8-b0b1-a23303bb6538
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-5dd5756b68-62wp6 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 9m8s
kube-system coredns-5dd5756b68-kh9dr 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 9m8s
kube-system etcd-embed-certs-722906 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 9m20s
kube-system kube-apiserver-embed-certs-722906 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m22s
kube-system kube-controller-manager-embed-certs-722906 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m20s
kube-system kube-proxy-tzpr9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m9s
kube-system kube-scheduler-embed-certs-722906 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m20s
kube-system metrics-server-57f55c9bc5-hzsfq 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (9%!)(MISSING) 0 (0%!)(MISSING) 9m6s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m6s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 0 (0%!)(MISSING)
memory 440Mi (20%!)(MISSING) 340Mi (16%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 9m4s kube-proxy
Normal Starting 9m21s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 9m21s kubelet Node embed-certs-722906 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m21s kubelet Node embed-certs-722906 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m21s kubelet Node embed-certs-722906 status is now: NodeHasSufficientPID
Normal NodeNotReady 9m21s kubelet Node embed-certs-722906 status is now: NodeNotReady
Normal NodeAllocatableEnforced 9m20s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 9m10s kubelet Node embed-certs-722906 status is now: NodeReady
Normal RegisteredNode 9m9s node-controller Node embed-certs-722906 event: Registered Node embed-certs-722906 in Controller
==> dmesg <==
[Feb14 04:20] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.075493] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.508254] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.500410] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.144345] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.538811] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +6.035394] systemd-fstab-generator[665]: Ignoring "noauto" for root device
[ +0.129285] systemd-fstab-generator[676]: Ignoring "noauto" for root device
[ +0.179341] systemd-fstab-generator[689]: Ignoring "noauto" for root device
[ +0.110945] systemd-fstab-generator[700]: Ignoring "noauto" for root device
[ +0.269143] systemd-fstab-generator[724]: Ignoring "noauto" for root device
[ +6.091692] systemd-fstab-generator[824]: Ignoring "noauto" for root device
[ +2.443539] systemd-fstab-generator[946]: Ignoring "noauto" for root device
[Feb14 04:21] kauditd_printk_skb: 29 callbacks suppressed
[Feb14 04:25] systemd-fstab-generator[3575]: Ignoring "noauto" for root device
[ +9.291565] systemd-fstab-generator[3902]: Ignoring "noauto" for root device
[ +12.514974] systemd-fstab-generator[4107]: Ignoring "noauto" for root device
[ +0.577674] kauditd_printk_skb: 2 callbacks suppressed
==> etcd [d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae] <==
{"level":"info","ts":"2024-02-14T04:25:28.830292Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.50.108:2380"}
{"level":"info","ts":"2024-02-14T04:25:28.830914Z","caller":"etcdserver/server.go:738","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"d5ce96a8bfe0f5c1","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
{"level":"info","ts":"2024-02-14T04:25:28.831071Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T04:25:28.831426Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T04:25:28.831528Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2024-02-14T04:25:28.831389Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d5ce96a8bfe0f5c1 switched to configuration voters=(15406417026798908865)"}
{"level":"info","ts":"2024-02-14T04:25:28.831865Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"38e677d7bff02ecf","local-member-id":"d5ce96a8bfe0f5c1","added-peer-id":"d5ce96a8bfe0f5c1","added-peer-peer-urls":["https://192.168.50.108:2380"]}
{"level":"info","ts":"2024-02-14T04:25:29.286762Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d5ce96a8bfe0f5c1 is starting a new election at term 1"}
{"level":"info","ts":"2024-02-14T04:25:29.286881Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d5ce96a8bfe0f5c1 became pre-candidate at term 1"}
{"level":"info","ts":"2024-02-14T04:25:29.286916Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d5ce96a8bfe0f5c1 received MsgPreVoteResp from d5ce96a8bfe0f5c1 at term 1"}
{"level":"info","ts":"2024-02-14T04:25:29.286946Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d5ce96a8bfe0f5c1 became candidate at term 2"}
{"level":"info","ts":"2024-02-14T04:25:29.28697Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d5ce96a8bfe0f5c1 received MsgVoteResp from d5ce96a8bfe0f5c1 at term 2"}
{"level":"info","ts":"2024-02-14T04:25:29.286997Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d5ce96a8bfe0f5c1 became leader at term 2"}
{"level":"info","ts":"2024-02-14T04:25:29.287022Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: d5ce96a8bfe0f5c1 elected leader d5ce96a8bfe0f5c1 at term 2"}
{"level":"info","ts":"2024-02-14T04:25:29.28987Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:25:29.294824Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"d5ce96a8bfe0f5c1","local-member-attributes":"{Name:embed-certs-722906 ClientURLs:[https://192.168.50.108:2379]}","request-path":"/0/members/d5ce96a8bfe0f5c1/attributes","cluster-id":"38e677d7bff02ecf","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T04:25:29.295136Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"38e677d7bff02ecf","local-member-id":"d5ce96a8bfe0f5c1","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:25:29.295386Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:25:29.295427Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:25:29.295153Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:25:29.296549Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T04:25:29.295163Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:25:29.300573Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.50.108:2379"}
{"level":"info","ts":"2024-02-14T04:25:29.300796Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T04:25:29.300889Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
==> kernel <==
04:34:55 up 14 min, 0 users, load average: 0.35, 0.24, 0.18
Linux embed-certs-722906 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e] <==
W0214 04:30:32.233770 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:30:32.233914 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:30:32.233945 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:30:32.234096 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:30:32.234256 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:30:32.235332 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:31:31.092625 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:31:32.234979 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:31:32.235042 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:31:32.235068 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:31:32.236178 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:31:32.236285 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:31:32.236318 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:32:31.092061 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I0214 04:33:31.092861 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:33:32.235930 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:33:32.236172 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:33:32.236213 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:33:32.236844 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:33:32.236986 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:33:32.238235 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:34:31.092160 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
==> kube-controller-manager [0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7] <==
I0214 04:29:16.754396 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:29:46.381396 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:29:46.765751 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:30:16.386970 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:30:16.774237 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:30:46.394460 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:30:46.784262 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:31:16.403527 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:31:16.793829 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:31:46.409939 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:31:46.803638 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
I0214 04:31:47.929582 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="320.746µs"
I0214 04:31:58.927473 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="108.03µs"
E0214 04:32:16.414935 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:32:16.813086 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:32:46.423300 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:32:46.822336 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:33:16.428767 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:33:16.830555 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:33:46.434863 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:33:46.839120 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:34:16.441477 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:34:16.849314 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:34:46.448002 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:34:46.857304 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
==> kube-proxy [dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4] <==
I0214 04:25:51.336245 1 server_others.go:69] "Using iptables proxy"
I0214 04:25:51.355010 1 node.go:141] Successfully retrieved node IP: 192.168.50.108
I0214 04:25:51.403056 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 04:25:51.403105 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:25:51.406323 1 server_others.go:152] "Using iptables Proxier"
I0214 04:25:51.406394 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:25:51.406577 1 server.go:846] "Version info" version="v1.28.4"
I0214 04:25:51.406610 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:25:51.408522 1 config.go:188] "Starting service config controller"
I0214 04:25:51.408975 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:25:51.409061 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:25:51.409095 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:25:51.409929 1 config.go:315] "Starting node config controller"
I0214 04:25:51.409966 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:25:51.510024 1 shared_informer.go:318] Caches are synced for node config
I0214 04:25:51.510062 1 shared_informer.go:318] Caches are synced for service config
I0214 04:25:51.510088 1 shared_informer.go:318] Caches are synced for endpoint slice config
==> kube-scheduler [7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5] <==
W0214 04:25:31.269762 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:31.269770 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:31.269830 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:25:31.269839 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 04:25:31.269873 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:31.269881 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:31.274890 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:31.276259 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:32.156076 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 04:25:32.156200 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
W0214 04:25:32.157224 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:25:32.157305 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0214 04:25:32.252839 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:32.252914 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:32.328418 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 04:25:32.328481 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0214 04:25:32.370184 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:25:32.370207 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 04:25:32.422796 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 04:25:32.422881 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 04:25:32.455111 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:32.455223 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:32.533827 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:32.533917 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
I0214 04:25:35.260428 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:20:30 UTC, ends at Wed 2024-02-14 04:34:56 UTC. --
Feb 14 04:32:10 embed-certs-722906 kubelet[3909]: E0214 04:32:10.915289 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:32:25 embed-certs-722906 kubelet[3909]: E0214 04:32:25.910528 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:32:35 embed-certs-722906 kubelet[3909]: E0214 04:32:35.035037 3909 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:32:35 embed-certs-722906 kubelet[3909]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:32:35 embed-certs-722906 kubelet[3909]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:32:35 embed-certs-722906 kubelet[3909]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:32:36 embed-certs-722906 kubelet[3909]: E0214 04:32:36.911432 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:32:47 embed-certs-722906 kubelet[3909]: E0214 04:32:47.910561 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:33:01 embed-certs-722906 kubelet[3909]: E0214 04:33:01.910613 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:33:13 embed-certs-722906 kubelet[3909]: E0214 04:33:13.910767 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:33:26 embed-certs-722906 kubelet[3909]: E0214 04:33:26.912874 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:33:35 embed-certs-722906 kubelet[3909]: E0214 04:33:35.038445 3909 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:33:35 embed-certs-722906 kubelet[3909]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:33:35 embed-certs-722906 kubelet[3909]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:33:35 embed-certs-722906 kubelet[3909]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:33:39 embed-certs-722906 kubelet[3909]: E0214 04:33:39.911222 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:33:50 embed-certs-722906 kubelet[3909]: E0214 04:33:50.911145 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:34:04 embed-certs-722906 kubelet[3909]: E0214 04:34:04.911334 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:34:19 embed-certs-722906 kubelet[3909]: E0214 04:34:19.910744 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:34:30 embed-certs-722906 kubelet[3909]: E0214 04:34:30.912574 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:34:35 embed-certs-722906 kubelet[3909]: E0214 04:34:35.035132 3909 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:34:35 embed-certs-722906 kubelet[3909]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:34:35 embed-certs-722906 kubelet[3909]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:34:35 embed-certs-722906 kubelet[3909]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:34:45 embed-certs-722906 kubelet[3909]: E0214 04:34:45.911647 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
==> storage-provisioner [416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2] <==
I0214 04:25:51.164956 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 04:25:51.191601 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 04:25:51.191763 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 04:25:51.211843 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 04:25:51.213585 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_embed-certs-722906_b25bb42b-cf04-4978-97a4-063b91d23571!
I0214 04:25:51.216320 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"c0d738d0-011a-442a-bd54-71dc11fd7931", APIVersion:"v1", ResourceVersion:"413", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' embed-certs-722906_b25bb42b-cf04-4978-97a4-063b91d23571 became leader
I0214 04:25:51.314222 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_embed-certs-722906_b25bb42b-cf04-4978-97a4-063b91d23571!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-722906 -n embed-certs-722906
helpers_test.go:261: (dbg) Run: kubectl --context embed-certs-722906 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-57f55c9bc5-hzsfq
helpers_test.go:274: ======> post-mortem[TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context embed-certs-722906 describe pod metrics-server-57f55c9bc5-hzsfq
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context embed-certs-722906 describe pod metrics-server-57f55c9bc5-hzsfq: exit status 1 (68.282991ms)
** stderr **
Error from server (NotFound): pods "metrics-server-57f55c9bc5-hzsfq" not found
** /stderr **
helpers_test.go:279: kubectl --context embed-certs-722906 describe pod metrics-server-57f55c9bc5-hzsfq: exit status 1
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (543.18s)
=== RUN TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
E0214 04:27:09.288755 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:27:17.489810 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
helpers_test.go:329: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: WARNING: pod list for "kubernetes-dashboard" "k8s-app=kubernetes-dashboard" returned: client rate limiter Wait returned an error: context deadline exceeded
start_stop_delete_test.go:274: ***** TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:274: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-527067 -n no-preload-527067
start_stop_delete_test.go:274: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: showing logs for failed pods as of 2024-02-14 04:35:41.072735034 +0000 UTC m=+6458.037352650
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067
helpers_test.go:244: <<< TestStartStop/group/no-preload/serial/UserAppExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/no-preload/serial/UserAppExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p no-preload-527067 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p no-preload-527067 logs -n 25: (1.600142415s)
helpers_test.go:252: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p bridge-528898 sudo cat | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | containerd config dump | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p bridge-528898 sudo find | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p bridge-528898 sudo crio | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:12 UTC |
| | config | | | | | |
| delete | -p bridge-528898 | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| delete | -p | disable-driver-mounts-648156 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | disable-driver-mounts-648156 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:13 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable metrics-server -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | default-k8s-diff-port-224675 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable dashboard -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:26 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable dashboard -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:16:21
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:16:21.016222 1548589 out.go:291] Setting OutFile to fd 1 ...
I0214 04:16:21.016364 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016373 1548589 out.go:304] Setting ErrFile to fd 2...
I0214 04:16:21.016378 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016548 1548589 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:16:21.017128 1548589 out.go:298] Setting JSON to false
I0214 04:16:21.018088 1548589 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":25128,"bootTime":1707859053,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:16:21.018154 1548589 start.go:138] virtualization: kvm guest
I0214 04:16:21.020869 1548589 out.go:177] * [default-k8s-diff-port-224675] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:16:21.022663 1548589 notify.go:220] Checking for updates...
I0214 04:16:21.022671 1548589 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:16:21.024231 1548589 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:16:21.025835 1548589 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:16:21.027384 1548589 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:16:21.028899 1548589 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:16:21.030391 1548589 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:16:21.032286 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:16:21.032695 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.032740 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.048006 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36251
I0214 04:16:21.048486 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.049074 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.049097 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.049529 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.049715 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.049979 1548589 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:16:21.050268 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.050306 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.064529 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34885
I0214 04:16:21.064932 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.065386 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.065417 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.065713 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.065881 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.102150 1548589 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:16:21.104036 1548589 start.go:296] selected driver: kvm2
I0214 04:16:21.104047 1548589 start.go:900] validating driver "kvm2" against &{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisk
s:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.104144 1548589 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:16:21.104799 1548589 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.104878 1548589 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:16:21.119570 1548589 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:16:21.119934 1548589 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:16:21.120000 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:16:21.120015 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:16:21.120050 1548589 start.go:339] cluster config:
{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Names
pace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.120145 1548589 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.122309 1548589 out.go:177] * Starting "default-k8s-diff-port-224675" primary control-plane node in "default-k8s-diff-port-224675" cluster
I0214 04:16:20.509543 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:23.581533 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:21.123776 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:16:21.123806 1548589 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 04:16:21.123816 1548589 cache.go:56] Caching tarball of preloaded images
I0214 04:16:21.123877 1548589 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:16:21.123887 1548589 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 04:16:21.123977 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:16:21.124153 1548589 start.go:360] acquireMachinesLock for default-k8s-diff-port-224675: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:16:29.661593 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:32.733584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:38.813574 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:41.885576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:47.965558 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:51.037514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:57.117639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:00.189564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:06.269549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:09.341644 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:15.421514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:18.493573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:24.573561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:27.645587 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:33.725630 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:36.797500 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:42.877547 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:45.949563 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:52.029594 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:55.101598 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:01.181611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:04.253573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:10.333576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:13.405584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:19.485564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:22.557519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:28.637560 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:31.709570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:37.789577 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:40.861658 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:46.941582 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:50.013561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:56.093507 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:59.165639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:05.245643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:08.317643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:14.397568 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:17.469610 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:23.549636 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:26.621578 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:32.701570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:35.773525 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:41.853530 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:44.925611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:51.005519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:54.077549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:57.080691 1548199 start.go:364] duration metric: took 4m20.251500972s to acquireMachinesLock for "no-preload-527067"
I0214 04:19:57.080766 1548199 start.go:96] Skipping create...Using existing machine configuration
I0214 04:19:57.080773 1548199 fix.go:54] fixHost starting:
I0214 04:19:57.081118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:19:57.081148 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:19:57.096555 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44277
I0214 04:19:57.097002 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:19:57.097550 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:19:57.097577 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:19:57.097855 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:19:57.098034 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:19:57.098149 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:19:57.099876 1548199 fix.go:112] recreateIfNeeded on no-preload-527067: state=Stopped err=<nil>
I0214 04:19:57.099914 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
W0214 04:19:57.100102 1548199 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:19:57.102069 1548199 out.go:177] * Restarting existing kvm2 VM for "no-preload-527067" ...
I0214 04:19:57.077816 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:19:57.077865 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078255 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:19:57.078287 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078566 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:19:57.080537 1548015 machine.go:97] duration metric: took 4m37.408761431s to provisionDockerMachine
I0214 04:19:57.080584 1548015 fix.go:56] duration metric: took 4m37.431215989s for fixHost
I0214 04:19:57.080596 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 4m37.431242855s
W0214 04:19:57.080624 1548015 start.go:713] error starting host: provision: host is not running
W0214 04:19:57.080748 1548015 out.go:239] ! StartHost failed, but will try again: provision: host is not running
I0214 04:19:57.080758 1548015 start.go:728] Will try again in 5 seconds ...
I0214 04:19:57.103328 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Start
I0214 04:19:57.103512 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring networks are active...
I0214 04:19:57.104245 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network default is active
I0214 04:19:57.104698 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network mk-no-preload-527067 is active
I0214 04:19:57.105038 1548199 main.go:141] libmachine: (no-preload-527067) Getting domain xml...
I0214 04:19:57.105698 1548199 main.go:141] libmachine: (no-preload-527067) Creating domain...
I0214 04:19:58.292262 1548199 main.go:141] libmachine: (no-preload-527067) Waiting to get IP...
I0214 04:19:58.293277 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.293718 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.293762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.293632 1549610 retry.go:31] will retry after 307.836827ms: waiting for machine to come up
I0214 04:19:58.603354 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.603935 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.603965 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.603876 1549610 retry.go:31] will retry after 375.894078ms: waiting for machine to come up
I0214 04:19:58.981513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.981981 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.982015 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.981916 1549610 retry.go:31] will retry after 451.678342ms: waiting for machine to come up
I0214 04:19:59.435521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.435921 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.435961 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.435861 1549610 retry.go:31] will retry after 481.719322ms: waiting for machine to come up
I0214 04:19:59.919474 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.919914 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.919949 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.919839 1549610 retry.go:31] will retry after 586.359357ms: waiting for machine to come up
I0214 04:20:00.507667 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:00.508169 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:00.508197 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:00.508112 1549610 retry.go:31] will retry after 703.740251ms: waiting for machine to come up
I0214 04:20:01.213009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:01.213504 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:01.213531 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:01.213452 1549610 retry.go:31] will retry after 979.462057ms: waiting for machine to come up
I0214 04:20:02.082344 1548015 start.go:360] acquireMachinesLock for old-k8s-version-960884: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:20:02.194117 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:02.194497 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:02.194521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:02.194467 1549610 retry.go:31] will retry after 1.278763641s: waiting for machine to come up
I0214 04:20:03.474465 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:03.474892 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:03.474922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:03.474853 1549610 retry.go:31] will retry after 1.500263985s: waiting for machine to come up
I0214 04:20:04.977136 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:04.977601 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:04.977627 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:04.977565 1549610 retry.go:31] will retry after 2.055604163s: waiting for machine to come up
I0214 04:20:07.036030 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:07.036483 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:07.036527 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:07.036415 1549610 retry.go:31] will retry after 2.711272112s: waiting for machine to come up
I0214 04:20:09.750977 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:09.751371 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:09.751404 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:09.751317 1549610 retry.go:31] will retry after 2.924789693s: waiting for machine to come up
I0214 04:20:12.678157 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:12.678553 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:12.678615 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:12.678494 1549610 retry.go:31] will retry after 3.785040141s: waiting for machine to come up
I0214 04:20:16.468466 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468926 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has current primary IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468949 1548199 main.go:141] libmachine: (no-preload-527067) Found IP for machine: 192.168.39.167
I0214 04:20:16.468966 1548199 main.go:141] libmachine: (no-preload-527067) Reserving static IP address...
I0214 04:20:16.469414 1548199 main.go:141] libmachine: (no-preload-527067) Reserved static IP address: 192.168.39.167
I0214 04:20:16.469449 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.469476 1548199 main.go:141] libmachine: (no-preload-527067) Waiting for SSH to be available...
I0214 04:20:16.469513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | skip adding static IP to network mk-no-preload-527067 - found existing host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"}
I0214 04:20:16.469530 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Getting to WaitForSSH function...
I0214 04:20:16.471450 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471707 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.471728 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471812 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH client type: external
I0214 04:20:16.471845 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa (-rw-------)
I0214 04:20:16.471925 1548199 main.go:141] libmachine: (no-preload-527067) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.167 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:16.471947 1548199 main.go:141] libmachine: (no-preload-527067) DBG | About to run SSH command:
I0214 04:20:16.471958 1548199 main.go:141] libmachine: (no-preload-527067) DBG | exit 0
I0214 04:20:16.557177 1548199 main.go:141] libmachine: (no-preload-527067) DBG | SSH cmd err, output: <nil>:
I0214 04:20:16.557638 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetConfigRaw
I0214 04:20:16.558256 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.560907 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561244 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.561290 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561493 1548199 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/config.json ...
I0214 04:20:16.561699 1548199 machine.go:94] provisionDockerMachine start ...
I0214 04:20:16.561722 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:16.561930 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.564237 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564637 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.564664 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.565051 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565394 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.565620 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.565992 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.566004 1548199 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:16.673468 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:16.673502 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.673763 1548199 buildroot.go:166] provisioning hostname "no-preload-527067"
I0214 04:20:16.673799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.674010 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.676849 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677243 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.677291 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677404 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.677612 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677784 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677899 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.678062 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.678523 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.678543 1548199 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-527067 && echo "no-preload-527067" | sudo tee /etc/hostname
I0214 04:20:17.989797 1548416 start.go:364] duration metric: took 4m17.605388932s to acquireMachinesLock for "embed-certs-722906"
I0214 04:20:17.989877 1548416 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:17.989886 1548416 fix.go:54] fixHost starting:
I0214 04:20:17.990389 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:17.990441 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:18.007849 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36303
I0214 04:20:18.008367 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:18.008941 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:20:18.008970 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:18.009367 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:18.009556 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:18.009721 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:20:18.011258 1548416 fix.go:112] recreateIfNeeded on embed-certs-722906: state=Stopped err=<nil>
I0214 04:20:18.011289 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
W0214 04:20:18.011467 1548416 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:18.013874 1548416 out.go:177] * Restarting existing kvm2 VM for "embed-certs-722906" ...
I0214 04:20:16.797274 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-527067
I0214 04:20:16.797308 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.800396 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.800792 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800948 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.801172 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801409 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801569 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.801716 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.802024 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.802041 1548199 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-527067' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-527067/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-527067' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:16.921808 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:16.921851 1548199 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:16.921907 1548199 buildroot.go:174] setting up certificates
I0214 04:20:16.921921 1548199 provision.go:84] configureAuth start
I0214 04:20:16.921942 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.922243 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.924941 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925246 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.925294 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925448 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.927542 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.927839 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.927881 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.928073 1548199 provision.go:143] copyHostCerts
I0214 04:20:16.928185 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:16.928201 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:16.928289 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:16.928403 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:16.928413 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:16.928442 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:16.928502 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:16.928509 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:16.928529 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:16.928578 1548199 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.no-preload-527067 san=[127.0.0.1 192.168.39.167 localhost minikube no-preload-527067]
I0214 04:20:17.305617 1548199 provision.go:177] copyRemoteCerts
I0214 04:20:17.305690 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:17.305716 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.308699 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309038 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.309061 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.309485 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.309657 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.309802 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.394912 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:17.416301 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0214 04:20:17.437138 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:17.457797 1548199 provision.go:87] duration metric: took 535.857617ms to configureAuth
I0214 04:20:17.457828 1548199 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:17.458050 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:20:17.458158 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.460939 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461355 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.461402 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461525 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.461750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.461928 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.462085 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.462252 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.462572 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.462588 1548199 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:17.755399 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:17.755434 1548199 machine.go:97] duration metric: took 1.19371818s to provisionDockerMachine
I0214 04:20:17.755449 1548199 start.go:293] postStartSetup for "no-preload-527067" (driver="kvm2")
I0214 04:20:17.755463 1548199 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:17.755479 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.755812 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:17.755844 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.758654 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.758940 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.758993 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.759135 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.759342 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.759503 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.759639 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.842683 1548199 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:17.847099 1548199 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:17.847127 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:17.847225 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:17.847324 1548199 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:17.847427 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:17.855667 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:17.878842 1548199 start.go:296] duration metric: took 123.375783ms for postStartSetup
I0214 04:20:17.878892 1548199 fix.go:56] duration metric: took 20.79811795s for fixHost
I0214 04:20:17.878923 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.881702 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.882041 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882222 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.882464 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882624 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882782 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.882993 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.883487 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.883502 1548199 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:17.989605 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884417.936736993
I0214 04:20:17.989641 1548199 fix.go:216] guest clock: 1707884417.936736993
I0214 04:20:17.989651 1548199 fix.go:229] Guest: 2024-02-14 04:20:17.936736993 +0000 UTC Remote: 2024-02-14 04:20:17.878897601 +0000 UTC m=+281.200605630 (delta=57.839392ms)
I0214 04:20:17.989679 1548199 fix.go:200] guest clock delta is within tolerance: 57.839392ms
I0214 04:20:17.989697 1548199 start.go:83] releasing machines lock for "no-preload-527067", held for 20.908940374s
I0214 04:20:17.989737 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.990017 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:17.993106 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993551 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.993583 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994292 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994496 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994549 1548199 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:17.994608 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.994767 1548199 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:17.994851 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.997321 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997570 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997602 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997622 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997736 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.997968 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.998111 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.998159 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998305 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.998422 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.998602 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998747 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:18.106735 1548199 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:18.112352 1548199 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:18.256984 1548199 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:18.262909 1548199 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:18.262978 1548199 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:18.279371 1548199 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:18.279399 1548199 start.go:494] detecting cgroup driver to use...
I0214 04:20:18.279462 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:18.294016 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:18.307013 1548199 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:18.307077 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:18.320441 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:18.334729 1548199 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:18.435265 1548199 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:18.543248 1548199 docker.go:233] disabling docker service ...
I0214 04:20:18.543333 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:18.555985 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:18.566967 1548199 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:18.680096 1548199 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:18.798889 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:18.813158 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:18.831387 1548199 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:18.831446 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.841300 1548199 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:18.841352 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.851097 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.860948 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.870710 1548199 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:18.880195 1548199 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:18.889041 1548199 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:18.889111 1548199 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:18.902760 1548199 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:18.912155 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:19.032843 1548199 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:19.218049 1548199 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:19.218136 1548199 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:19.223483 1548199 start.go:562] Will wait 60s for crictl version
I0214 04:20:19.223562 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.227341 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:19.269198 1548199 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:19.269316 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.314795 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.363241 1548199 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on CRI-O 1.24.1 ...
I0214 04:20:18.015330 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Start
I0214 04:20:18.015514 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring networks are active...
I0214 04:20:18.016153 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network default is active
I0214 04:20:18.016585 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network mk-embed-certs-722906 is active
I0214 04:20:18.017058 1548416 main.go:141] libmachine: (embed-certs-722906) Getting domain xml...
I0214 04:20:18.017739 1548416 main.go:141] libmachine: (embed-certs-722906) Creating domain...
I0214 04:20:19.267998 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting to get IP...
I0214 04:20:19.269071 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.269626 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.269744 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.269612 1549739 retry.go:31] will retry after 206.534163ms: waiting for machine to come up
I0214 04:20:19.478352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.478984 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.479109 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.479039 1549739 retry.go:31] will retry after 329.891336ms: waiting for machine to come up
I0214 04:20:19.810738 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.811201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.811225 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.811148 1549739 retry.go:31] will retry after 297.899998ms: waiting for machine to come up
I0214 04:20:20.110861 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.111307 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.111340 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.111260 1549739 retry.go:31] will retry after 483.120653ms: waiting for machine to come up
I0214 04:20:19.364761 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:19.367698 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368111 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:19.368141 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368326 1548199 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 04:20:19.372316 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:19.384595 1548199 kubeadm.go:877] updating cluster {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m
0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:19.384737 1548199 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:20:19.384782 1548199 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:19.428992 1548199 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.29.0-rc.2". assuming images are not preloaded.
I0214 04:20:19.429025 1548199 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.29.0-rc.2 registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 registry.k8s.io/kube-scheduler:v1.29.0-rc.2 registry.k8s.io/kube-proxy:v1.29.0-rc.2 registry.k8s.io/pause:3.9 registry.k8s.io/etcd:3.5.10-0 registry.k8s.io/coredns/coredns:v1.11.1 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.429150 1548199 image.go:134] retrieving image: registry.k8s.io/pause:3.9
I0214 04:20:19.429159 1548199 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.429177 1548199 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.429328 1548199 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.429332 1548199 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.429351 1548199 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.431104 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.431106 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.431123 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.431216 1548199 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.431226 1548199 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
I0214 04:20:19.431239 1548199 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.431291 1548199 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.431826 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.613887 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.614261 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.626641 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.9
I0214 04:20:19.630913 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.638603 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.652797 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.654940 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.656778 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.698298 1548199 cache_images.go:116] "registry.k8s.io/etcd:3.5.10-0" needs transfer: "registry.k8s.io/etcd:3.5.10-0" does not exist at hash "a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7" in container runtime
I0214 04:20:19.698355 1548199 cri.go:218] Removing image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.698414 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.757753 1548199 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" does not exist at hash "bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f" in container runtime
I0214 04:20:19.757810 1548199 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.757870 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941144 1548199 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" does not exist at hash "4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210" in container runtime
I0214 04:20:19.941166 1548199 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.11.1" needs transfer: "registry.k8s.io/coredns/coredns:v1.11.1" does not exist at hash "cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4" in container runtime
I0214 04:20:19.941188 1548199 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime
I0214 04:20:19.941198 1548199 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.941201 1548199 cri.go:218] Removing image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.941205 1548199 cri.go:218] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941337 1548199 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" does not exist at hash "d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d" in container runtime
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941382 1548199 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.941415 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941482 1548199 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-proxy:v1.29.0-rc.2" does not exist at hash "cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834" in container runtime
I0214 04:20:19.941506 1548199 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.941537 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941549 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.941643 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.955388 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.955421 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.969125 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.969198 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.969166 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:20.061499 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
I0214 04:20:20.061591 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.061633 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.061699 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.094179 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094180 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
I0214 04:20:20.094312 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094395 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:20.124555 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
I0214 04:20:20.124585 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124670 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:20.124703 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124677 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124746 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/etcd_3.5.10-0 (exists)
I0214 04:20:20.124760 1548199 crio.go:257] Loading image: /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124793 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124803 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2 (exists)
I0214 04:20:20.124829 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124877 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2 (exists)
I0214 04:20:20.124902 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/storage-provisioner_v5 (exists)
I0214 04:20:20.136587 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/coredns_v1.11.1 (exists)
I0214 04:20:20.136626 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2 (exists)
I0214 04:20:20.595903 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.596479 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.596504 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.596431 1549739 retry.go:31] will retry after 541.170149ms: waiting for machine to come up
I0214 04:20:21.139128 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.139587 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.139619 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.139543 1549739 retry.go:31] will retry after 609.736734ms: waiting for machine to come up
I0214 04:20:21.750821 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.751430 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.751476 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.751373 1549739 retry.go:31] will retry after 889.762874ms: waiting for machine to come up
I0214 04:20:22.642380 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:22.642915 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:22.642966 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:22.642850 1549739 retry.go:31] will retry after 1.310308388s: waiting for machine to come up
I0214 04:20:23.954650 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:23.955082 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:23.955114 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:23.955032 1549739 retry.go:31] will retry after 1.186449176s: waiting for machine to come up
I0214 04:20:25.143888 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:25.144379 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:25.144409 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:25.144331 1549739 retry.go:31] will retry after 1.870374645s: waiting for machine to come up
I0214 04:20:24.103814 1548199 ssh_runner.go:235] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (3.97895084s)
I0214 04:20:24.103870 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2 (exists)
I0214 04:20:24.104023 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0: (3.979201042s)
I0214 04:20:24.104052 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 from cache
I0214 04:20:24.104094 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:24.104197 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:27.017422 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:27.017923 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:27.017949 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:27.017821 1549739 retry.go:31] will retry after 2.372344988s: waiting for machine to come up
I0214 04:20:29.391597 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:29.392177 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:29.392212 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:29.392127 1549739 retry.go:31] will retry after 2.760319549s: waiting for machine to come up
I0214 04:20:27.189223 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2: (3.084990766s)
I0214 04:20:27.189276 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 from cache
I0214 04:20:27.189310 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:27.189404 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:29.355802 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2: (2.166363074s)
I0214 04:20:29.355840 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 from cache
I0214 04:20:29.355881 1548199 crio.go:257] Loading image: /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:29.355951 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:30.013381 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
I0214 04:20:30.013438 1548199 crio.go:257] Loading image: /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:30.013501 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:32.155254 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:32.155727 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:32.155753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:32.155677 1549739 retry.go:31] will retry after 4.524050008s: waiting for machine to come up
I0214 04:20:31.977727 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1: (1.964188552s)
I0214 04:20:31.977769 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 from cache
I0214 04:20:31.977802 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:31.977872 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:34.535494 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2: (2.557583724s)
I0214 04:20:34.535538 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 from cache
I0214 04:20:34.535571 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:34.535624 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:35.791070 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (1.255414762s)
I0214 04:20:35.791122 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 from cache
I0214 04:20:35.791154 1548199 cache_images.go:123] Successfully loaded all cached images
I0214 04:20:35.791166 1548199 cache_images.go:92] duration metric: took 16.362124396s to LoadCachedImages
I0214 04:20:35.791179 1548199 kubeadm.go:928] updating node { 192.168.39.167 8443 v1.29.0-rc.2 crio true true} ...
I0214 04:20:35.791336 1548199 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-527067 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.167
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:35.791437 1548199 ssh_runner.go:195] Run: crio config
I0214 04:20:35.848895 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:20:35.848923 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:35.848935 1548199 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:35.848985 1548199 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.167 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-527067 NodeName:no-preload-527067 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.167"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.167 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:35.849152 1548199 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.167
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-527067"
kubeletExtraArgs:
node-ip: 192.168.39.167
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.167"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:35.849221 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0214 04:20:35.859377 1548199 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:35.859443 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:35.868486 1548199 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0214 04:20:35.885091 1548199 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0214 04:20:35.901749 1548199 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2166 bytes)
I0214 04:20:35.919596 1548199 ssh_runner.go:195] Run: grep 192.168.39.167 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:35.923203 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.167 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:35.934756 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:36.048443 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:36.063403 1548199 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067 for IP: 192.168.39.167
I0214 04:20:36.063423 1548199 certs.go:194] generating shared ca certs ...
I0214 04:20:36.063440 1548199 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:36.063607 1548199 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:36.063675 1548199 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:36.063691 1548199 certs.go:256] generating profile certs ...
I0214 04:20:36.063805 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/client.key
I0214 04:20:36.063903 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key.79c0eebd
I0214 04:20:36.063964 1548199 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key
I0214 04:20:36.064127 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:36.064168 1548199 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:36.064182 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:36.064220 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:36.064249 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:36.064281 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:36.064332 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:36.065313 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:36.101889 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:36.135234 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:36.168832 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:36.204188 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 04:20:36.230823 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 04:20:36.254917 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:36.282014 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:36.303131 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:36.323933 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:36.344419 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:36.365038 1548199 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:36.380645 1548199 ssh_runner.go:195] Run: openssl version
I0214 04:20:36.386091 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:36.395680 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399890 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399959 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.405132 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:36.415168 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:36.424870 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.428976 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.429025 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.434401 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:36.443848 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:36.453658 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457908 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457963 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.463066 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:36.472994 1548199 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:36.477141 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:36.482809 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:36.488342 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:36.493884 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:36.499087 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:36.504410 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:36.509751 1548199 kubeadm.go:391] StartCluster: {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29
.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s
Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:36.509849 1548199 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:36.509914 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.547323 1548199 cri.go:89] found id: ""
I0214 04:20:36.547408 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:36.556907 1548199 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:36.556928 1548199 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:36.556935 1548199 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:36.557012 1548199 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:36.566003 1548199 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:36.567328 1548199 kubeconfig.go:125] found "no-preload-527067" server: "https://192.168.39.167:8443"
I0214 04:20:36.570250 1548199 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:36.578772 1548199 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.167
I0214 04:20:36.578805 1548199 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:36.578819 1548199 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:36.578868 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.615271 1548199 cri.go:89] found id: ""
I0214 04:20:36.615369 1548199 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:36.631254 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:36.640513 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:36.640544 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:20:36.640605 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:36.649213 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:36.649289 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:36.658011 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:36.667277 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:36.667461 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:36.677535 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:36.686189 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:36.686248 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:36.696716 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:36.706405 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:36.706442 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:36.715622 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:36.725241 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.074017 1548589 start.go:364] duration metric: took 4m16.949827565s to acquireMachinesLock for "default-k8s-diff-port-224675"
I0214 04:20:38.074099 1548589 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:38.074107 1548589 fix.go:54] fixHost starting:
I0214 04:20:38.074546 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:38.074596 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:38.092223 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32909
I0214 04:20:38.092628 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:38.093091 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:20:38.093112 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:38.093545 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:38.093743 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:38.093902 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:20:38.095356 1548589 fix.go:112] recreateIfNeeded on default-k8s-diff-port-224675: state=Stopped err=<nil>
I0214 04:20:38.095385 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
W0214 04:20:38.095570 1548589 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:38.097728 1548589 out.go:177] * Restarting existing kvm2 VM for "default-k8s-diff-port-224675" ...
I0214 04:20:36.682303 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.682827 1548416 main.go:141] libmachine: (embed-certs-722906) Found IP for machine: 192.168.50.108
I0214 04:20:36.682865 1548416 main.go:141] libmachine: (embed-certs-722906) Reserving static IP address...
I0214 04:20:36.682884 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has current primary IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.683294 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.683326 1548416 main.go:141] libmachine: (embed-certs-722906) Reserved static IP address: 192.168.50.108
I0214 04:20:36.683352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | skip adding static IP to network mk-embed-certs-722906 - found existing host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"}
I0214 04:20:36.683370 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Getting to WaitForSSH function...
I0214 04:20:36.683386 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting for SSH to be available...
I0214 04:20:36.685555 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.685877 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.685912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.686044 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH client type: external
I0214 04:20:36.686073 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa (-rw-------)
I0214 04:20:36.686108 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.108 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:36.686121 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | About to run SSH command:
I0214 04:20:36.686136 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | exit 0
I0214 04:20:36.777374 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | SSH cmd err, output: <nil>:
I0214 04:20:36.777749 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetConfigRaw
I0214 04:20:36.778583 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:36.781415 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.781891 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.781918 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.782292 1548416 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/config.json ...
I0214 04:20:36.782531 1548416 machine.go:94] provisionDockerMachine start ...
I0214 04:20:36.782576 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:36.782816 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.785327 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.785737 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785996 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.786168 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786327 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786501 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.786710 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.787196 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.787214 1548416 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:36.905657 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:36.905687 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.905964 1548416 buildroot.go:166] provisioning hostname "embed-certs-722906"
I0214 04:20:36.905990 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.906183 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.909442 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.909874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.909912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.910070 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.910262 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910445 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910582 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.910738 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.911264 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.911289 1548416 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-722906 && echo "embed-certs-722906" | sudo tee /etc/hostname
I0214 04:20:37.046181 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-722906
I0214 04:20:37.046216 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.049414 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.049785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.049819 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.050075 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.050291 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050646 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.050842 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.051191 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.051235 1548416 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-722906' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-722906/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-722906' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:37.177589 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:37.177622 1548416 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:37.177646 1548416 buildroot.go:174] setting up certificates
I0214 04:20:37.177657 1548416 provision.go:84] configureAuth start
I0214 04:20:37.177668 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:37.178023 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:37.181013 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181404 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.181435 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181606 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.183959 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184300 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.184329 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184472 1548416 provision.go:143] copyHostCerts
I0214 04:20:37.184534 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:37.184544 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:37.184594 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:37.184678 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:37.184685 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:37.184710 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:37.184785 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:37.184794 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:37.184813 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:37.184881 1548416 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.embed-certs-722906 san=[127.0.0.1 192.168.50.108 embed-certs-722906 localhost minikube]
I0214 04:20:37.334150 1548416 provision.go:177] copyRemoteCerts
I0214 04:20:37.334225 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:37.334258 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.336874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337245 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.337299 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337492 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.337693 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.337868 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.338016 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.424211 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:37.448257 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0214 04:20:37.472132 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:20:37.496606 1548416 provision.go:87] duration metric: took 318.923431ms to configureAuth
I0214 04:20:37.496633 1548416 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:37.496815 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:37.496904 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.499706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500129 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.500174 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500359 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.500566 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500738 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500873 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.501094 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.501587 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.501614 1548416 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:37.814749 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:37.814781 1548416 machine.go:97] duration metric: took 1.032234304s to provisionDockerMachine
I0214 04:20:37.814796 1548416 start.go:293] postStartSetup for "embed-certs-722906" (driver="kvm2")
I0214 04:20:37.814811 1548416 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:37.814848 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:37.815206 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:37.815237 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.818201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818621 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.818644 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818819 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.819026 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.819221 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.819386 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.913636 1548416 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:37.919126 1548416 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:37.919153 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:37.919231 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:37.919328 1548416 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:37.919441 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:37.930902 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:37.955477 1548416 start.go:296] duration metric: took 140.651894ms for postStartSetup
I0214 04:20:37.955515 1548416 fix.go:56] duration metric: took 19.965630101s for fixHost
I0214 04:20:37.955546 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.958406 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.958844 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.958883 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.959025 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.959250 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959490 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.959876 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.960220 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.960236 1548416 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:38.073852 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884438.021225394
I0214 04:20:38.073878 1548416 fix.go:216] guest clock: 1707884438.021225394
I0214 04:20:38.073897 1548416 fix.go:229] Guest: 2024-02-14 04:20:38.021225394 +0000 UTC Remote: 2024-02-14 04:20:37.955524144 +0000 UTC m=+277.725419033 (delta=65.70125ms)
I0214 04:20:38.073926 1548416 fix.go:200] guest clock delta is within tolerance: 65.70125ms
I0214 04:20:38.073936 1548416 start.go:83] releasing machines lock for "embed-certs-722906", held for 20.084084933s
I0214 04:20:38.073965 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.074261 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:38.077151 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077577 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.077612 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077814 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078403 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078604 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078683 1548416 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:38.078733 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.078839 1548416 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:38.078867 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.081284 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081692 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.081758 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081784 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081870 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082041 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082218 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082256 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.082293 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.082336 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.082457 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082607 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082726 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082903 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.190317 1548416 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:38.196626 1548416 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:38.349673 1548416 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:38.356571 1548416 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:38.356677 1548416 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:38.377847 1548416 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:38.377877 1548416 start.go:494] detecting cgroup driver to use...
I0214 04:20:38.377956 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:38.395591 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:38.411254 1548416 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:38.411337 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:38.429922 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:38.446585 1548416 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:38.576797 1548416 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:38.708684 1548416 docker.go:233] disabling docker service ...
I0214 04:20:38.708752 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:38.723898 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:38.736512 1548416 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:38.864382 1548416 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:38.978645 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:38.995888 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:39.015920 1548416 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:39.015998 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.028138 1548416 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:39.028205 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.041203 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.054736 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.064851 1548416 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:39.074475 1548416 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:39.085772 1548416 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:39.085839 1548416 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:39.102669 1548416 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:39.117041 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:39.248406 1548416 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:39.438738 1548416 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:39.438820 1548416 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:39.445895 1548416 start.go:562] Will wait 60s for crictl version
I0214 04:20:39.445969 1548416 ssh_runner.go:195] Run: which crictl
I0214 04:20:39.450199 1548416 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:39.491583 1548416 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:39.491674 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.534681 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.593285 1548416 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:39.594908 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:39.598263 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.598753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:39.598785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.599034 1548416 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0214 04:20:39.603478 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:39.621148 1548416 kubeadm.go:877] updating cluster {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:
false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:39.621309 1548416 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:39.621379 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:39.676783 1548416 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:39.676909 1548416 ssh_runner.go:195] Run: which lz4
I0214 04:20:39.681410 1548416 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:39.686690 1548416 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:39.686727 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:20:38.099207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Start
I0214 04:20:38.099430 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring networks are active...
I0214 04:20:38.100228 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network default is active
I0214 04:20:38.100585 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network mk-default-k8s-diff-port-224675 is active
I0214 04:20:38.101059 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Getting domain xml...
I0214 04:20:38.101854 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Creating domain...
I0214 04:20:39.454986 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting to get IP...
I0214 04:20:39.456025 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456576 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456614 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.456520 1549871 retry.go:31] will retry after 292.69131ms: waiting for machine to come up
I0214 04:20:39.751334 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751908 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751956 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.751858 1549871 retry.go:31] will retry after 340.869303ms: waiting for machine to come up
I0214 04:20:40.094535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095142 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.095051 1549871 retry.go:31] will retry after 293.465495ms: waiting for machine to come up
I0214 04:20:40.390912 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391346 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391377 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.391290 1549871 retry.go:31] will retry after 457.62012ms: waiting for machine to come up
I0214 04:20:40.851151 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851616 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851645 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.851547 1549871 retry.go:31] will retry after 539.345518ms: waiting for machine to come up
I0214 04:20:36.851047 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.089975 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.238873301s)
I0214 04:20:38.090005 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.309755 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.378436 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.478394 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:38.478509 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:38.979577 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.478754 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.979574 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.479243 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.978672 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:41.006970 1548199 api_server.go:72] duration metric: took 2.528578043s to wait for apiserver process to appear ...
I0214 04:20:41.007003 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:41.007024 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.008150 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:20:41.507776 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.762516 1548416 crio.go:444] duration metric: took 2.081156311s to copy over tarball
I0214 04:20:41.762608 1548416 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:20:44.980302 1548416 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.217656042s)
I0214 04:20:44.980335 1548416 crio.go:451] duration metric: took 3.217784443s to extract the tarball
I0214 04:20:44.980346 1548416 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:20:45.024706 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:45.082193 1548416 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:20:45.082217 1548416 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:20:45.082225 1548416 kubeadm.go:928] updating node { 192.168.50.108 8443 v1.28.4 crio true true} ...
I0214 04:20:45.082349 1548416 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-722906 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.50.108
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:45.082447 1548416 ssh_runner.go:195] Run: crio config
I0214 04:20:45.147931 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:45.147969 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:45.147982 1548416 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:45.148006 1548416 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.108 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-722906 NodeName:embed-certs-722906 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.108"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.108 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:45.148164 1548416 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.108
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-722906"
kubeletExtraArgs:
node-ip: 192.168.50.108
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.108"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:45.148232 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:20:45.158479 1548416 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:45.158553 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:45.167772 1548416 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)
I0214 04:20:45.184110 1548416 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:20:45.200469 1548416 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
I0214 04:20:45.217332 1548416 ssh_runner.go:195] Run: grep 192.168.50.108 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:45.221512 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.108 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:45.233317 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:41.392312 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393904 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:41.393756 1549871 retry.go:31] will retry after 729.897424ms: waiting for machine to come up
I0214 04:20:42.125952 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126513 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126542 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:42.126448 1549871 retry.go:31] will retry after 1.070487026s: waiting for machine to come up
I0214 04:20:43.198768 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199234 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199269 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:43.199179 1549871 retry.go:31] will retry after 1.144751625s: waiting for machine to come up
I0214 04:20:44.345532 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345958 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345989 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:44.345929 1549871 retry.go:31] will retry after 1.430046726s: waiting for machine to come up
I0214 04:20:45.778221 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778683 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778713 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:45.778628 1549871 retry.go:31] will retry after 2.320641186s: waiting for machine to come up
I0214 04:20:46.508190 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:46.508231 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:45.341316 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:45.781473 1548416 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906 for IP: 192.168.50.108
I0214 04:20:45.781494 1548416 certs.go:194] generating shared ca certs ...
I0214 04:20:45.781513 1548416 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:45.781690 1548416 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:45.781760 1548416 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:45.781777 1548416 certs.go:256] generating profile certs ...
I0214 04:20:45.781960 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/client.key
I0214 04:20:45.782154 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key.de29a2e4
I0214 04:20:45.782215 1548416 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key
I0214 04:20:45.782395 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:45.782438 1548416 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:45.782453 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:45.782491 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:45.782537 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:45.782570 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:45.782625 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:45.783482 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:45.822613 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:45.853037 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:45.898215 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:45.938947 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0214 04:20:45.965143 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:20:45.994794 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:46.018374 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:46.044018 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:46.067499 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:46.090920 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:46.114475 1548416 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:46.132051 1548416 ssh_runner.go:195] Run: openssl version
I0214 04:20:46.137746 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:46.147403 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152220 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152298 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.158254 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:46.167536 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:46.179112 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184157 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184219 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.190110 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:46.200066 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:46.210093 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214882 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214955 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.220636 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:46.230395 1548416 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:46.235238 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:46.241337 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:46.247195 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:46.253414 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:46.259696 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:46.266214 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:46.272246 1548416 kubeadm.go:391] StartCluster: {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fal
se MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:46.272384 1548416 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:46.272458 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.322213 1548416 cri.go:89] found id: ""
I0214 04:20:46.322303 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:46.334965 1548416 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:46.334993 1548416 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:46.334999 1548416 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:46.335055 1548416 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:46.344493 1548416 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:46.345570 1548416 kubeconfig.go:125] found "embed-certs-722906" server: "https://192.168.50.108:8443"
I0214 04:20:46.347818 1548416 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:46.357313 1548416 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.50.108
I0214 04:20:46.357349 1548416 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:46.357365 1548416 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:46.357429 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.403854 1548416 cri.go:89] found id: ""
I0214 04:20:46.403945 1548416 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:46.418730 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:46.432468 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:46.432491 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:20:46.432541 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:46.441218 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:46.441346 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:46.450078 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:46.458158 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:46.458261 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:46.472089 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:46.480354 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:46.480425 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:46.489174 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:46.497321 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:46.497406 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:46.506204 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:46.517469 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:46.646342 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.587291 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.799709 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.882294 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.990798 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:47.990913 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.491970 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.991676 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.491048 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.991348 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.100608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:48.101075 1549871 retry.go:31] will retry after 2.658096517s: waiting for machine to come up
I0214 04:20:50.762784 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763407 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:50.763316 1549871 retry.go:31] will retry after 2.514722067s: waiting for machine to come up
I0214 04:20:51.508782 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:51.508854 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:50.491707 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:50.511999 1548416 api_server.go:72] duration metric: took 2.521202011s to wait for apiserver process to appear ...
I0214 04:20:50.512032 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:50.512056 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.915403 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:20:53.915447 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:20:53.915465 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.961623 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:53.961686 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.012877 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.029797 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.029829 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.512349 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.517512 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.517539 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.013148 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.019019 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:55.019067 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.512961 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.520464 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:20:55.529064 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:20:55.529096 1548416 api_server.go:131] duration metric: took 5.017056759s to wait for apiserver health ...
I0214 04:20:55.529107 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:55.529117 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:55.531379 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:20:53.279582 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280038 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:53.279941 1549871 retry.go:31] will retry after 3.362064709s: waiting for machine to come up
I0214 04:20:56.510005 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:56.510055 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:58.174260 1548015 start.go:364] duration metric: took 56.091842509s to acquireMachinesLock for "old-k8s-version-960884"
I0214 04:20:58.174320 1548015 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:58.174329 1548015 fix.go:54] fixHost starting:
I0214 04:20:58.174723 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:58.174759 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:58.194079 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41161
I0214 04:20:58.194519 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:58.195088 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:20:58.195119 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:58.195478 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:58.195686 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:20:58.195855 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:20:58.197422 1548015 fix.go:112] recreateIfNeeded on old-k8s-version-960884: state=Stopped err=<nil>
I0214 04:20:58.197454 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
W0214 04:20:58.197646 1548015 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:58.200239 1548015 out.go:177] * Restarting existing kvm2 VM for "old-k8s-version-960884" ...
I0214 04:20:58.201659 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Start
I0214 04:20:58.201846 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring networks are active...
I0214 04:20:58.202622 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network default is active
I0214 04:20:58.202951 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network mk-old-k8s-version-960884 is active
I0214 04:20:58.203335 1548015 main.go:141] libmachine: (old-k8s-version-960884) Getting domain xml...
I0214 04:20:58.204058 1548015 main.go:141] libmachine: (old-k8s-version-960884) Creating domain...
I0214 04:20:59.499603 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting to get IP...
I0214 04:20:59.500457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.500948 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.501078 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.500925 1550044 retry.go:31] will retry after 268.008751ms: waiting for machine to come up
I0214 04:20:56.646632 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647206 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has current primary IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Found IP for machine: 192.168.61.188
I0214 04:20:56.647242 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserving static IP address...
I0214 04:20:56.647731 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserved static IP address: 192.168.61.188
I0214 04:20:56.647765 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for SSH to be available...
I0214 04:20:56.647794 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.647835 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | skip adding static IP to network mk-default-k8s-diff-port-224675 - found existing host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"}
I0214 04:20:56.647855 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Getting to WaitForSSH function...
I0214 04:20:56.650403 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.650820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.650856 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.651067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH client type: external
I0214 04:20:56.651100 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa (-rw-------)
I0214 04:20:56.651166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.188 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:56.651192 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | About to run SSH command:
I0214 04:20:56.651207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | exit 0
I0214 04:20:56.745447 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | SSH cmd err, output: <nil>:
I0214 04:20:56.745839 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetConfigRaw
I0214 04:20:56.746577 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:56.749052 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749421 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.749460 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749749 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:20:56.750003 1548589 machine.go:94] provisionDockerMachine start ...
I0214 04:20:56.750032 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:56.750283 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.752289 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.752669 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752745 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.752923 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753226 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.753428 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.753775 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.753787 1548589 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:56.885360 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:56.885414 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885730 1548589 buildroot.go:166] provisioning hostname "default-k8s-diff-port-224675"
I0214 04:20:56.885763 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885965 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.889200 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889612 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.889646 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.889979 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890304 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.890522 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.890994 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.891016 1548589 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-224675 && echo "default-k8s-diff-port-224675" | sudo tee /etc/hostname
I0214 04:20:57.036037 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-224675
I0214 04:20:57.036072 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.039174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039572 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.039608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039755 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.039972 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040163 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040409 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.040613 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.040946 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.040964 1548589 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-224675' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-224675/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-224675' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:57.182677 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:57.182717 1548589 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:57.182783 1548589 buildroot.go:174] setting up certificates
I0214 04:20:57.182802 1548589 provision.go:84] configureAuth start
I0214 04:20:57.182822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:57.183166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:57.186475 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.186873 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.186913 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.187230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.189476 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189790 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.189822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189971 1548589 provision.go:143] copyHostCerts
I0214 04:20:57.190038 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:57.190049 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:57.190098 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:57.190266 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:57.190280 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:57.190314 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:57.190386 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:57.190394 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:57.190412 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:57.190461 1548589 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-224675 san=[127.0.0.1 192.168.61.188 default-k8s-diff-port-224675 localhost minikube]
I0214 04:20:57.387080 1548589 provision.go:177] copyRemoteCerts
I0214 04:20:57.387149 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:57.387175 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.390293 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.390630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.391007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.391181 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.391322 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.485912 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:57.512761 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0214 04:20:57.536095 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:57.558680 1548589 provision.go:87] duration metric: took 375.857715ms to configureAuth
I0214 04:20:57.558710 1548589 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:57.558918 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:57.559003 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.562067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562500 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.562537 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562704 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.562907 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563106 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563246 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.563461 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.563823 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.563850 1548589 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:57.893504 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:57.893536 1548589 machine.go:97] duration metric: took 1.143516422s to provisionDockerMachine
I0214 04:20:57.893548 1548589 start.go:293] postStartSetup for "default-k8s-diff-port-224675" (driver="kvm2")
I0214 04:20:57.893559 1548589 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:57.893575 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:57.893941 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:57.893974 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.896371 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896764 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.896795 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896910 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.897116 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.897286 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.897442 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.996592 1548589 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:58.000872 1548589 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:58.000900 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:58.000983 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:58.001088 1548589 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:58.001183 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:58.011272 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:58.034964 1548589 start.go:296] duration metric: took 141.398226ms for postStartSetup
I0214 04:20:58.035023 1548589 fix.go:56] duration metric: took 19.960915344s for fixHost
I0214 04:20:58.035053 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.037914 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038291 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.038324 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038581 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.038811 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.038999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.039138 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.039329 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:58.039672 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:58.039684 1548589 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:58.174082 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884458.118396657
I0214 04:20:58.174110 1548589 fix.go:216] guest clock: 1707884458.118396657
I0214 04:20:58.174121 1548589 fix.go:229] Guest: 2024-02-14 04:20:58.118396657 +0000 UTC Remote: 2024-02-14 04:20:58.035028403 +0000 UTC m=+277.067763536 (delta=83.368254ms)
I0214 04:20:58.174148 1548589 fix.go:200] guest clock delta is within tolerance: 83.368254ms
I0214 04:20:58.174154 1548589 start.go:83] releasing machines lock for "default-k8s-diff-port-224675", held for 20.100083449s
I0214 04:20:58.174185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.174605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:58.177237 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177662 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.177693 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177891 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178381 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178690 1548589 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:58.178744 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.178844 1548589 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:58.178867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.181490 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181819 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.181842 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182009 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.182292 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.182352 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.182420 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182520 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182582 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.182999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.183208 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.183377 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.279272 1548589 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:58.306096 1548589 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:58.464434 1548589 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:58.471146 1548589 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:58.471214 1548589 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:58.488300 1548589 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:58.488334 1548589 start.go:494] detecting cgroup driver to use...
I0214 04:20:58.488423 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:58.506634 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:58.521226 1548589 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:58.521315 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:58.536720 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:58.549326 1548589 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:58.661636 1548589 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:58.783909 1548589 docker.go:233] disabling docker service ...
I0214 04:20:58.784000 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:58.796379 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:58.807498 1548589 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:58.924871 1548589 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:59.041964 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:59.055151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:59.082093 1548589 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:59.082175 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.095126 1548589 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:59.095227 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.104759 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.117356 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.126315 1548589 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:59.135891 1548589 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:59.146513 1548589 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:59.146572 1548589 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:59.162055 1548589 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:59.172668 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:59.323690 1548589 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:59.554209 1548589 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:59.554296 1548589 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:59.559401 1548589 start.go:562] Will wait 60s for crictl version
I0214 04:20:59.559471 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:20:59.563786 1548589 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:59.606476 1548589 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:59.606583 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.676861 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.739175 1548589 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:55.532872 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:20:55.548094 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:20:55.582319 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:20:55.595384 1548416 system_pods.go:59] 8 kube-system pods found
I0214 04:20:55.595415 1548416 system_pods.go:61] "coredns-5dd5756b68-4njjf" [3526e55f-d197-40a9-a939-bdc324aa0214] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:20:55.595422 1548416 system_pods.go:61] "etcd-embed-certs-722906" [cc60420b-dd77-4385-86f9-d2ddaa5a9b22] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:20:55.595429 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [850aef3c-4402-4e33-a81d-2d4bd97c5503] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:20:55.595435 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [5f2cc407-f67a-4779-ab0d-1a739e070df4] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:20:55.595443 1548416 system_pods.go:61] "kube-proxy-4wk86" [de0506d7-756a-4ce1-ab3c-54aaf8c041ad] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:20:55.595449 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [05db3b4a-941a-4aaf-88e3-35ec35176042] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:20:55.595458 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-5nqbv" [7784c464-f718-4eb0-b9dd-ebb579ead3bc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:20:55.595464 1548416 system_pods.go:61] "storage-provisioner" [d272841c-697d-4708-bce6-6fcad0d9d2b4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:20:55.595471 1548416 system_pods.go:74] duration metric: took 13.129235ms to wait for pod list to return data ...
I0214 04:20:55.595482 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:20:55.601854 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:20:55.601918 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:20:55.601935 1548416 node_conditions.go:105] duration metric: took 6.44739ms to run NodePressure ...
I0214 04:20:55.601957 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:55.954027 1548416 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:20:55.970665 1548416 kubeadm.go:733] kubelet initialised
I0214 04:20:55.970695 1548416 kubeadm.go:734] duration metric: took 16.634129ms waiting for restarted kubelet to initialise ...
I0214 04:20:55.970708 1548416 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:20:55.978062 1548416 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:20:57.985711 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.989728 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.740766 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:59.744066 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744437 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:59.744465 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744727 1548589 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0214 04:20:59.750187 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:59.763984 1548589 kubeadm.go:877] updating cluster {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat
ion:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:59.764177 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:59.764235 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:59.814567 1548589 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:59.814655 1548589 ssh_runner.go:195] Run: which lz4
I0214 04:20:59.819563 1548589 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:59.824793 1548589 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:59.824844 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:21:01.511247 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:01.511301 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:01.665765 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": read tcp 192.168.39.1:46006->192.168.39.167:8443: read: connection reset by peer
I0214 04:20:59.770509 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.770916 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.770941 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.770880 1550044 retry.go:31] will retry after 254.3155ms: waiting for machine to come up
I0214 04:21:00.027295 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.028116 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.028281 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.028236 1550044 retry.go:31] will retry after 304.399751ms: waiting for machine to come up
I0214 04:21:00.334939 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.335679 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.335710 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.335610 1550044 retry.go:31] will retry after 495.017444ms: waiting for machine to come up
I0214 04:21:00.833716 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.834301 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.834332 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.834259 1550044 retry.go:31] will retry after 586.036153ms: waiting for machine to come up
I0214 04:21:01.422440 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:01.423042 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:01.423073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:01.423002 1550044 retry.go:31] will retry after 893.296492ms: waiting for machine to come up
I0214 04:21:02.318089 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:02.318517 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:02.318553 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:02.318444 1550044 retry.go:31] will retry after 890.603828ms: waiting for machine to come up
I0214 04:21:03.210695 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:03.211183 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:03.211219 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:03.211140 1550044 retry.go:31] will retry after 1.068479468s: waiting for machine to come up
I0214 04:21:04.281009 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:04.281818 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:04.281859 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:04.281713 1550044 retry.go:31] will retry after 1.48876639s: waiting for machine to come up
I0214 04:21:00.490145 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:00.490174 1548416 pod_ready.go:81] duration metric: took 4.512078435s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:21:00.490188 1548416 pod_ready.go:78] waiting up to 4m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:02.498108 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:04.500186 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:01.782168 1548589 crio.go:444] duration metric: took 1.962621296s to copy over tarball
I0214 04:21:01.782265 1548589 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:05.094954 1548589 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.312628523s)
I0214 04:21:05.094995 1548589 crio.go:451] duration metric: took 3.312794343s to extract the tarball
I0214 04:21:05.095005 1548589 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:05.138877 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:05.189028 1548589 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:21:05.189067 1548589 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:21:05.189079 1548589 kubeadm.go:928] updating node { 192.168.61.188 8444 v1.28.4 crio true true} ...
I0214 04:21:05.189273 1548589 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=default-k8s-diff-port-224675 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.188
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:05.189360 1548589 ssh_runner.go:195] Run: crio config
I0214 04:21:05.268931 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:05.268970 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:05.268985 1548589 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:05.269014 1548589 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.188 APIServerPort:8444 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-224675 NodeName:default-k8s-diff-port-224675 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.188"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.188 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cer
ts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:21:05.269248 1548589 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.188
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-224675"
kubeletExtraArgs:
node-ip: 192.168.61.188
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.188"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:05.269373 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:21:05.282570 1548589 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:05.282677 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:05.294227 1548589 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (328 bytes)
I0214 04:21:05.314442 1548589 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:05.335296 1548589 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0214 04:21:05.355453 1548589 ssh_runner.go:195] Run: grep 192.168.61.188 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:05.359558 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.188 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:05.374035 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:05.500958 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:05.517736 1548589 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675 for IP: 192.168.61.188
I0214 04:21:05.517761 1548589 certs.go:194] generating shared ca certs ...
I0214 04:21:05.517784 1548589 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:05.518063 1548589 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:05.518133 1548589 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:05.518149 1548589 certs.go:256] generating profile certs ...
I0214 04:21:05.518278 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/client.key
I0214 04:21:05.518378 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key.107453ef
I0214 04:21:05.518440 1548589 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key
I0214 04:21:05.518591 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:05.518663 1548589 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:05.518679 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:05.518715 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:05.518750 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:05.518786 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:05.518843 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:05.519732 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:05.563956 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:05.600031 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:05.637740 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:05.690706 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0214 04:21:05.737661 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:05.775249 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:05.808393 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:21:05.835096 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:05.859782 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:05.885907 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:05.912030 1548589 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:05.929758 1548589 ssh_runner.go:195] Run: openssl version
I0214 04:21:05.935156 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:05.945003 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949769 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949864 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.955524 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:05.965551 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:05.975674 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980561 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980621 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.986257 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:05.997315 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:06.007670 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012694 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012766 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:02.007691 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.008567 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:02.507730 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.508577 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.007700 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:03.008475 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.507127 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.797126 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.797164 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:07.797184 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.883078 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.883120 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:08.007346 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.097373 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.097412 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:08.507874 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.516200 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.516246 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:09.007697 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:09.012802 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:21:09.021792 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:21:09.021833 1548199 api_server.go:131] duration metric: took 28.01482277s to wait for apiserver health ...
I0214 04:21:09.021845 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:21:09.021853 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:09.023946 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:05.771858 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:05.772454 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:05.772494 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:05.772403 1550044 retry.go:31] will retry after 2.280902204s: waiting for machine to come up
I0214 04:21:08.054571 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:08.055138 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:08.055173 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:08.055076 1550044 retry.go:31] will retry after 1.815235532s: waiting for machine to come up
I0214 04:21:06.844839 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:07.283580 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.283613 1548416 pod_ready.go:81] duration metric: took 6.793414916s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.283638 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294673 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.294704 1548416 pod_ready.go:81] duration metric: took 11.057139ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294719 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303085 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.303113 1548416 pod_ready.go:81] duration metric: took 8.385115ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303125 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310622 1548416 pod_ready.go:92] pod "kube-proxy-4wk86" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.310649 1548416 pod_ready.go:81] duration metric: took 7.515057ms for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310661 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.323237 1548416 pod_ready.go:102] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:09.821404 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:09.821523 1548416 pod_ready.go:81] duration metric: took 2.510851991s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.821565 1548416 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:06.018693 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:06.380858 1548589 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:06.387108 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:06.393578 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:06.399652 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:06.405980 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:06.412267 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:06.419780 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:06.427216 1548589 kubeadm.go:391] StartCluster: {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration
:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:06.427363 1548589 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:06.427422 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.497747 1548589 cri.go:89] found id: ""
I0214 04:21:06.497834 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:06.516612 1548589 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:06.516658 1548589 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:06.516667 1548589 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:06.516733 1548589 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:06.529291 1548589 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:06.531168 1548589 kubeconfig.go:125] found "default-k8s-diff-port-224675" server: "https://192.168.61.188:8444"
I0214 04:21:06.535161 1548589 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:06.546663 1548589 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.61.188
I0214 04:21:06.546708 1548589 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:06.546726 1548589 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:06.546803 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.597843 1548589 cri.go:89] found id: ""
I0214 04:21:06.597935 1548589 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:06.616190 1548589 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:06.628139 1548589 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:06.628171 1548589 kubeadm.go:156] found existing configuration files:
I0214 04:21:06.628236 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I0214 04:21:06.638453 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:06.638512 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:06.648959 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I0214 04:21:06.660706 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:06.660788 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:06.671857 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I0214 04:21:06.682340 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:06.682407 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:06.692058 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I0214 04:21:06.701943 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:06.702022 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:06.711790 1548589 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:06.721996 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:06.889535 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.226025 1548589 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.336439873s)
I0214 04:21:08.226061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.459929 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.556113 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.663379 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:08.663488 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.164266 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.664203 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.163698 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.663743 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.689408 1548589 api_server.go:72] duration metric: took 2.026029304s to wait for apiserver process to appear ...
I0214 04:21:10.689439 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:10.689466 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:10.690130 1548589 api_server.go:269] stopped: https://192.168.61.188:8444/healthz: Get "https://192.168.61.188:8444/healthz": dial tcp 192.168.61.188:8444: connect: connection refused
I0214 04:21:09.025318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:09.044094 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:09.065032 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:09.077574 1548199 system_pods.go:59] 8 kube-system pods found
I0214 04:21:09.077615 1548199 system_pods.go:61] "coredns-76f75df574-kszkn" [e042e368-b6a1-481d-ac0e-a41fded08d17] Running
I0214 04:21:09.077624 1548199 system_pods.go:61] "etcd-no-preload-527067" [f9eb0545-49ea-4302-89ba-f897701543c8] Running
I0214 04:21:09.077632 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [294a622e-a6af-46f1-b011-4d932202c48c] Running
I0214 04:21:09.077641 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [cb6ca785-3638-4e5c-8950-bddb982904b4] Running
I0214 04:21:09.077648 1548199 system_pods.go:61] "kube-proxy-x55kr" [b523c872-d6f6-4522-b3f0-669b55d4784c] Running
I0214 04:21:09.077656 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [7e451830-0a27-4fa9-8ebd-36ae39aa0214] Running
I0214 04:21:09.077669 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-jq29b" [0c974098-1c0c-482e-a187-95f35842b947] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:09.077686 1548199 system_pods.go:61] "storage-provisioner" [d4ce4210-3a50-4839-9266-54a8a6725728] Running
I0214 04:21:09.077698 1548199 system_pods.go:74] duration metric: took 12.635754ms to wait for pod list to return data ...
I0214 04:21:09.077713 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:09.080917 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:09.080955 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:09.080972 1548199 node_conditions.go:105] duration metric: took 3.250174ms to run NodePressure ...
I0214 04:21:09.080995 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:09.378306 1548199 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:09.384151 1548199 retry.go:31] will retry after 170.068456ms: kubelet not initialised
I0214 04:21:09.560919 1548199 retry.go:31] will retry after 290.437429ms: kubelet not initialised
I0214 04:21:09.859277 1548199 retry.go:31] will retry after 624.738868ms: kubelet not initialised
I0214 04:21:10.492136 1548199 retry.go:31] will retry after 533.792177ms: kubelet not initialised
I0214 04:21:11.034100 1548199 retry.go:31] will retry after 1.244408489s: kubelet not initialised
I0214 04:21:09.872580 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:09.873073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:09.873109 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:09.873043 1550044 retry.go:31] will retry after 2.578927184s: waiting for machine to come up
I0214 04:21:12.454474 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:12.454906 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:12.454940 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:12.454858 1550044 retry.go:31] will retry after 3.936870017s: waiting for machine to come up
I0214 04:21:11.833118 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:14.329353 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:11.190349 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.926174 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.926304 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:14.926353 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.981084 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.981133 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:15.190448 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.196250 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.196274 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:15.690479 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.698329 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.698362 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:16.190232 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:16.195910 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:21:16.205529 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:21:16.205562 1548589 api_server.go:131] duration metric: took 5.516113354s to wait for apiserver health ...
I0214 04:21:16.205575 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:16.205584 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:16.207433 1548589 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:12.289467 1548199 retry.go:31] will retry after 1.910737554s: kubelet not initialised
I0214 04:21:14.207622 1548199 retry.go:31] will retry after 2.041648758s: kubelet not initialised
I0214 04:21:16.260641 1548199 kubeadm.go:733] kubelet initialised
I0214 04:21:16.260666 1548199 kubeadm.go:734] duration metric: took 6.882327169s waiting for restarted kubelet to initialise ...
I0214 04:21:16.260677 1548199 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.271440 1548199 pod_ready.go:78] waiting up to 4m0s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.208874 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:16.223699 1548589 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:16.242002 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:16.258621 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:21:16.258672 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:21:16.258684 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:21:16.258702 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:21:16.258720 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:21:16.258735 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:21:16.258745 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:21:16.258757 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:16.258773 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:21:16.258782 1548589 system_pods.go:74] duration metric: took 16.754069ms to wait for pod list to return data ...
I0214 04:21:16.258804 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:16.262763 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:16.262799 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:16.262812 1548589 node_conditions.go:105] duration metric: took 4.002558ms to run NodePressure ...
I0214 04:21:16.262833 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:16.517025 1548589 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:16.522602 1548589 kubeadm.go:733] kubelet initialised
I0214 04:21:16.522681 1548589 kubeadm.go:734] duration metric: took 5.568582ms waiting for restarted kubelet to initialise ...
I0214 04:21:16.522703 1548589 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.529946 1548589 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.535926 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535952 1548589 pod_ready.go:81] duration metric: took 5.972224ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.535962 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535971 1548589 pod_ready.go:78] waiting up to 4m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.541171 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541207 1548589 pod_ready.go:81] duration metric: took 5.225365ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.541221 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541229 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.546186 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546218 1548589 pod_ready.go:81] duration metric: took 4.980231ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.546231 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546239 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.646668 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646709 1548589 pod_ready.go:81] duration metric: took 100.455975ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.646726 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646735 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.049656 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049690 1548589 pod_ready.go:81] duration metric: took 402.946278ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.049704 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049713 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.445638 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445677 1548589 pod_ready.go:81] duration metric: took 395.952591ms for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.445694 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445703 1548589 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.847249 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847282 1548589 pod_ready.go:81] duration metric: took 401.569704ms for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.847311 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847322 1548589 pod_ready.go:38] duration metric: took 1.324598748s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:17.847345 1548589 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:21:17.861893 1548589 ops.go:34] apiserver oom_adj: -16
I0214 04:21:17.861926 1548589 kubeadm.go:591] duration metric: took 11.345250928s to restartPrimaryControlPlane
I0214 04:21:17.861937 1548589 kubeadm.go:393] duration metric: took 11.434732694s to StartCluster
I0214 04:21:17.861963 1548589 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.862046 1548589 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:21:17.864089 1548589 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.864357 1548589 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:21:17.866315 1548589 out.go:177] * Verifying Kubernetes components...
I0214 04:21:17.864450 1548589 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:21:17.864662 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:21:17.867813 1548589 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867813 1548589 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867893 1548589 addons.go:234] Setting addon storage-provisioner=true in "default-k8s-diff-port-224675"
W0214 04:21:17.867911 1548589 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:21:17.867931 1548589 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-224675"
I0214 04:21:17.867822 1548589 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867990 1548589 addons.go:234] Setting addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:17.867995 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
W0214 04:21:17.868002 1548589 addons.go:243] addon metrics-server should already be in state true
I0214 04:21:17.868067 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.868372 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868405 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868471 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868586 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868630 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:17.885511 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35721
I0214 04:21:17.886123 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.886736 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.886761 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.887121 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.887700 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.887744 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.888429 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36919
I0214 04:21:17.888436 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37749
I0214 04:21:17.888934 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.888943 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.889459 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889479 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889628 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889638 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889897 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.890090 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.894107 1548589 addons.go:234] Setting addon default-storageclass=true in "default-k8s-diff-port-224675"
W0214 04:21:17.894129 1548589 addons.go:243] addon default-storageclass should already be in state true
I0214 04:21:17.894158 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.894527 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.894573 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.897686 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.898250 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.898277 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.905863 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43347
I0214 04:21:17.906256 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.906706 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.906719 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.907066 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.907252 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.909082 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.912129 1548589 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:17.913850 1548589 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:17.913867 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:21:17.913882 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.913431 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41665
I0214 04:21:17.914856 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.915448 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.915472 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.916246 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.916924 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.916952 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.917227 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917496 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.917535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917782 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.917997 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.918516 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44391
I0214 04:21:17.918650 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.919229 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.919243 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.919838 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.919858 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.920242 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.921364 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.922929 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.925090 1548589 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:21:16.394555 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:16.395079 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:16.395118 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:16.395000 1550044 retry.go:31] will retry after 4.184306662s: waiting for machine to come up
I0214 04:21:17.930415 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:21:17.930435 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:21:17.930457 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.934174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934210 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.934233 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934380 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.937367 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42083
I0214 04:21:17.937375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.937552 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.937951 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.937949 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.938390 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.938405 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.938789 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.939000 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.940318 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.940561 1548589 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:17.940575 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:21:17.940588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.943188 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943558 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.943600 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943816 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.943954 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.944088 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.944168 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:18.108100 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:18.126785 1548589 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:18.199680 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:21:18.199711 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:21:18.211800 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:18.225027 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:21:18.225053 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:21:18.244323 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.244358 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:21:18.276796 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.350125 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:19.154449 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154480 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.154805 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.154827 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.154841 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154853 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.155094 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.155200 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.155172 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.163519 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.163539 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.163825 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.163880 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.561946 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.28509634s)
I0214 04:21:19.562006 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562027 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562344 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.562355 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562371 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562386 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562395 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562697 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562718 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562731 1548589 addons.go:470] Verifying addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:19.632363 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.282192396s)
I0214 04:21:19.632421 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632434 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.632756 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.632777 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.632777 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.632787 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632796 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.633163 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.633192 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.633209 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.635385 1548589 out.go:177] * Enabled addons: default-storageclass, metrics-server, storage-provisioner
I0214 04:21:16.330627 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:18.829917 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:19.636745 1548589 addons.go:505] duration metric: took 1.772300134s for enable addons: enabled=[default-storageclass metrics-server storage-provisioner]
I0214 04:21:20.130535 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:18.278986 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.279953 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.581058 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581627 1548015 main.go:141] libmachine: (old-k8s-version-960884) Found IP for machine: 192.168.72.206
I0214 04:21:20.581661 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has current primary IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581676 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserving static IP address...
I0214 04:21:20.582088 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.582127 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | skip adding static IP to network mk-old-k8s-version-960884 - found existing host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"}
I0214 04:21:20.582141 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserved static IP address: 192.168.72.206
I0214 04:21:20.582161 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting for SSH to be available...
I0214 04:21:20.582177 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Getting to WaitForSSH function...
I0214 04:21:20.584389 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584675 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.584703 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584856 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH client type: external
I0214 04:21:20.584883 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa (-rw-------)
I0214 04:21:20.584919 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.206 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:21:20.584935 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | About to run SSH command:
I0214 04:21:20.584946 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | exit 0
I0214 04:21:20.681801 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | SSH cmd err, output: <nil>:
I0214 04:21:20.682218 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetConfigRaw
I0214 04:21:20.683002 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:20.686419 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.686997 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.687032 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.687340 1548015 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/config.json ...
I0214 04:21:20.687596 1548015 machine.go:94] provisionDockerMachine start ...
I0214 04:21:20.687624 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:20.687892 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.690877 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691276 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.691307 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691491 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.691695 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.691868 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.692066 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.692276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.692587 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.692598 1548015 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:21:20.821994 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:21:20.822030 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822348 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:21:20.822383 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822629 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.825677 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826050 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.826081 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826289 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.826531 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826688 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826859 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.827085 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.827569 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.827591 1548015 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-960884 && echo "old-k8s-version-960884" | sudo tee /etc/hostname
I0214 04:21:20.970187 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-960884
I0214 04:21:20.970224 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.972969 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973418 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.973457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973649 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.973838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.973991 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.974112 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.974276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.974644 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.974663 1548015 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-960884' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-960884/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-960884' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:21:21.109947 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:21:21.109989 1548015 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:21:21.110028 1548015 buildroot.go:174] setting up certificates
I0214 04:21:21.110040 1548015 provision.go:84] configureAuth start
I0214 04:21:21.110055 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:21.110430 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:21.113401 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113720 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.113755 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.116563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.116901 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.116928 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.117065 1548015 provision.go:143] copyHostCerts
I0214 04:21:21.117136 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:21:21.117149 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:21:21.117216 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:21:21.117349 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:21:21.117363 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:21:21.117397 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:21:21.117479 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:21:21.117495 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:21:21.117525 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:21:21.117600 1548015 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-960884 san=[127.0.0.1 192.168.72.206 localhost minikube old-k8s-version-960884]
I0214 04:21:21.249602 1548015 provision.go:177] copyRemoteCerts
I0214 04:21:21.249679 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:21:21.249705 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.252629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253091 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.253120 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253338 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.253535 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.253683 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.253817 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.352374 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:21:21.376684 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0214 04:21:21.400100 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:21:21.422025 1548015 provision.go:87] duration metric: took 311.969213ms to configureAuth
I0214 04:21:21.422062 1548015 buildroot.go:189] setting minikube options for container-runtime
I0214 04:21:21.422289 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:21:21.422388 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.425363 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425732 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.425769 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425922 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.426103 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426259 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426369 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.426526 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.426855 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.426883 1548015 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:21:21.762573 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:21:21.762683 1548015 machine.go:97] duration metric: took 1.075066333s to provisionDockerMachine
I0214 04:21:21.762703 1548015 start.go:293] postStartSetup for "old-k8s-version-960884" (driver="kvm2")
I0214 04:21:21.762722 1548015 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:21:21.762772 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:21.763195 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:21:21.763254 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.766548 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.766932 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.766960 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.767123 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.767363 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.767558 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.767724 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.864283 1548015 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:21:21.869125 1548015 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:21:21.869155 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:21:21.869235 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:21:21.869404 1548015 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:21:21.869542 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:21:21.879233 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:21.901977 1548015 start.go:296] duration metric: took 139.253065ms for postStartSetup
I0214 04:21:21.902024 1548015 fix.go:56] duration metric: took 23.727695033s for fixHost
I0214 04:21:21.902051 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.904963 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905391 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.905429 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905645 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.905838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906175 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.906361 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.906733 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.906748 1548015 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:21:22.034574 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884481.977175244
I0214 04:21:22.034604 1548015 fix.go:216] guest clock: 1707884481.977175244
I0214 04:21:22.034613 1548015 fix.go:229] Guest: 2024-02-14 04:21:21.977175244 +0000 UTC Remote: 2024-02-14 04:21:21.902028761 +0000 UTC m=+362.408004482 (delta=75.146483ms)
I0214 04:21:22.034653 1548015 fix.go:200] guest clock delta is within tolerance: 75.146483ms
I0214 04:21:22.034658 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 23.860366317s
I0214 04:21:22.034685 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.034987 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:22.038178 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038662 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.038693 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038881 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039433 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039661 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039752 1548015 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:21:22.039824 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.039923 1548015 ssh_runner.go:195] Run: cat /version.json
I0214 04:21:22.039956 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.042871 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.042905 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043230 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043269 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043303 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043320 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043406 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043515 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043651 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043738 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043831 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043988 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.044088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.155962 1548015 ssh_runner.go:195] Run: systemctl --version
I0214 04:21:22.161514 1548015 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:21:22.307311 1548015 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:21:22.313795 1548015 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:21:22.313886 1548015 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:21:22.331192 1548015 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:21:22.331219 1548015 start.go:494] detecting cgroup driver to use...
I0214 04:21:22.331295 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:21:22.348525 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:21:22.360700 1548015 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:21:22.360765 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:21:22.373323 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:21:22.386326 1548015 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:21:22.500712 1548015 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:21:22.628951 1548015 docker.go:233] disabling docker service ...
I0214 04:21:22.629047 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:21:22.644389 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:21:22.656100 1548015 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:21:22.771454 1548015 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:21:22.890367 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:21:22.906025 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:21:22.923645 1548015 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0214 04:21:22.923718 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.934179 1548015 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:21:22.934261 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.945371 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.955276 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.965963 1548015 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:21:22.977213 1548015 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:21:22.987180 1548015 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:21:22.987242 1548015 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:21:23.001621 1548015 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:21:23.011279 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:23.138894 1548015 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:21:23.320312 1548015 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:21:23.320405 1548015 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:21:23.331416 1548015 start.go:562] Will wait 60s for crictl version
I0214 04:21:23.331498 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:23.336532 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:21:23.383038 1548015 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:21:23.383147 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.439429 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.497766 1548015 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.24.1 ...
I0214 04:21:23.499416 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:23.502453 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.502863 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:23.502890 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.503096 1548015 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:21:23.507846 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:23.521497 1548015 kubeadm.go:877] updating cluster {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0
s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:21:23.521668 1548015 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0214 04:21:23.521743 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:23.563000 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:23.563077 1548015 ssh_runner.go:195] Run: which lz4
I0214 04:21:23.567232 1548015 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:21:23.571918 1548015 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:21:23.571956 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0214 04:21:20.832765 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:23.331172 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:22.131519 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:24.132734 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:25.632316 1548589 node_ready.go:49] node "default-k8s-diff-port-224675" has status "Ready":"True"
I0214 04:21:25.632355 1548589 node_ready.go:38] duration metric: took 7.505537722s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:25.632378 1548589 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:25.644082 1548589 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663622 1548589 pod_ready.go:92] pod "coredns-5dd5756b68-27jph" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.663652 1548589 pod_ready.go:81] duration metric: took 19.53614ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663665 1548589 pod_ready.go:78] waiting up to 6m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684330 1548589 pod_ready.go:92] pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.684364 1548589 pod_ready.go:81] duration metric: took 20.690068ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684381 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701825 1548589 pod_ready.go:92] pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.701861 1548589 pod_ready.go:81] duration metric: took 17.469749ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701880 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720092 1548589 pod_ready.go:92] pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.720116 1548589 pod_ready.go:81] duration metric: took 18.227307ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720126 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:22.282916 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:24.790590 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:25.407536 1548015 crio.go:444] duration metric: took 1.840347288s to copy over tarball
I0214 04:21:25.407632 1548015 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:28.466951 1548015 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.059268232s)
I0214 04:21:28.466988 1548015 crio.go:451] duration metric: took 3.059413422s to extract the tarball
I0214 04:21:28.466998 1548015 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:28.508517 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:28.568984 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:28.569019 1548015 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:21:28.569089 1548015 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.569113 1548015 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.569124 1548015 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.569194 1548015 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0214 04:21:28.569261 1548015 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.569341 1548015 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.569195 1548015 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.569577 1548015 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570792 1548015 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.570765 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570822 1548015 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0214 04:21:28.570828 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.570830 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.570764 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.570777 1548015 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.570853 1548015 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.761944 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.765651 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.768487 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0214 04:21:28.777658 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.789124 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.831672 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0214 04:21:28.834241 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.835723 1548015 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0214 04:21:28.835774 1548015 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.835821 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.846042 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.894678 1548015 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0214 04:21:28.894728 1548015 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.894778 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944386 1548015 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0214 04:21:28.944443 1548015 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.944481 1548015 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0214 04:21:28.944507 1548015 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0214 04:21:28.944509 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944535 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989723 1548015 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0214 04:21:28.989774 1548015 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0214 04:21:28.989812 1548015 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.989821 1548015 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0214 04:21:28.989853 1548015 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.989779 1548015 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.989907 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989931 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989873 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989933 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:29.110089 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:29.110123 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0214 04:21:29.110142 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0214 04:21:29.110230 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0214 04:21:29.110281 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0214 04:21:29.110339 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:29.110389 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:29.250488 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0214 04:21:29.250791 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0214 04:21:29.254821 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0214 04:21:29.254967 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0214 04:21:29.255074 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0214 04:21:29.255084 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0214 04:21:29.255142 1548015 cache_images.go:92] duration metric: took 686.107956ms to LoadCachedImages
W0214 04:21:29.255222 1548015 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0: no such file or directory
I0214 04:21:29.255239 1548015 kubeadm.go:928] updating node { 192.168.72.206 8443 v1.16.0 crio true true} ...
I0214 04:21:29.255399 1548015 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-960884 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.206
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:29.255479 1548015 ssh_runner.go:195] Run: crio config
I0214 04:21:29.317891 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:29.317923 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:29.317935 1548015 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:29.317961 1548015 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.206 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-960884 NodeName:old-k8s-version-960884 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.206"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.206 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0214 04:21:29.318104 1548015 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.206
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-960884"
kubeletExtraArgs:
node-ip: 192.168.72.206
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.206"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-960884
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.72.206:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:29.318193 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0214 04:21:29.327452 1548015 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:29.327531 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:29.337200 1548015 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0214 04:21:29.352775 1548015 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:29.370691 1548015 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2181 bytes)
I0214 04:21:29.391607 1548015 ssh_runner.go:195] Run: grep 192.168.72.206 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:29.395665 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.206 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:29.409170 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:29.518566 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:29.534160 1548015 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884 for IP: 192.168.72.206
I0214 04:21:29.534202 1548015 certs.go:194] generating shared ca certs ...
I0214 04:21:29.534231 1548015 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:29.534487 1548015 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:29.534575 1548015 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:29.534595 1548015 certs.go:256] generating profile certs ...
I0214 04:21:29.534721 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/client.key
I0214 04:21:29.534813 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key.83e6709b
I0214 04:21:29.534879 1548015 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key
I0214 04:21:29.535019 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:29.535076 1548015 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:29.535089 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:29.535122 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:29.535155 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:29.535198 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:29.535265 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:29.536212 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:25.332784 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:27.830166 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:26.031649 1548589 pod_ready.go:92] pod "kube-proxy-dbkzv" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:26.031684 1548589 pod_ready.go:81] duration metric: took 311.550001ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:26.031698 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:28.040585 1548589 pod_ready.go:102] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:30.465468 1548589 pod_ready.go:92] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:30.465504 1548589 pod_ready.go:81] duration metric: took 4.433796246s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:30.465519 1548589 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:27.279574 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.552593 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.576065 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:29.714093 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:29.748054 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:29.777699 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0214 04:21:29.804606 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:29.829987 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:29.853803 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0214 04:21:29.878360 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:29.901845 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:29.926801 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:29.951044 1548015 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:29.970807 1548015 ssh_runner.go:195] Run: openssl version
I0214 04:21:29.977053 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:29.990302 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996045 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996150 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:30.002320 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:30.014065 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:30.027194 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032670 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032739 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.039164 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:30.051920 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:30.064135 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070013 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070096 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.076531 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:30.087989 1548015 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:30.094182 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:30.100653 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:30.106827 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:30.112695 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:30.118991 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:30.124783 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:30.130728 1548015 kubeadm.go:391] StartCluster: {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s M
ount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:30.130856 1548015 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:30.130920 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.172760 1548015 cri.go:89] found id: ""
I0214 04:21:30.172844 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:30.182798 1548015 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:30.182820 1548015 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:30.182833 1548015 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:30.182890 1548015 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:30.191987 1548015 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:30.193332 1548015 kubeconfig.go:125] found "old-k8s-version-960884" server: "https://192.168.72.206:8443"
I0214 04:21:30.195906 1548015 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:30.204941 1548015 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.72.206
I0214 04:21:30.204971 1548015 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:30.204983 1548015 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:30.205030 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.246746 1548015 cri.go:89] found id: ""
I0214 04:21:30.246835 1548015 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:30.265837 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:30.277949 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:30.277986 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:21:30.278049 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:21:30.287840 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:30.287899 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:30.298734 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:21:30.307885 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:30.307983 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:30.317668 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:21:30.326303 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:30.326366 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:30.335884 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:21:30.344902 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:30.345020 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:30.355826 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:30.366201 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:30.517881 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.202023 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.400048 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.491748 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.625368 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:31.625475 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.126481 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.626533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.126533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.625871 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.658063 1548015 api_server.go:72] duration metric: took 2.032718395s to wait for apiserver process to appear ...
I0214 04:21:33.658096 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:33.658118 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:30.329984 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.830531 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.831590 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.475902 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.973325 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:31.780474 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.281836 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:36.284001 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.658562 1548015 api_server.go:269] stopped: https://192.168.72.206:8443/healthz: Get "https://192.168.72.206:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:38.658613 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.453628 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.453667 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:39.453686 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.476016 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.476042 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:37.330750 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.829556 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.659245 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.678800 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:39.678842 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.158920 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.165230 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:40.165286 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.659134 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.666024 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:21:40.674534 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:21:40.674571 1548015 api_server.go:131] duration metric: took 7.016466266s to wait for apiserver health ...
I0214 04:21:40.674584 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:40.674594 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:40.676474 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:36.974542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.474238 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.781991 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.280560 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:40.677823 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:40.689136 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:40.709008 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:40.719306 1548015 system_pods.go:59] 7 kube-system pods found
I0214 04:21:40.719343 1548015 system_pods.go:61] "coredns-5644d7b6d9-9ph4x" [6f0623c3-2524-4ba1-b0f2-43c8cdf5d3b2] Running
I0214 04:21:40.719350 1548015 system_pods.go:61] "etcd-old-k8s-version-960884" [6b8c8c75-cb3e-4b82-bc58-51b05ed826a7] Running
I0214 04:21:40.719357 1548015 system_pods.go:61] "kube-apiserver-old-k8s-version-960884" [2d8f7b59-3872-4499-9504-1f030e7c8094] Running
I0214 04:21:40.719364 1548015 system_pods.go:61] "kube-controller-manager-old-k8s-version-960884" [78c409e9-42ac-447c-99c6-6f9b687c2d36] Running
I0214 04:21:40.719378 1548015 system_pods.go:61] "kube-proxy-csc94" [091dfdb5-e19e-40c3-8d1a-e27448a61134] Running
I0214 04:21:40.719384 1548015 system_pods.go:61] "kube-scheduler-old-k8s-version-960884" [7cd0a53c-f839-4886-8902-95a9617c0223] Running
I0214 04:21:40.719390 1548015 system_pods.go:61] "storage-provisioner" [1531bf30-b7cb-46dd-8059-139eda59ab91] Running
I0214 04:21:40.719402 1548015 system_pods.go:74] duration metric: took 10.361661ms to wait for pod list to return data ...
I0214 04:21:40.719419 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:40.723811 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:40.723849 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:40.723864 1548015 node_conditions.go:105] duration metric: took 4.43897ms to run NodePressure ...
I0214 04:21:40.723893 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:40.977897 1548015 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:40.981121 1548015 retry.go:31] will retry after 128.555505ms: kubelet not initialised
I0214 04:21:41.115327 1548015 retry.go:31] will retry after 372.280627ms: kubelet not initialised
I0214 04:21:41.502405 1548015 retry.go:31] will retry after 313.632774ms: kubelet not initialised
I0214 04:21:41.825529 1548015 retry.go:31] will retry after 544.787289ms: kubelet not initialised
I0214 04:21:42.384758 1548015 retry.go:31] will retry after 1.43607177s: kubelet not initialised
I0214 04:21:43.832903 1548015 retry.go:31] will retry after 1.235835339s: kubelet not initialised
I0214 04:21:42.329232 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.330406 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.974395 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.477378 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:43.778781 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.778914 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.073614 1548015 retry.go:31] will retry after 4.115318211s: kubelet not initialised
I0214 04:21:49.193659 1548015 retry.go:31] will retry after 3.071167603s: kubelet not initialised
I0214 04:21:46.829802 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.331008 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:46.974416 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.473600 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:48.278392 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:50.279104 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.271827 1548015 retry.go:31] will retry after 4.905866185s: kubelet not initialised
I0214 04:21:51.331690 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.829509 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:51.973092 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.974274 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.280558 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:54.782002 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:55.278849 1548199 pod_ready.go:92] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.278875 1548199 pod_ready.go:81] duration metric: took 39.007391751s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.278887 1548199 pod_ready.go:78] waiting up to 4m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284671 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.284698 1548199 pod_ready.go:81] duration metric: took 5.804847ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284711 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289743 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.289762 1548199 pod_ready.go:81] duration metric: took 5.043413ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289770 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294751 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.294769 1548199 pod_ready.go:81] duration metric: took 4.99309ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294778 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299781 1548199 pod_ready.go:92] pod "kube-proxy-x55kr" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.299805 1548199 pod_ready.go:81] duration metric: took 5.020271ms for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299817 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677017 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.677045 1548199 pod_ready.go:81] duration metric: took 377.218998ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677059 1548199 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
I0214 04:21:57.184269 1548015 retry.go:31] will retry after 9.183740474s: kubelet not initialised
I0214 04:21:56.331498 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.828024 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:56.473208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.475219 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.974208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:57.684889 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.187231 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.829899 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.329789 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.474087 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:05.973662 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:02.683519 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:04.686765 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:06.375294 1548015 retry.go:31] will retry after 10.020373951s: kubelet not initialised
I0214 04:22:05.330250 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.829740 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.830530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.978588 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:10.473694 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.184721 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:11.185656 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.329405 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.829220 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.474366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.975443 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:13.683763 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:15.683805 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:16.402320 1548015 retry.go:31] will retry after 15.374173134s: kubelet not initialised
I0214 04:22:16.829525 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.330075 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:17.474403 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.973780 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:18.185466 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:20.186291 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.829432 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:23.834007 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.976320 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.474283 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:22.684964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.685062 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.685477 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.329169 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.329997 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.476641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.973366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:30.974012 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:29.184272 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.184459 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.781677 1548015 kubeadm.go:733] kubelet initialised
I0214 04:22:31.781704 1548015 kubeadm.go:734] duration metric: took 50.803779674s waiting for restarted kubelet to initialise ...
I0214 04:22:31.781719 1548015 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:22:31.786850 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791542 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.791560 1548015 pod_ready.go:81] duration metric: took 4.686316ms for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791568 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796485 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.796505 1548015 pod_ready.go:81] duration metric: took 4.931563ms for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796514 1548015 pod_ready.go:78] waiting up to 4m0s for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805785 1548015 pod_ready.go:92] pod "etcd-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.805802 1548015 pod_ready.go:81] duration metric: took 9.282838ms for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805810 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810054 1548015 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.810071 1548015 pod_ready.go:81] duration metric: took 4.255532ms for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810082 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182215 1548015 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.182243 1548015 pod_ready.go:81] duration metric: took 372.153995ms for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182252 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582145 1548015 pod_ready.go:92] pod "kube-proxy-csc94" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.582173 1548015 pod_ready.go:81] duration metric: took 399.915006ms for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582181 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981350 1548015 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.981378 1548015 pod_ready.go:81] duration metric: took 399.188492ms for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981415 1548015 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
I0214 04:22:30.830906 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.330140 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.473744 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.973699 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.186827 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.686309 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:34.989538 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.488713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.488883 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.828958 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.829284 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.829823 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.974025 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.473910 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.688964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.185392 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:41.989551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.487817 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.329132 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.329344 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.475040 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.972605 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.187968 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.683996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.685030 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.488902 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.489494 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.829203 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.829494 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.973991 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:49.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.685120 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.686084 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.988398 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:52.988448 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.332998 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.829030 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.979340 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.476506 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.184251 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:55.685108 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.990421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:57.488098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:59.489487 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.328826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.973425 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.973762 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.185513 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.684633 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.989929 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:04.489964 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.828826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.832159 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.473241 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:03.474787 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.474970 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.685927 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.184376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:06.494093 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:08.989439 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.328777 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.828637 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.829373 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.973237 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.975687 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.184628 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.184711 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.187647 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.488966 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.988214 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.830718 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.329069 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:12.474693 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.977568 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.189114 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:15.684342 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.490073 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.989036 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.329532 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.332792 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:17.475839 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:19.972797 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.184713 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.683768 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.489160 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.489440 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.829097 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.830033 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.830536 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.974815 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.976133 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.684285 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.685554 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:25.988251 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.988908 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.329244 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.330485 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:26.475964 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:28.982419 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.184598 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.683919 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.684156 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.991522 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:32.488915 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.829760 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.329419 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.473542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.973595 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.973745 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.685000 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.685530 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.988612 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.988713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.989808 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.829339 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:39.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.473757 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.474119 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.184045 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.185960 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.488363 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.989158 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.329290 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.329388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.975321 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.473736 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.683468 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:44.690416 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:46.489697 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:48.989092 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.829184 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.831722 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.474154 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.974446 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.184559 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.186644 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.687583 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.489421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:53.988562 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:50.329667 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.338563 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.829530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.472871 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.473807 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.184095 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.687057 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.488978 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.989503 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.829824 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.329912 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.474847 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.973570 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:00.973652 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.184086 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.488818 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.987787 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.830119 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:04.329491 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:02.973916 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.473218 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.686039 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.184833 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.988871 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.989591 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.329626 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.330752 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.973857 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.474126 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.185966 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.684238 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.489965 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.989505 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.829538 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.830552 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.834481 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.973081 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.474984 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.686130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.184428 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.989770 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.488555 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.828863 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.974045 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:20.474441 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.185605 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.684728 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.685632 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.988389 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.989011 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.491174 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.829015 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:23.830388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:22.974348 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:25.473908 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.183571 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.184732 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.989443 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:29.489238 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.329468 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.829440 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:27.973912 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.472580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.184943 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.684148 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.489461 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.989426 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.328521 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.474634 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:34.476234 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.684963 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.185485 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.488685 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.489813 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.829187 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.829640 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.973580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.974641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.684542 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.186898 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.490022 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.988898 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.328976 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.329745 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.829057 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:41.473013 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:43.473476 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:45.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.683866 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.684597 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:46.687189 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.994614 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.489146 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.329572 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.831061 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.474959 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.973243 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.187340 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.684163 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.988804 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.989029 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.489969 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.328728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.328898 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.473423 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.975259 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.184131 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.184881 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.490033 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.989280 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.329901 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.827955 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:57.473867 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:59.973370 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.684729 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.684873 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.487690 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.988399 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.828728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:02.829737 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.973785 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:04.472611 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.183568 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.184388 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.988477 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.989996 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.329020 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.829709 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.821931 1548416 pod_ready.go:81] duration metric: took 4m0.000330437s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
E0214 04:25:09.821969 1548416 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:09.821992 1548416 pod_ready.go:38] duration metric: took 4m13.851272943s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:09.822023 1548416 kubeadm.go:591] duration metric: took 4m23.487018823s to restartPrimaryControlPlane
W0214 04:25:09.822227 1548416 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:09.822321 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:06.472962 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:08.473224 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.475222 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.184478 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.185147 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:11.186402 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.490868 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.989663 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.974982 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.472802 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:13.187130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.685270 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.489955 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.988265 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.473792 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:19.974720 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:18.185036 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:20.687587 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.917450 1548416 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (14.095094363s)
I0214 04:25:23.917578 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:23.933147 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:25:23.944003 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:25:23.954648 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:25:23.954670 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:25:23.954721 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:25:23.964628 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:25:23.964687 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:25:23.975077 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:25:23.985324 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:25:23.985395 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:25:23.994917 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:25:24.003630 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:25:24.003677 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:25:24.012938 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:25:24.021462 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:25:24.021516 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:25:24.030687 1548416 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:25:24.084345 1548416 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:25:24.084459 1548416 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:25:24.247090 1548416 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:25:24.247242 1548416 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:25:24.247374 1548416 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:25:24.485795 1548416 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:25:19.988669 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:21.988724 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.989786 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.487801 1548416 out.go:204] - Generating certificates and keys ...
I0214 04:25:24.487929 1548416 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:25:24.488045 1548416 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:25:24.488156 1548416 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:25:24.488237 1548416 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:25:24.488319 1548416 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:25:24.488383 1548416 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:25:24.488535 1548416 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:25:24.489833 1548416 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:25:24.491055 1548416 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:25:24.492160 1548416 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:25:24.492954 1548416 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:25:24.493057 1548416 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:25:24.698026 1548416 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:25:24.804410 1548416 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:25:24.911827 1548416 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:25:25.071754 1548416 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:25:25.072362 1548416 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:25:25.074829 1548416 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:25:25.076806 1548416 out.go:204] - Booting up control plane ...
I0214 04:25:25.076910 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:25:25.077012 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:25:25.077429 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:25:25.093739 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:25:25.094504 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:25:25.094594 1548416 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:25:25.245976 1548416 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:25:22.473854 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.474402 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.183996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:25.186464 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.489150 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.489653 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.974174 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.975072 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.473411 1548589 pod_ready.go:81] duration metric: took 4m0.007878225s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:25:30.473436 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0214 04:25:30.473443 1548589 pod_ready.go:38] duration metric: took 4m4.841053907s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:30.473469 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:30.473534 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:30.473603 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:30.529327 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:30.529352 1548589 cri.go:89] found id: ""
I0214 04:25:30.529362 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:30.529463 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.538030 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:30.538092 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:30.589897 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:30.589925 1548589 cri.go:89] found id: ""
I0214 04:25:30.589936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:30.590005 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.595536 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:30.595652 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:30.650191 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:30.650224 1548589 cri.go:89] found id: ""
I0214 04:25:30.650235 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:30.650305 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.666693 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:30.666780 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:30.725870 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:30.725896 1548589 cri.go:89] found id: ""
I0214 04:25:30.725906 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:30.725982 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.731165 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:30.731252 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:30.772330 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:30.772361 1548589 cri.go:89] found id: ""
I0214 04:25:30.772372 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:30.772432 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.777656 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:30.777735 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:30.825727 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:30.825760 1548589 cri.go:89] found id: ""
I0214 04:25:30.825771 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:30.825849 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.830555 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:30.830636 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:30.885427 1548589 cri.go:89] found id: ""
I0214 04:25:30.885461 1548589 logs.go:276] 0 containers: []
W0214 04:25:30.885471 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:30.885480 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:30.885549 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:30.932894 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:30.932928 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:30.932935 1548589 cri.go:89] found id: ""
I0214 04:25:30.932945 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:30.933011 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.937903 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.941946 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:30.941972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:30.957244 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:30.957298 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:31.006421 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:31.006469 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:27.687719 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.184052 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:33.251700 1548416 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.005690 seconds
I0214 04:25:33.251865 1548416 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:25:33.279172 1548416 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:25:33.813646 1548416 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:25:33.813879 1548416 kubeadm.go:309] [mark-control-plane] Marking the node embed-certs-722906 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:25:34.330117 1548416 kubeadm.go:309] [bootstrap-token] Using token: ljwfse.zvxgc1v12nz5i5q8
I0214 04:25:30.490723 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:32.490888 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.331680 1548416 out.go:204] - Configuring RBAC rules ...
I0214 04:25:34.331854 1548416 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:25:34.338019 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:25:34.346414 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:25:34.356280 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:25:34.363364 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:25:34.367537 1548416 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:25:34.386334 1548416 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:25:34.635264 1548416 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:25:34.746128 1548416 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:25:34.747640 1548416 kubeadm.go:309]
I0214 04:25:34.747718 1548416 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:25:34.747729 1548416 kubeadm.go:309]
I0214 04:25:34.747815 1548416 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:25:34.747825 1548416 kubeadm.go:309]
I0214 04:25:34.747855 1548416 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:25:34.747919 1548416 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:25:34.747991 1548416 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:25:34.748001 1548416 kubeadm.go:309]
I0214 04:25:34.748053 1548416 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:25:34.748057 1548416 kubeadm.go:309]
I0214 04:25:34.748096 1548416 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:25:34.748102 1548416 kubeadm.go:309]
I0214 04:25:34.748166 1548416 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:25:34.748221 1548416 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:25:34.748286 1548416 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:25:34.748293 1548416 kubeadm.go:309]
I0214 04:25:34.748388 1548416 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:25:34.748476 1548416 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:25:34.748483 1548416 kubeadm.go:309]
I0214 04:25:34.748576 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748694 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:25:34.748719 1548416 kubeadm.go:309] --control-plane
I0214 04:25:34.748725 1548416 kubeadm.go:309]
I0214 04:25:34.748824 1548416 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:25:34.748831 1548416 kubeadm.go:309]
I0214 04:25:34.748897 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748999 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:25:34.752065 1548416 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:25:34.752103 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:25:34.752116 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:25:34.753766 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:25:34.754902 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:25:34.796511 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:25:34.854873 1548416 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:25:34.855010 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:34.855147 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-722906 minikube.k8s.io/updated_at=2024_02_14T04_25_34_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=embed-certs-722906 minikube.k8s.io/primary=true
I0214 04:25:34.950220 1548416 ops.go:34] apiserver oom_adj: -16
I0214 04:25:35.202083 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:31.057754 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:31.057788 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:31.119551 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:31.119592 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:31.180933 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:31.180972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:31.236512 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:31.236559 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:31.290709 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:31.290749 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:31.343989 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:31.344029 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:31.391042 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:31.391076 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:31.436728 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:31.436768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:31.924773 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:31.924835 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:32.076912 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:32.076958 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.634522 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:34.660761 1548589 api_server.go:72] duration metric: took 4m16.796363202s to wait for apiserver process to appear ...
I0214 04:25:34.660794 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:34.660846 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:34.660918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:34.730857 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.730891 1548589 cri.go:89] found id: ""
I0214 04:25:34.730902 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:34.730963 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.735849 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:34.735918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:34.791895 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:34.791926 1548589 cri.go:89] found id: ""
I0214 04:25:34.791936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:34.791999 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.798706 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:34.798792 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:34.848256 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:34.848280 1548589 cri.go:89] found id: ""
I0214 04:25:34.848288 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:34.848339 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.853629 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:34.853699 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:34.908476 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:34.908509 1548589 cri.go:89] found id: ""
I0214 04:25:34.908521 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:34.908586 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.913799 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:34.913881 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:34.956647 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:34.956733 1548589 cri.go:89] found id: ""
I0214 04:25:34.956747 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:34.956799 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.961972 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:34.962058 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:35.005734 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.005763 1548589 cri.go:89] found id: ""
I0214 04:25:35.005772 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:35.005824 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.012134 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:35.012215 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:35.057761 1548589 cri.go:89] found id: ""
I0214 04:25:35.057788 1548589 logs.go:276] 0 containers: []
W0214 04:25:35.057795 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:35.057801 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:35.057902 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:35.100965 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.100992 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.100996 1548589 cri.go:89] found id: ""
I0214 04:25:35.101003 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:35.101058 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.105885 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.110123 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:35.110151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:35.189435 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:35.189477 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:35.206289 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:35.206328 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:35.263399 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:35.263450 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.329373 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:35.329410 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.370980 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:35.371016 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:35.519971 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:35.520010 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.565453 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:35.565488 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:35.622596 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:35.622626 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:35.679526 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:35.679563 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:35.726343 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:35.726386 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:35.774533 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:35.774578 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:35.819726 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:35.819758 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:32.186812 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.686565 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.989832 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:37.489923 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:35.702927 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.203043 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.702176 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.203031 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.702509 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.203045 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.703098 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.203120 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.702193 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:40.202469 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.718371 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:25:38.726571 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:25:38.728501 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:25:38.728531 1548589 api_server.go:131] duration metric: took 4.067727996s to wait for apiserver health ...
I0214 04:25:38.728543 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:38.728574 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:38.728639 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:38.777478 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:38.777506 1548589 cri.go:89] found id: ""
I0214 04:25:38.777516 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:38.777582 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.785109 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:38.785170 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:38.829370 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:38.829398 1548589 cri.go:89] found id: ""
I0214 04:25:38.829409 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:38.829475 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.834285 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:38.834359 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:38.879921 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:38.879967 1548589 cri.go:89] found id: ""
I0214 04:25:38.879978 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:38.880045 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.884937 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:38.884994 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:38.929638 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:38.929663 1548589 cri.go:89] found id: ""
I0214 04:25:38.929672 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:38.929739 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.934420 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:38.934485 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:38.982428 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:38.982464 1548589 cri.go:89] found id: ""
I0214 04:25:38.982476 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:38.982541 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.987942 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:38.988014 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:39.027009 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:39.027041 1548589 cri.go:89] found id: ""
I0214 04:25:39.027051 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:39.027115 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.031258 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:39.031312 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:39.074333 1548589 cri.go:89] found id: ""
I0214 04:25:39.074363 1548589 logs.go:276] 0 containers: []
W0214 04:25:39.074374 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:39.074382 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:39.074445 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:39.121097 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.121119 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.121125 1548589 cri.go:89] found id: ""
I0214 04:25:39.121132 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:39.121192 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.125559 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.129744 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:39.129768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:39.169819 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:39.169857 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:39.217193 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:39.217224 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:39.267119 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:39.267173 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:39.333382 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:39.333426 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.380541 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:39.380575 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.426020 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:39.426061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:39.787418 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:39.787471 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:39.850366 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:39.850412 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:39.970082 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:39.970127 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:40.014849 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:40.014876 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:40.064556 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:40.064597 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:40.116058 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:40.116092 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:37.187809 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:39.684638 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.642784 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:25:42.642824 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.642836 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.642847 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.642854 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.642860 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.642866 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.642876 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.642889 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.642900 1548589 system_pods.go:74] duration metric: took 3.914348976s to wait for pod list to return data ...
I0214 04:25:42.642913 1548589 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:42.647178 1548589 default_sa.go:45] found service account: "default"
I0214 04:25:42.647199 1548589 default_sa.go:55] duration metric: took 4.279291ms for default service account to be created ...
I0214 04:25:42.647208 1548589 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:42.656453 1548589 system_pods.go:86] 8 kube-system pods found
I0214 04:25:42.656474 1548589 system_pods.go:89] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.656480 1548589 system_pods.go:89] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.656485 1548589 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.656490 1548589 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.656494 1548589 system_pods.go:89] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.656498 1548589 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.656504 1548589 system_pods.go:89] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.656509 1548589 system_pods.go:89] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.656517 1548589 system_pods.go:126] duration metric: took 9.303804ms to wait for k8s-apps to be running ...
I0214 04:25:42.656523 1548589 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:42.656567 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:42.675938 1548589 system_svc.go:56] duration metric: took 19.40332ms WaitForService to wait for kubelet
I0214 04:25:42.675968 1548589 kubeadm.go:576] duration metric: took 4m24.811581461s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:42.675997 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:42.680017 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:42.680051 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:42.680099 1548589 node_conditions.go:105] duration metric: took 4.09496ms to run NodePressure ...
I0214 04:25:42.680116 1548589 start.go:240] waiting for startup goroutines ...
I0214 04:25:42.680129 1548589 start.go:245] waiting for cluster config update ...
I0214 04:25:42.680147 1548589 start.go:254] writing updated cluster config ...
I0214 04:25:42.680530 1548589 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:42.736509 1548589 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:42.739295 1548589 out.go:177] * Done! kubectl is now configured to use "default-k8s-diff-port-224675" cluster and "default" namespace by default
I0214 04:25:39.988499 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.487797 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.488009 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:40.702290 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.202214 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.702270 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.202407 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.702166 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.202987 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.702484 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.202110 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.702114 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:45.202558 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.184826 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.685376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.685510 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:45.702721 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.202291 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.703068 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.837652 1548416 kubeadm.go:1106] duration metric: took 11.982686598s to wait for elevateKubeSystemPrivileges
W0214 04:25:46.837704 1548416 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:25:46.837716 1548416 kubeadm.go:393] duration metric: took 5m0.565491944s to StartCluster
I0214 04:25:46.837742 1548416 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.837855 1548416 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:25:46.840795 1548416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.841125 1548416 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:25:46.842696 1548416 out.go:177] * Verifying Kubernetes components...
I0214 04:25:46.841205 1548416 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:25:46.841387 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:25:46.844126 1548416 addons.go:69] Setting default-storageclass=true in profile "embed-certs-722906"
I0214 04:25:46.844139 1548416 addons.go:69] Setting metrics-server=true in profile "embed-certs-722906"
I0214 04:25:46.844161 1548416 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-722906"
I0214 04:25:46.844186 1548416 addons.go:234] Setting addon metrics-server=true in "embed-certs-722906"
W0214 04:25:46.844201 1548416 addons.go:243] addon metrics-server should already be in state true
I0214 04:25:46.844238 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844126 1548416 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-722906"
I0214 04:25:46.844300 1548416 addons.go:234] Setting addon storage-provisioner=true in "embed-certs-722906"
W0214 04:25:46.844326 1548416 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:25:46.844126 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:25:46.844363 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844562 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844592 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844663 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844699 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844736 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844799 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.861369 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43067
I0214 04:25:46.861608 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41001
I0214 04:25:46.862027 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862176 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862591 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862626 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.862672 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862689 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.863022 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863215 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37963
I0214 04:25:46.863398 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863596 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.863763 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.864032 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.864056 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.864428 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.864568 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.864611 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.864955 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.865007 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.867986 1548416 addons.go:234] Setting addon default-storageclass=true in "embed-certs-722906"
W0214 04:25:46.868013 1548416 addons.go:243] addon default-storageclass should already be in state true
I0214 04:25:46.868058 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.868432 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.868487 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.881291 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39701
I0214 04:25:46.882035 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.882540 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.882555 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.883263 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34619
I0214 04:25:46.883304 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.883548 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.883717 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.884554 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.884580 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.885036 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.885241 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.885647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.885718 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35895
I0214 04:25:46.887988 1548416 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:25:46.886555 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.886681 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.889304 1548416 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:46.889318 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:25:46.889335 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.890487 1548416 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:25:46.489212 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:48.990116 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.890206 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.891625 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.891590 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:25:46.891694 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:25:46.891710 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.892169 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.892674 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893285 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.893311 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.893494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.893556 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.893583 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893734 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.893993 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.894174 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.894439 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.894862 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.894886 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.895040 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.895172 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.895286 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.895362 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.912395 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38507
I0214 04:25:46.912945 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.913571 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.913598 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.913955 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.914139 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.915701 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.915924 1548416 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:46.915936 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:25:46.915949 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.918689 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919161 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.919259 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919614 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.919795 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.919991 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.920118 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:47.174988 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:25:47.211043 1548416 node_ready.go:35] waiting up to 6m0s for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248873 1548416 node_ready.go:49] node "embed-certs-722906" has status "Ready":"True"
I0214 04:25:47.248902 1548416 node_ready.go:38] duration metric: took 37.827003ms for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248914 1548416 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:47.291049 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:47.295308 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:47.304396 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:25:47.304431 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:25:47.312577 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:47.352103 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:25:47.352142 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:25:47.652975 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:47.653009 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:25:47.701829 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:49.316545 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.106061464s)
I0214 04:25:49.397232 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397245 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.084547595s)
I0214 04:25:49.397335 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397353 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397607 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397715 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397743 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397752 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397771 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397807 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397824 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397839 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397694 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.397987 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.398013 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398033 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.398118 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398132 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.454369 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.454395 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.454743 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.454768 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.658753 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.956862479s)
I0214 04:25:49.658827 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.658845 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659187 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659205 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659217 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.659226 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659474 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659492 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659501 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.659504 1548416 addons.go:470] Verifying addon metrics-server=true in "embed-certs-722906"
I0214 04:25:49.662582 1548416 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:25:49.664096 1548416 addons.go:505] duration metric: took 2.82289258s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:25:48.687996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:51.185303 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:50.303857 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:50.303890 1548416 pod_ready.go:81] duration metric: took 3.008544941s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:50.303906 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312602 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.312630 1548416 pod_ready.go:81] duration metric: took 1.008715179s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312643 1548416 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318888 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.318913 1548416 pod_ready.go:81] duration metric: took 6.260888ms for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318925 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326339 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.326358 1548416 pod_ready.go:81] duration metric: took 7.425473ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326366 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336131 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.336157 1548416 pod_ready.go:81] duration metric: took 9.784766ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336170 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344427 1548416 pod_ready.go:92] pod "kube-proxy-tzpr9" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.344452 1548416 pod_ready.go:81] duration metric: took 1.008276095s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344461 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703142 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.703165 1548416 pod_ready.go:81] duration metric: took 358.6975ms for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703173 1548416 pod_ready.go:38] duration metric: took 5.454247611s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:52.703187 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:52.703240 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:52.721042 1548416 api_server.go:72] duration metric: took 5.879877619s to wait for apiserver process to appear ...
I0214 04:25:52.721069 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:52.721091 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:25:52.727234 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:25:52.728584 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:25:52.728607 1548416 api_server.go:131] duration metric: took 7.530707ms to wait for apiserver health ...
I0214 04:25:52.728617 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:52.905660 1548416 system_pods.go:59] 9 kube-system pods found
I0214 04:25:52.905694 1548416 system_pods.go:61] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:52.905702 1548416 system_pods.go:61] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:52.905709 1548416 system_pods.go:61] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:52.905714 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:52.905719 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:52.905724 1548416 system_pods.go:61] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:52.905731 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:52.905740 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:52.905753 1548416 system_pods.go:61] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:52.905764 1548416 system_pods.go:74] duration metric: took 177.140213ms to wait for pod list to return data ...
I0214 04:25:52.905777 1548416 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:53.100558 1548416 default_sa.go:45] found service account: "default"
I0214 04:25:53.100586 1548416 default_sa.go:55] duration metric: took 194.801355ms for default service account to be created ...
I0214 04:25:53.100596 1548416 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:53.304778 1548416 system_pods.go:86] 9 kube-system pods found
I0214 04:25:53.304808 1548416 system_pods.go:89] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:53.304814 1548416 system_pods.go:89] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:53.304818 1548416 system_pods.go:89] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:53.304822 1548416 system_pods.go:89] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:53.304826 1548416 system_pods.go:89] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:53.304830 1548416 system_pods.go:89] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:53.304836 1548416 system_pods.go:89] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:53.304843 1548416 system_pods.go:89] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:53.304848 1548416 system_pods.go:89] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:53.304857 1548416 system_pods.go:126] duration metric: took 204.2556ms to wait for k8s-apps to be running ...
I0214 04:25:53.304863 1548416 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:53.304908 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:53.321806 1548416 system_svc.go:56] duration metric: took 16.912625ms WaitForService to wait for kubelet
I0214 04:25:53.321844 1548416 kubeadm.go:576] duration metric: took 6.480687176s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:53.321873 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:53.501541 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:53.501571 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:53.501582 1548416 node_conditions.go:105] duration metric: took 179.703171ms to run NodePressure ...
I0214 04:25:53.501593 1548416 start.go:240] waiting for startup goroutines ...
I0214 04:25:53.501600 1548416 start.go:245] waiting for cluster config update ...
I0214 04:25:53.501610 1548416 start.go:254] writing updated cluster config ...
I0214 04:25:53.501868 1548416 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:53.554017 1548416 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:53.556089 1548416 out.go:177] * Done! kubectl is now configured to use "embed-certs-722906" cluster and "default" namespace by default
I0214 04:25:51.488936 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.988506 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.686041 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:55.677854 1548199 pod_ready.go:81] duration metric: took 4m0.000776482s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
E0214 04:25:55.677886 1548199 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:55.677908 1548199 pod_ready.go:38] duration metric: took 4m39.417217273s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:55.677936 1548199 kubeadm.go:591] duration metric: took 5m19.120995318s to restartPrimaryControlPlane
W0214 04:25:55.678003 1548199 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:55.678033 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:55.989446 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:58.490001 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:00.989098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:03.488351 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:05.491080 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:07.990103 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:09.129870 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (13.451791169s)
I0214 04:26:09.129957 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:09.143478 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:09.153419 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:09.162505 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:09.162527 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:26:09.162576 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:09.171259 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:09.171322 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:09.179961 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:09.188272 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:09.188334 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:09.197398 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:09.206885 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:09.206953 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:09.215702 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:09.224447 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:09.224504 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:09.233076 1548199 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:26:09.449400 1548199 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:10.489135 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:12.490085 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:14.989284 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:16.989501 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:19.489121 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:20.589989 1548199 kubeadm.go:309] [init] Using Kubernetes version: v1.29.0-rc.2
I0214 04:26:20.590079 1548199 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:20.590160 1548199 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:20.590282 1548199 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:20.590404 1548199 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:20.590459 1548199 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:20.592006 1548199 out.go:204] - Generating certificates and keys ...
I0214 04:26:20.592122 1548199 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:20.592229 1548199 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:20.592338 1548199 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:20.592403 1548199 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:20.592503 1548199 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:20.592599 1548199 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:20.592693 1548199 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:20.592787 1548199 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:20.592902 1548199 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:20.592997 1548199 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:20.593045 1548199 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:20.593123 1548199 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:20.593198 1548199 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:20.593294 1548199 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0214 04:26:20.593365 1548199 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:20.593442 1548199 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:20.593534 1548199 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:20.593660 1548199 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:20.593761 1548199 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:20.595405 1548199 out.go:204] - Booting up control plane ...
I0214 04:26:20.595518 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:20.595632 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:20.595748 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:20.595890 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:20.596009 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:20.596086 1548199 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:26:20.596252 1548199 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:20.596349 1548199 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.003185 seconds
I0214 04:26:20.596497 1548199 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:20.596673 1548199 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:20.596762 1548199 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:20.597019 1548199 kubeadm.go:309] [mark-control-plane] Marking the node no-preload-527067 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:26:20.597103 1548199 kubeadm.go:309] [bootstrap-token] Using token: yl18az.ikdg7kzcuqfvy8ic
I0214 04:26:20.598756 1548199 out.go:204] - Configuring RBAC rules ...
I0214 04:26:20.598884 1548199 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:20.598995 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:26:20.599173 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:20.599325 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:20.599486 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:20.599606 1548199 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:20.599753 1548199 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:26:20.599838 1548199 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:20.599907 1548199 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:20.599918 1548199 kubeadm.go:309]
I0214 04:26:20.599999 1548199 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:20.600014 1548199 kubeadm.go:309]
I0214 04:26:20.600130 1548199 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:20.600144 1548199 kubeadm.go:309]
I0214 04:26:20.600185 1548199 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:20.600262 1548199 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:20.600334 1548199 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:20.600344 1548199 kubeadm.go:309]
I0214 04:26:20.600414 1548199 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:26:20.600423 1548199 kubeadm.go:309]
I0214 04:26:20.600486 1548199 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:26:20.600494 1548199 kubeadm.go:309]
I0214 04:26:20.600559 1548199 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:20.600678 1548199 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:20.600743 1548199 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:20.600749 1548199 kubeadm.go:309]
I0214 04:26:20.600828 1548199 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:20.600931 1548199 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:20.600952 1548199 kubeadm.go:309]
I0214 04:26:20.601036 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601125 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:20.601144 1548199 kubeadm.go:309] --control-plane
I0214 04:26:20.601149 1548199 kubeadm.go:309]
I0214 04:26:20.601216 1548199 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:20.601222 1548199 kubeadm.go:309]
I0214 04:26:20.601302 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601453 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:20.601475 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:26:20.601488 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:20.603974 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:20.605318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:20.625217 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:20.665755 1548199 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:20.665828 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:20.665845 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes no-preload-527067 minikube.k8s.io/updated_at=2024_02_14T04_26_20_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=no-preload-527067 minikube.k8s.io/primary=true
I0214 04:26:20.978111 1548199 ops.go:34] apiserver oom_adj: -16
I0214 04:26:20.978350 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.478785 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.490359 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:23.988822 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:21.979082 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.478676 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.978647 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.479016 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.979139 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.478469 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.979026 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.478991 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.979248 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:26.478422 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.989074 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:28.488567 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:26.978971 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.478678 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.978661 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.479360 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.978439 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.479419 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.978677 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.478657 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.979294 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:31.478514 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.489293 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.490551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.982429 1548015 pod_ready.go:81] duration metric: took 4m0.000999321s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
E0214 04:26:32.982455 1548015 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:26:32.982485 1548015 pod_ready.go:38] duration metric: took 4m1.20075372s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:32.982524 1548015 kubeadm.go:591] duration metric: took 5m2.799685673s to restartPrimaryControlPlane
W0214 04:26:32.982589 1548015 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:26:32.982617 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:26:31.979099 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.478987 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.979077 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.479009 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.979314 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.478489 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.612101 1548199 kubeadm.go:1106] duration metric: took 13.946337661s to wait for elevateKubeSystemPrivileges
W0214 04:26:34.612159 1548199 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:26:34.612171 1548199 kubeadm.go:393] duration metric: took 5m58.102428414s to StartCluster
I0214 04:26:34.612196 1548199 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.612300 1548199 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:26:34.615005 1548199 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.615369 1548199 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:26:34.617155 1548199 out.go:177] * Verifying Kubernetes components...
I0214 04:26:34.615466 1548199 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:26:34.615560 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:26:34.618768 1548199 addons.go:69] Setting storage-provisioner=true in profile "no-preload-527067"
I0214 04:26:34.618791 1548199 addons.go:69] Setting metrics-server=true in profile "no-preload-527067"
I0214 04:26:34.618813 1548199 addons.go:234] Setting addon storage-provisioner=true in "no-preload-527067"
I0214 04:26:34.618820 1548199 addons.go:234] Setting addon metrics-server=true in "no-preload-527067"
W0214 04:26:34.618825 1548199 addons.go:243] addon storage-provisioner should already be in state true
W0214 04:26:34.618829 1548199 addons.go:243] addon metrics-server should already be in state true
I0214 04:26:34.618772 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:26:34.618884 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618886 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618775 1548199 addons.go:69] Setting default-storageclass=true in profile "no-preload-527067"
I0214 04:26:34.618993 1548199 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-527067"
I0214 04:26:34.619298 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619308 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619333 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619337 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619341 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619372 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.640257 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32983
I0214 04:26:34.640580 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36149
I0214 04:26:34.640597 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39493
I0214 04:26:34.640873 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.640987 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641373 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641523 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641545 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.641583 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641611 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642323 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642329 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642423 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.642449 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642627 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.642851 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.643118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643159 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.643410 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643444 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.646798 1548199 addons.go:234] Setting addon default-storageclass=true in "no-preload-527067"
W0214 04:26:34.646822 1548199 addons.go:243] addon default-storageclass should already be in state true
I0214 04:26:34.646854 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.647219 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.647255 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.661218 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42977
I0214 04:26:34.661948 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.662433 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.662460 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.662620 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33585
I0214 04:26:34.662742 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43125
I0214 04:26:34.662815 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.662980 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.663003 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663243 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663722 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663743 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.663678 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663990 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.664043 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664472 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664637 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.664688 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.664751 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.665180 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.667379 1548199 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:26:34.668945 1548199 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:34.668969 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:26:34.668989 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.666787 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.670977 1548199 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:26:34.672956 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:26:34.672975 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:26:34.672994 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.673016 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.672384 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673068 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.673095 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673204 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.673357 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.673524 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.676340 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.676867 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.676922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.677027 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.677226 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.677799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.677995 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.688291 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46577
I0214 04:26:34.688787 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.689408 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.689428 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.689974 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.690207 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.691884 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.692131 1548199 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:34.692145 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:26:34.692161 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.695649 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696104 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.696127 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696274 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.696463 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.696600 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.696724 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.961474 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:26:34.991187 1548199 node_ready.go:35] waiting up to 6m0s for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001485 1548199 node_ready.go:49] node "no-preload-527067" has status "Ready":"True"
I0214 04:26:35.001505 1548199 node_ready.go:38] duration metric: took 10.286336ms for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001515 1548199 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:35.008527 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:35.194026 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:26:35.194058 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:26:35.195705 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:35.220973 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:35.241307 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:26:35.241374 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:26:35.312068 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:35.312103 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:26:35.375420 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169901 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170341 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170364 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170376 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170386 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170395 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170472 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170493 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170504 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170514 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170906 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170927 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170931 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170961 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170970 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.240387 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.240440 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.240813 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.240831 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365401 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365431 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.365774 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.365798 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365808 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.365814 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365836 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.366107 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.366128 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.366141 1548199 addons.go:470] Verifying addon metrics-server=true in "no-preload-527067"
I0214 04:26:36.367846 1548199 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:26:36.369323 1548199 addons.go:505] duration metric: took 1.753864307s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:26:37.042437 1548199 pod_ready.go:102] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:38.019213 1548199 pod_ready.go:92] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.019249 1548199 pod_ready.go:81] duration metric: took 3.010693835s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.019263 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027650 1548199 pod_ready.go:92] pod "coredns-76f75df574-m2q5f" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.027677 1548199 pod_ready.go:81] duration metric: took 8.406148ms for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027690 1548199 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.033993 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.034019 1548199 pod_ready.go:81] duration metric: took 6.321413ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.034028 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042724 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.042759 1548199 pod_ready.go:81] duration metric: took 8.716807ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042772 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050793 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.050819 1548199 pod_ready.go:81] duration metric: took 8.039526ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050828 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213505 1548199 pod_ready.go:92] pod "kube-proxy-66w6n" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.213536 1548199 pod_ready.go:81] duration metric: took 1.162700616s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213550 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613918 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.613945 1548199 pod_ready.go:81] duration metric: took 400.387683ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613953 1548199 pod_ready.go:38] duration metric: took 4.6124289s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:39.613972 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:26:39.614036 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:26:39.630218 1548199 api_server.go:72] duration metric: took 5.014782329s to wait for apiserver process to appear ...
I0214 04:26:39.630255 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:26:39.630286 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:26:39.637180 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:26:39.638716 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:26:39.638768 1548199 api_server.go:131] duration metric: took 8.502857ms to wait for apiserver health ...
I0214 04:26:39.638776 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:26:39.824405 1548199 system_pods.go:59] 9 kube-system pods found
I0214 04:26:39.824444 1548199 system_pods.go:61] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:39.824452 1548199 system_pods.go:61] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:39.824459 1548199 system_pods.go:61] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:39.824466 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:39.824473 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:39.824480 1548199 system_pods.go:61] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:39.824486 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:39.824497 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:39.824506 1548199 system_pods.go:61] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:39.824520 1548199 system_pods.go:74] duration metric: took 185.738017ms to wait for pod list to return data ...
I0214 04:26:39.824530 1548199 default_sa.go:34] waiting for default service account to be created ...
I0214 04:26:40.013391 1548199 default_sa.go:45] found service account: "default"
I0214 04:26:40.013415 1548199 default_sa.go:55] duration metric: took 188.875578ms for default service account to be created ...
I0214 04:26:40.013424 1548199 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:26:40.217587 1548199 system_pods.go:86] 9 kube-system pods found
I0214 04:26:40.217616 1548199 system_pods.go:89] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:40.217622 1548199 system_pods.go:89] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:40.217626 1548199 system_pods.go:89] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:40.217630 1548199 system_pods.go:89] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:40.217635 1548199 system_pods.go:89] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:40.217639 1548199 system_pods.go:89] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:40.217644 1548199 system_pods.go:89] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:40.217651 1548199 system_pods.go:89] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:40.217656 1548199 system_pods.go:89] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:40.217665 1548199 system_pods.go:126] duration metric: took 204.236287ms to wait for k8s-apps to be running ...
I0214 04:26:40.217672 1548199 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:26:40.217718 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:40.234093 1548199 system_svc.go:56] duration metric: took 16.409726ms WaitForService to wait for kubelet
I0214 04:26:40.234124 1548199 kubeadm.go:576] duration metric: took 5.61871569s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:26:40.234149 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:26:40.414050 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:26:40.414083 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:26:40.414095 1548199 node_conditions.go:105] duration metric: took 179.940381ms to run NodePressure ...
I0214 04:26:40.414107 1548199 start.go:240] waiting for startup goroutines ...
I0214 04:26:40.414113 1548199 start.go:245] waiting for cluster config update ...
I0214 04:26:40.414123 1548199 start.go:254] writing updated cluster config ...
I0214 04:26:40.414399 1548199 ssh_runner.go:195] Run: rm -f paused
I0214 04:26:40.471952 1548199 start.go:599] kubectl: 1.29.1, cluster: 1.29.0-rc.2 (minor skew: 0)
I0214 04:26:40.474067 1548199 out.go:177] * Done! kubectl is now configured to use "no-preload-527067" cluster and "default" namespace by default
I0214 04:26:39.897152 1548015 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (6.91450391s)
I0214 04:26:39.897269 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:39.912739 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:39.923449 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:39.939932 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:39.939961 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:26:39.940018 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:39.953815 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:39.953883 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:39.962552 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:39.971167 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:39.971216 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:39.979864 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:39.988192 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:39.988315 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:39.997134 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:40.005722 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:40.005762 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:40.015266 1548015 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0214 04:26:40.076413 1548015 kubeadm.go:309] [init] Using Kubernetes version: v1.16.0
I0214 04:26:40.076723 1548015 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:40.230449 1548015 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:40.230618 1548015 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:40.230731 1548015 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:40.478573 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:40.479934 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:40.489997 1548015 kubeadm.go:309] [kubelet-start] Activating the kubelet service
I0214 04:26:40.644188 1548015 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:40.646342 1548015 out.go:204] - Generating certificates and keys ...
I0214 04:26:40.646467 1548015 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:40.646561 1548015 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:40.646688 1548015 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:40.646835 1548015 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:40.646956 1548015 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:40.647034 1548015 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:40.647235 1548015 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:40.647843 1548015 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:40.648304 1548015 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:40.649043 1548015 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:40.649108 1548015 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:40.649182 1548015 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:40.935104 1548015 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:41.023680 1548015 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:41.246180 1548015 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:41.346131 1548015 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:41.346986 1548015 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:41.349022 1548015 out.go:204] - Booting up control plane ...
I0214 04:26:41.349146 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:41.352956 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:41.355013 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:41.356192 1548015 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:41.359118 1548015 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:52.863670 1548015 kubeadm.go:309] [apiclient] All control plane components are healthy after 11.504059 seconds
I0214 04:26:52.863792 1548015 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:52.880996 1548015 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config-1.16" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:53.404015 1548015 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:53.404215 1548015 kubeadm.go:309] [mark-control-plane] Marking the node old-k8s-version-960884 as control-plane by adding the label "node-role.kubernetes.io/master=''"
I0214 04:26:53.916361 1548015 kubeadm.go:309] [bootstrap-token] Using token: 0ncwgq.h72unli3702wifzv
I0214 04:26:53.917805 1548015 out.go:204] - Configuring RBAC rules ...
I0214 04:26:53.917949 1548015 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:53.927093 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:53.932015 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:53.935192 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:53.938316 1548015 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:54.012603 1548015 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:54.352255 1548015 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:54.354368 1548015 kubeadm.go:309]
I0214 04:26:54.354465 1548015 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:54.354478 1548015 kubeadm.go:309]
I0214 04:26:54.354557 1548015 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:54.354569 1548015 kubeadm.go:309]
I0214 04:26:54.354605 1548015 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:54.354686 1548015 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:54.354760 1548015 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:54.354775 1548015 kubeadm.go:309]
I0214 04:26:54.354824 1548015 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:54.354894 1548015 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:54.354972 1548015 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:54.354983 1548015 kubeadm.go:309]
I0214 04:26:54.355115 1548015 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:54.355264 1548015 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:54.355276 1548015 kubeadm.go:309]
I0214 04:26:54.355393 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355557 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:54.355606 1548015 kubeadm.go:309] --control-plane
I0214 04:26:54.355613 1548015 kubeadm.go:309]
I0214 04:26:54.355679 1548015 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:54.355686 1548015 kubeadm.go:309]
I0214 04:26:54.355780 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355925 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:54.356354 1548015 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:54.356485 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:26:54.356504 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:54.358086 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:54.359624 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:54.371756 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:54.389927 1548015 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:54.390013 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes old-k8s-version-960884 minikube.k8s.io/updated_at=2024_02_14T04_26_54_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=old-k8s-version-960884 minikube.k8s.io/primary=true
I0214 04:26:54.390016 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:54.431990 1548015 ops.go:34] apiserver oom_adj: -16
I0214 04:26:54.626609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.126943 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.627715 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.127333 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.626894 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.126758 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.626794 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.127609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.627033 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.126732 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.627253 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.127445 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.627305 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.126733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.627428 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.127101 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.627112 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.127318 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.627564 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.127249 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.627430 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.127707 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.627355 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.127647 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.626733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.126735 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.627135 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.127098 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.626845 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.127164 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.627189 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.127584 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.232804 1548015 kubeadm.go:1106] duration metric: took 15.842870427s to wait for elevateKubeSystemPrivileges
W0214 04:27:10.232858 1548015 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:27:10.232867 1548015 kubeadm.go:393] duration metric: took 5m40.102162281s to StartCluster
I0214 04:27:10.232888 1548015 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.233054 1548015 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:27:10.235716 1548015 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.236044 1548015 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:27:10.237600 1548015 out.go:177] * Verifying Kubernetes components...
I0214 04:27:10.236151 1548015 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:27:10.238873 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:27:10.236262 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:27:10.237637 1548015 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-960884"
I0214 04:27:10.238984 1548015 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-960884"
W0214 04:27:10.238997 1548015 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:27:10.237648 1548015 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-960884"
I0214 04:27:10.239056 1548015 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:10.237659 1548015 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-960884"
I0214 04:27:10.239095 1548015 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-960884"
I0214 04:27:10.239028 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
W0214 04:27:10.239066 1548015 addons.go:243] addon metrics-server should already be in state true
I0214 04:27:10.239210 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.239508 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239514 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239536 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239578 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.259948 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37397
I0214 04:27:10.260188 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33423
I0214 04:27:10.260189 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41519
I0214 04:27:10.260483 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260579 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260588 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.261044 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261057 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261069 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261073 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261137 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261152 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261462 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261531 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261578 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261964 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.262091 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262123 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.262177 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262206 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.265041 1548015 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-960884"
W0214 04:27:10.265057 1548015 addons.go:243] addon default-storageclass should already be in state true
I0214 04:27:10.265079 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.265355 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.265388 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.281666 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35115
I0214 04:27:10.282244 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.282939 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.282959 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.283421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.283696 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.285726 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.287965 1548015 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:27:10.287003 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37937
I0214 04:27:10.289469 1548015 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.289494 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:27:10.289513 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.290515 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.291054 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.291066 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.291421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.291810 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.291838 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.295055 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.295588 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295834 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.296046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.296225 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.296429 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.299942 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37359
I0214 04:27:10.300312 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.300732 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.300749 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.301045 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.301234 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.303089 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.304834 1548015 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:27:10.306097 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:27:10.306115 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:27:10.306132 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.308576 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37931
I0214 04:27:10.308935 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.309498 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.309517 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.309629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.309890 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.310082 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.310137 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.310163 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.310357 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.310556 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.310953 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.311088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.311700 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.311908 1548015 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.311922 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:27:10.311935 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.315147 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315579 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.315639 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315862 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.316084 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.316268 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.316454 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.457777 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:27:10.480620 1548015 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.491995 1548015 node_ready.go:49] node "old-k8s-version-960884" has status "Ready":"True"
I0214 04:27:10.492022 1548015 node_ready.go:38] duration metric: took 11.363355ms for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.492035 1548015 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:10.497386 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:10.561045 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.584516 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.593942 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:27:10.593967 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:27:10.621414 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:27:10.621438 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:27:10.694662 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:10.694688 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:27:10.747668 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:11.306565 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306591 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306723 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306756 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306919 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.306969 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.306988 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.306996 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307152 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307075 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307244 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307255 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307265 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307062 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.307496 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307512 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307685 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307698 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.394434 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.394467 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.394790 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.394815 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523086 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523107 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523443 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.523505 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523519 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523534 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523546 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523818 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523839 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523853 1548015 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:11.525563 1548015 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:27:11.526853 1548015 addons.go:505] duration metric: took 1.290704397s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:27:12.555185 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:15.004085 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:17.005427 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:19.506364 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:20.521073 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.521097 1548015 pod_ready.go:81] duration metric: took 10.02368927s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.521114 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530815 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.530849 1548015 pod_ready.go:81] duration metric: took 9.726579ms for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530866 1548015 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.539987 1548015 pod_ready.go:92] pod "kube-proxy-4jhcb" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.540019 1548015 pod_ready.go:81] duration metric: took 9.143682ms for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.540033 1548015 pod_ready.go:38] duration metric: took 10.047982488s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:20.540055 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:27:20.540113 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:27:20.564418 1548015 api_server.go:72] duration metric: took 10.328326886s to wait for apiserver process to appear ...
I0214 04:27:20.564452 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:27:20.564478 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:27:20.573942 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:27:20.575255 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:27:20.575287 1548015 api_server.go:131] duration metric: took 10.826827ms to wait for apiserver health ...
I0214 04:27:20.575298 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:27:20.581952 1548015 system_pods.go:59] 5 kube-system pods found
I0214 04:27:20.581982 1548015 system_pods.go:61] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.581989 1548015 system_pods.go:61] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.581996 1548015 system_pods.go:61] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.582006 1548015 system_pods.go:61] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.582014 1548015 system_pods.go:61] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.582025 1548015 system_pods.go:74] duration metric: took 6.718437ms to wait for pod list to return data ...
I0214 04:27:20.582034 1548015 default_sa.go:34] waiting for default service account to be created ...
I0214 04:27:20.584695 1548015 default_sa.go:45] found service account: "default"
I0214 04:27:20.584724 1548015 default_sa.go:55] duration metric: took 2.678001ms for default service account to be created ...
I0214 04:27:20.584735 1548015 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:27:20.589847 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.589876 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.589886 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.589896 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.589912 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.589924 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.589950 1548015 retry.go:31] will retry after 248.508062ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:20.844936 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.844971 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.844977 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.844981 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.844988 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.844993 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.845010 1548015 retry.go:31] will retry after 367.089613ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.218037 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.218074 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.218082 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.218089 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.218099 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.218105 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.218126 1548015 retry.go:31] will retry after 419.193903ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.642404 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.642441 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.642447 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.642452 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.642459 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.642465 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.642483 1548015 retry.go:31] will retry after 451.345597ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.099422 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.099453 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.099459 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.099466 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.099474 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.099480 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.099499 1548015 retry.go:31] will retry after 651.082119ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.756099 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.756128 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.756134 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.756148 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.756159 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.756169 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.756189 1548015 retry.go:31] will retry after 586.140581ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:23.348131 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:23.348163 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:23.348168 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:23.348172 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:23.348178 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:23.348183 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:23.348202 1548015 retry.go:31] will retry after 870.913743ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:24.224631 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:24.224665 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:24.224674 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:24.224680 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:24.224690 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:24.224697 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:24.224719 1548015 retry.go:31] will retry after 1.13554102s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:25.365563 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:25.365593 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:25.365598 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:25.365603 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:25.365609 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:25.365614 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:25.365633 1548015 retry.go:31] will retry after 1.737635615s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:27.109613 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:27.109642 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:27.109647 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:27.109651 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:27.109657 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:27.109664 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:27.109684 1548015 retry.go:31] will retry after 1.744560644s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:28.860288 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:28.860319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:28.860327 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:28.860333 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:28.860343 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:28.860350 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:28.860372 1548015 retry.go:31] will retry after 2.781231308s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:31.647467 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:31.647509 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:31.647518 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:31.647525 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:31.647536 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:31.647543 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:31.647566 1548015 retry.go:31] will retry after 3.406936773s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:35.060683 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:35.060716 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:35.060721 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:35.060725 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:35.060735 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:35.060742 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:35.060765 1548015 retry.go:31] will retry after 3.181009478s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:38.247591 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:38.247626 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:38.247634 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:38.247639 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:38.247648 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:38.247655 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:38.247679 1548015 retry.go:31] will retry after 4.973684574s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:43.227832 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:43.227888 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:43.227896 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:43.227902 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:43.227914 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:43.227921 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:43.227947 1548015 retry.go:31] will retry after 6.269902816s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:49.502449 1548015 system_pods.go:86] 6 kube-system pods found
I0214 04:27:49.502483 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:49.502491 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:49.502497 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:49.502503 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Pending
I0214 04:27:49.502511 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:49.502518 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:49.502541 1548015 retry.go:31] will retry after 7.09681765s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:56.607786 1548015 system_pods.go:86] 7 kube-system pods found
I0214 04:27:56.607823 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:56.607833 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:56.607843 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:27:56.607850 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:56.607863 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:27:56.607878 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:56.607894 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:56.607917 1548015 retry.go:31] will retry after 9.404244714s: missing components: etcd, kube-apiserver
I0214 04:28:06.017960 1548015 system_pods.go:86] 8 kube-system pods found
I0214 04:28:06.017990 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:06.017995 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:06.017999 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Pending
I0214 04:28:06.018004 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:06.018008 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:06.018012 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:06.018018 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:06.018025 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:06.018044 1548015 retry.go:31] will retry after 13.524747575s: missing components: etcd, kube-apiserver
I0214 04:28:19.549284 1548015 system_pods.go:86] 9 kube-system pods found
I0214 04:28:19.549319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:19.549331 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:19.549337 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Running
I0214 04:28:19.549351 1548015 system_pods.go:89] "kube-apiserver-old-k8s-version-960884" [a70eef81-e29d-4b42-9bba-e396214086b6] Running
I0214 04:28:19.549357 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:19.549364 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:19.549371 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:19.549383 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:19.549394 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:19.549413 1548015 system_pods.go:126] duration metric: took 58.964669894s to wait for k8s-apps to be running ...
I0214 04:28:19.549427 1548015 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:28:19.549488 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:28:19.575300 1548015 system_svc.go:56] duration metric: took 25.86022ms WaitForService to wait for kubelet
I0214 04:28:19.575336 1548015 kubeadm.go:576] duration metric: took 1m9.339251431s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:28:19.575379 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:28:19.579124 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:28:19.579155 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:28:19.579195 1548015 node_conditions.go:105] duration metric: took 3.807562ms to run NodePressure ...
I0214 04:28:19.579211 1548015 start.go:240] waiting for startup goroutines ...
I0214 04:28:19.579226 1548015 start.go:245] waiting for cluster config update ...
I0214 04:28:19.579242 1548015 start.go:254] writing updated cluster config ...
I0214 04:28:19.579574 1548015 ssh_runner.go:195] Run: rm -f paused
I0214 04:28:19.634648 1548015 start.go:599] kubectl: 1.29.1, cluster: 1.16.0 (minor skew: 13)
I0214 04:28:19.636438 1548015 out.go:177]
W0214 04:28:19.637884 1548015 out.go:239] ! /usr/local/bin/kubectl is version 1.29.1, which may have incompatibilities with Kubernetes 1.16.0.
I0214 04:28:19.639178 1548015 out.go:177] - Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'
I0214 04:28:19.640482 1548015 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-960884" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:20:08 UTC, ends at Wed 2024-02-14 04:35:42 UTC. --
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.151228639Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885342151213551,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:97830,},InodesUsed:&UInt64Value{Value:49,},},},}" file="go-grpc-middleware/chain.go:25" id=ebf0fd78-e7c9-4203-85e9-d190fd368861 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.151782535Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=345bc0a2-8edc-4894-afed-1dd0fb4b8d38 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.151828732Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=345bc0a2-8edc-4894-afed-1dd0fb4b8d38 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.152114041Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684,PodSandboxId:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:eaba9cb00c07766583bd527cc3d4dbf002c2587dcee4952d2ee56e8562346651,State:CONTAINER_RUNNING,CreatedAt:1707884798096609424,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{io.kubernetes.container.hash: 661b70a3,io.kubernetes.container.restartCount: 0,io.kube
rnetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331,PodSandboxId:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:eba727be6ca4938cb3deec2eb6b7767e33995b2083144b23a8bbd138515b0dac,State:CONTAINER_RUNNING,CreatedAt:1707884797678437642,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,},Annotations:map[string]string{io.kubernetes.container.hash: 44829cc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09,PodSandboxId:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884797041968111,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,},Annotations:map[string]string{io.kubernetes.container.hash: ee12eb91,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-t
cp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4,PodSandboxId:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884796912060673,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8
d8d-35e0ab14f8de,},Annotations:map[string]string{io.kubernetes.container.hash: 7e31045f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b,PodSandboxId:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:a9aa934e24e72ecc1829948966f500cf16b2faa6b63de15f1b6de03cc074812f,State:CONTAINER_RUNNING,CreatedAt:170788477305
5775275,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,},Annotations:map[string]string{io.kubernetes.container.hash: 7d8a0274,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426,PodSandboxId:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:3,},Image:&ImageSpec{Image:d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:a5352bf791d1f99a5175e68039fe9bf100ca3dfd2400901a3a5e9bf0c8b03203,State:CONTAINER_RUNNING,CreatedAt:17078
84772932735101,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,},Annotations:map[string]string{io.kubernetes.container.hash: f18bb92e,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280,PodSandboxId:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:1d6d10016794014c57a966c3c40b351e068202efa97e3fec2d3387198e0cbad0,State:CONTAINER_RUNNING,CreatedA
t:1707884772738087522,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,},Annotations:map[string]string{io.kubernetes.container.hash: 67b5ed48,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26,PodSandboxId:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:061a72677dc6dc85cdb47cf61f4453c9be173c19c3d48e04b1d7a25f9b405fe7,State:CONTAINER_RUNNING,CreatedAt:1707884772608071364,Labels:ma
p[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,},Annotations:map[string]string{io.kubernetes.container.hash: 2d1fedde,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=345bc0a2-8edc-4894-afed-1dd0fb4b8d38 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.191859994Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=49996f02-5566-4ef6-ae65-4d31bbb07def name=/runtime.v1.RuntimeService/Version
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.192035728Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=49996f02-5566-4ef6-ae65-4d31bbb07def name=/runtime.v1.RuntimeService/Version
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.193451391Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=e67e7f6d-e6be-4796-b59b-d83a208af8a1 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.193763757Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885342193750713,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:97830,},InodesUsed:&UInt64Value{Value:49,},},},}" file="go-grpc-middleware/chain.go:25" id=e67e7f6d-e6be-4796-b59b-d83a208af8a1 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.194197811Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=42899e70-3148-488e-8d6d-f0a569e41d6d name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.194243825Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=42899e70-3148-488e-8d6d-f0a569e41d6d name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.194433977Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684,PodSandboxId:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:eaba9cb00c07766583bd527cc3d4dbf002c2587dcee4952d2ee56e8562346651,State:CONTAINER_RUNNING,CreatedAt:1707884798096609424,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{io.kubernetes.container.hash: 661b70a3,io.kubernetes.container.restartCount: 0,io.kube
rnetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331,PodSandboxId:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:eba727be6ca4938cb3deec2eb6b7767e33995b2083144b23a8bbd138515b0dac,State:CONTAINER_RUNNING,CreatedAt:1707884797678437642,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,},Annotations:map[string]string{io.kubernetes.container.hash: 44829cc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09,PodSandboxId:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884797041968111,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,},Annotations:map[string]string{io.kubernetes.container.hash: ee12eb91,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-t
cp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4,PodSandboxId:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884796912060673,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8
d8d-35e0ab14f8de,},Annotations:map[string]string{io.kubernetes.container.hash: 7e31045f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b,PodSandboxId:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:a9aa934e24e72ecc1829948966f500cf16b2faa6b63de15f1b6de03cc074812f,State:CONTAINER_RUNNING,CreatedAt:170788477305
5775275,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,},Annotations:map[string]string{io.kubernetes.container.hash: 7d8a0274,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426,PodSandboxId:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:3,},Image:&ImageSpec{Image:d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:a5352bf791d1f99a5175e68039fe9bf100ca3dfd2400901a3a5e9bf0c8b03203,State:CONTAINER_RUNNING,CreatedAt:17078
84772932735101,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,},Annotations:map[string]string{io.kubernetes.container.hash: f18bb92e,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280,PodSandboxId:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:1d6d10016794014c57a966c3c40b351e068202efa97e3fec2d3387198e0cbad0,State:CONTAINER_RUNNING,CreatedA
t:1707884772738087522,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,},Annotations:map[string]string{io.kubernetes.container.hash: 67b5ed48,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26,PodSandboxId:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:061a72677dc6dc85cdb47cf61f4453c9be173c19c3d48e04b1d7a25f9b405fe7,State:CONTAINER_RUNNING,CreatedAt:1707884772608071364,Labels:ma
p[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,},Annotations:map[string]string{io.kubernetes.container.hash: 2d1fedde,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=42899e70-3148-488e-8d6d-f0a569e41d6d name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.233457270Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=b0d3d78e-aa65-4478-b5f2-591b7a01b255 name=/runtime.v1.RuntimeService/Version
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.233512328Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=b0d3d78e-aa65-4478-b5f2-591b7a01b255 name=/runtime.v1.RuntimeService/Version
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.234664382Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=60b9aa64-eb27-4ac9-8cf0-2580499f72f8 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.235089458Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885342235070871,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:97830,},InodesUsed:&UInt64Value{Value:49,},},},}" file="go-grpc-middleware/chain.go:25" id=60b9aa64-eb27-4ac9-8cf0-2580499f72f8 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.235538861Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=f267029f-2405-4f88-b293-8ede0a1b20ea name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.235646275Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=f267029f-2405-4f88-b293-8ede0a1b20ea name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.235988486Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684,PodSandboxId:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:eaba9cb00c07766583bd527cc3d4dbf002c2587dcee4952d2ee56e8562346651,State:CONTAINER_RUNNING,CreatedAt:1707884798096609424,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{io.kubernetes.container.hash: 661b70a3,io.kubernetes.container.restartCount: 0,io.kube
rnetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331,PodSandboxId:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:eba727be6ca4938cb3deec2eb6b7767e33995b2083144b23a8bbd138515b0dac,State:CONTAINER_RUNNING,CreatedAt:1707884797678437642,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,},Annotations:map[string]string{io.kubernetes.container.hash: 44829cc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09,PodSandboxId:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884797041968111,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,},Annotations:map[string]string{io.kubernetes.container.hash: ee12eb91,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-t
cp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4,PodSandboxId:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884796912060673,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8
d8d-35e0ab14f8de,},Annotations:map[string]string{io.kubernetes.container.hash: 7e31045f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b,PodSandboxId:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:a9aa934e24e72ecc1829948966f500cf16b2faa6b63de15f1b6de03cc074812f,State:CONTAINER_RUNNING,CreatedAt:170788477305
5775275,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,},Annotations:map[string]string{io.kubernetes.container.hash: 7d8a0274,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426,PodSandboxId:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:3,},Image:&ImageSpec{Image:d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:a5352bf791d1f99a5175e68039fe9bf100ca3dfd2400901a3a5e9bf0c8b03203,State:CONTAINER_RUNNING,CreatedAt:17078
84772932735101,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,},Annotations:map[string]string{io.kubernetes.container.hash: f18bb92e,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280,PodSandboxId:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:1d6d10016794014c57a966c3c40b351e068202efa97e3fec2d3387198e0cbad0,State:CONTAINER_RUNNING,CreatedA
t:1707884772738087522,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,},Annotations:map[string]string{io.kubernetes.container.hash: 67b5ed48,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26,PodSandboxId:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:061a72677dc6dc85cdb47cf61f4453c9be173c19c3d48e04b1d7a25f9b405fe7,State:CONTAINER_RUNNING,CreatedAt:1707884772608071364,Labels:ma
p[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,},Annotations:map[string]string{io.kubernetes.container.hash: 2d1fedde,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=f267029f-2405-4f88-b293-8ede0a1b20ea name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.278255287Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=8b26f9e9-b3b4-4589-b261-ab59e20df13b name=/runtime.v1.RuntimeService/Version
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.278312346Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=8b26f9e9-b3b4-4589-b261-ab59e20df13b name=/runtime.v1.RuntimeService/Version
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.279445181Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=155e37dd-e22d-45ba-b635-8b43c8858bf6 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.279806072Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885342279790426,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:97830,},InodesUsed:&UInt64Value{Value:49,},},},}" file="go-grpc-middleware/chain.go:25" id=155e37dd-e22d-45ba-b635-8b43c8858bf6 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.281158834Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=d3343e56-1854-43c3-98c5-6f539145145c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.281216165Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=d3343e56-1854-43c3-98c5-6f539145145c name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:35:42 no-preload-527067 crio[731]: time="2024-02-14 04:35:42.281404886Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684,PodSandboxId:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:eaba9cb00c07766583bd527cc3d4dbf002c2587dcee4952d2ee56e8562346651,State:CONTAINER_RUNNING,CreatedAt:1707884798096609424,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{io.kubernetes.container.hash: 661b70a3,io.kubernetes.container.restartCount: 0,io.kube
rnetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331,PodSandboxId:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:eba727be6ca4938cb3deec2eb6b7767e33995b2083144b23a8bbd138515b0dac,State:CONTAINER_RUNNING,CreatedAt:1707884797678437642,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,},Annotations:map[string]string{io.kubernetes.container.hash: 44829cc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09,PodSandboxId:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884797041968111,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,},Annotations:map[string]string{io.kubernetes.container.hash: ee12eb91,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-t
cp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4,PodSandboxId:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884796912060673,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8
d8d-35e0ab14f8de,},Annotations:map[string]string{io.kubernetes.container.hash: 7e31045f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b,PodSandboxId:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:a9aa934e24e72ecc1829948966f500cf16b2faa6b63de15f1b6de03cc074812f,State:CONTAINER_RUNNING,CreatedAt:170788477305
5775275,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,},Annotations:map[string]string{io.kubernetes.container.hash: 7d8a0274,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426,PodSandboxId:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:3,},Image:&ImageSpec{Image:d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:a5352bf791d1f99a5175e68039fe9bf100ca3dfd2400901a3a5e9bf0c8b03203,State:CONTAINER_RUNNING,CreatedAt:17078
84772932735101,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,},Annotations:map[string]string{io.kubernetes.container.hash: f18bb92e,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280,PodSandboxId:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:1d6d10016794014c57a966c3c40b351e068202efa97e3fec2d3387198e0cbad0,State:CONTAINER_RUNNING,CreatedA
t:1707884772738087522,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,},Annotations:map[string]string{io.kubernetes.container.hash: 67b5ed48,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26,PodSandboxId:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:061a72677dc6dc85cdb47cf61f4453c9be173c19c3d48e04b1d7a25f9b405fe7,State:CONTAINER_RUNNING,CreatedAt:1707884772608071364,Labels:ma
p[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,},Annotations:map[string]string{io.kubernetes.container.hash: 2d1fedde,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=d3343e56-1854-43c3-98c5-6f539145145c name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
6b7794264a9e6 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 9 minutes ago Running storage-provisioner 0 1d04d5e343d85 storage-provisioner
e0981ccfd847c cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834 9 minutes ago Running kube-proxy 0 08bc41dabd07e kube-proxy-66w6n
92ac4be8b9956 cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 9 minutes ago Running coredns 0 7730f1fd8b5a1 coredns-76f75df574-4zm9s
806377c72df58 cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 9 minutes ago Running coredns 0 ceb975adcbfba coredns-76f75df574-m2q5f
924a828e19eeb 4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210 9 minutes ago Running kube-scheduler 2 577d2f2f4c947 kube-scheduler-no-preload-527067
9a84b74b19347 d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d 9 minutes ago Running kube-controller-manager 3 14b3f04a24ffb kube-controller-manager-no-preload-527067
bc8ea9ceb189e bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f 9 minutes ago Running kube-apiserver 3 e35ac772147d2 kube-apiserver-no-preload-527067
ec7eb461f00f4 a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7 9 minutes ago Running etcd 2 13e9eb5c5984a etcd-no-preload-527067
==> coredns [806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.11.1
linux/amd64, go1.20.7, ae2bbc2
==> coredns [92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.11.1
linux/amd64, go1.20.7, ae2bbc2
==> describe nodes <==
Name: no-preload-527067
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=no-preload-527067
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=no-preload-527067
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_26_20_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:26:17 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: no-preload-527067
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 04:35:41 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:31:47 +0000 Wed, 14 Feb 2024 04:26:14 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:31:47 +0000 Wed, 14 Feb 2024 04:26:14 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:31:47 +0000 Wed, 14 Feb 2024 04:26:14 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:31:47 +0000 Wed, 14 Feb 2024 04:26:30 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.167
Hostname: no-preload-527067
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 147390bdcbe54d888a0f22cbecd5e708
System UUID: 147390bd-cbe5-4d88-8a0f-22cbecd5e708
Boot ID: 390007b1-055b-4493-b72f-4532d086c028
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.29.0-rc.2
Kube-Proxy Version: v1.29.0-rc.2
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-76f75df574-4zm9s 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 9m8s
kube-system coredns-76f75df574-m2q5f 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 9m8s
kube-system etcd-no-preload-527067 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 9m22s
kube-system kube-apiserver-no-preload-527067 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m24s
kube-system kube-controller-manager-no-preload-527067 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m24s
kube-system kube-proxy-66w6n 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m8s
kube-system kube-scheduler-no-preload-527067 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m22s
kube-system metrics-server-57f55c9bc5-rkc5k 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (9%!)(MISSING) 0 (0%!)(MISSING) 9m6s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m6s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 0 (0%!)(MISSING)
memory 440Mi (20%!)(MISSING) 340Mi (16%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 9m4s kube-proxy
Normal Starting 9m31s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 9m31s (x8 over 9m31s) kubelet Node no-preload-527067 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m31s (x8 over 9m31s) kubelet Node no-preload-527067 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m31s (x7 over 9m31s) kubelet Node no-preload-527067 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 9m31s kubelet Updated Node Allocatable limit across pods
Normal Starting 9m22s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 9m22s kubelet Node no-preload-527067 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m22s kubelet Node no-preload-527067 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m22s kubelet Node no-preload-527067 status is now: NodeHasSufficientPID
Normal NodeNotReady 9m22s kubelet Node no-preload-527067 status is now: NodeNotReady
Normal NodeAllocatableEnforced 9m22s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 9m12s kubelet Node no-preload-527067 status is now: NodeReady
Normal RegisteredNode 9m9s node-controller Node no-preload-527067 event: Registered Node no-preload-527067 in Controller
==> dmesg <==
[Feb14 04:20] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.071797] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.413622] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.479112] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.151272] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.465715] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +7.198212] systemd-fstab-generator[656]: Ignoring "noauto" for root device
[ +0.096909] systemd-fstab-generator[667]: Ignoring "noauto" for root device
[ +0.131454] systemd-fstab-generator[680]: Ignoring "noauto" for root device
[ +0.126971] systemd-fstab-generator[691]: Ignoring "noauto" for root device
[ +0.230874] systemd-fstab-generator[715]: Ignoring "noauto" for root device
[ +17.021750] systemd-fstab-generator[1227]: Ignoring "noauto" for root device
[ +2.229578] systemd-fstab-generator[1351]: Ignoring "noauto" for root device
[Feb14 04:21] kauditd_printk_skb: 29 callbacks suppressed
[Feb14 04:26] systemd-fstab-generator[4067]: Ignoring "noauto" for root device
[ +9.265074] systemd-fstab-generator[4390]: Ignoring "noauto" for root device
[ +14.452403] systemd-fstab-generator[4609]: Ignoring "noauto" for root device
[ +0.418474] kauditd_printk_skb: 2 callbacks suppressed
==> etcd [ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26] <==
{"level":"info","ts":"2024-02-14T04:26:14.631364Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac switched to configuration voters=(2366053629920448428)"}
{"level":"info","ts":"2024-02-14T04:26:14.632294Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"31f708155da0e645","local-member-id":"20d5e93d92ee8fac","added-peer-id":"20d5e93d92ee8fac","added-peer-peer-urls":["https://192.168.39.167:2380"]}
{"level":"info","ts":"2024-02-14T04:26:14.64683Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-02-14T04:26:14.648033Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.39.167:2380"}
{"level":"info","ts":"2024-02-14T04:26:14.661247Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.39.167:2380"}
{"level":"info","ts":"2024-02-14T04:26:14.654817Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"20d5e93d92ee8fac","initial-advertise-peer-urls":["https://192.168.39.167:2380"],"listen-peer-urls":["https://192.168.39.167:2380"],"advertise-client-urls":["https://192.168.39.167:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.39.167:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-02-14T04:26:14.654972Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-02-14T04:26:15.549979Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac is starting a new election at term 1"}
{"level":"info","ts":"2024-02-14T04:26:15.55008Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac became pre-candidate at term 1"}
{"level":"info","ts":"2024-02-14T04:26:15.550194Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac received MsgPreVoteResp from 20d5e93d92ee8fac at term 1"}
{"level":"info","ts":"2024-02-14T04:26:15.550228Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac became candidate at term 2"}
{"level":"info","ts":"2024-02-14T04:26:15.550259Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac received MsgVoteResp from 20d5e93d92ee8fac at term 2"}
{"level":"info","ts":"2024-02-14T04:26:15.550295Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac became leader at term 2"}
{"level":"info","ts":"2024-02-14T04:26:15.550328Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 20d5e93d92ee8fac elected leader 20d5e93d92ee8fac at term 2"}
{"level":"info","ts":"2024-02-14T04:26:15.55736Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:26:15.558994Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"20d5e93d92ee8fac","local-member-attributes":"{Name:no-preload-527067 ClientURLs:[https://192.168.39.167:2379]}","request-path":"/0/members/20d5e93d92ee8fac/attributes","cluster-id":"31f708155da0e645","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T04:26:15.559264Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:26:15.572444Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:26:15.575666Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"31f708155da0e645","local-member-id":"20d5e93d92ee8fac","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:26:15.575763Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:26:15.575793Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:26:15.577524Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T04:26:15.577583Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-02-14T04:26:15.581976Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T04:26:15.603303Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.167:2379"}
==> kernel <==
04:35:42 up 15 min, 0 users, load average: 0.17, 0.34, 0.30
Linux no-preload-527067 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280] <==
I0214 04:29:37.059364 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:31:17.250308 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:31:17.250478 1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
W0214 04:31:18.250982 1 handler_proxy.go:93] no RequestInfo found in the context
W0214 04:31:18.251078 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:31:18.251145 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:31:18.251192 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
E0214 04:31:18.251220 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:31:18.252352 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:32:18.252533 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:32:18.252685 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:32:18.252695 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:32:18.252736 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:32:18.252752 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:32:18.253957 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:34:18.253004 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:34:18.253448 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:34:18.253490 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:34:18.255154 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:34:18.255228 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:34:18.255238 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
==> kube-controller-manager [9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426] <==
I0214 04:30:04.264494 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:30:33.777576 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:30:34.275107 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:31:03.783241 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:31:04.284705 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:31:33.790688 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:31:34.293539 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:32:03.796249 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:32:04.302678 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:32:33.801487 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:32:34.310746 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
I0214 04:32:40.698717 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="447.288µs"
I0214 04:32:53.698377 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="140.881µs"
E0214 04:33:03.809122 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:33:04.319621 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:33:33.815988 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:33:34.329283 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:34:03.823973 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:34:04.341245 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:34:33.829764 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:34:34.351658 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:35:03.835103 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:35:04.360704 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:35:33.841763 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:35:34.374116 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
==> kube-proxy [e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331] <==
I0214 04:26:38.203652 1 server_others.go:72] "Using iptables proxy"
I0214 04:26:38.236160 1 server.go:1050] "Successfully retrieved node IP(s)" IPs=["192.168.39.167"]
I0214 04:26:38.300786 1 server_others.go:146] "No iptables support for family" ipFamily="IPv6"
I0214 04:26:38.300865 1 server.go:654] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:26:38.300999 1 server_others.go:168] "Using iptables Proxier"
I0214 04:26:38.342214 1 proxier.go:246] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:26:38.342445 1 server.go:865] "Version info" version="v1.29.0-rc.2"
I0214 04:26:38.342458 1 server.go:867] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:26:38.344034 1 config.go:188] "Starting service config controller"
I0214 04:26:38.344125 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:26:38.344149 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:26:38.344153 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:26:38.344680 1 config.go:315] "Starting node config controller"
I0214 04:26:38.345708 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:26:38.445067 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 04:26:38.445076 1 shared_informer.go:318] Caches are synced for service config
I0214 04:26:38.446697 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b] <==
W0214 04:26:17.296720 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:26:17.297548 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 04:26:17.296755 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:17.301294 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 04:26:17.296464 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 04:26:17.301318 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0214 04:26:18.122935 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 04:26:18.123037 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 04:26:18.187992 1 reflector.go:539] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 04:26:18.188097 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
W0214 04:26:18.304456 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 04:26:18.304540 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 04:26:18.330536 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:26:18.330622 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 04:26:18.355346 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 04:26:18.355442 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0214 04:26:18.389592 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:18.389701 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 04:26:18.439174 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:26:18.439268 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 04:26:18.467123 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:26:18.467245 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0214 04:26:18.501144 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 04:26:18.501250 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
I0214 04:26:20.780782 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:20:08 UTC, ends at Wed 2024-02-14 04:35:42 UTC. --
Feb 14 04:33:07 no-preload-527067 kubelet[4397]: E0214 04:33:07.679442 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:33:20 no-preload-527067 kubelet[4397]: E0214 04:33:20.680794 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:33:20 no-preload-527067 kubelet[4397]: E0214 04:33:20.814874 4397 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:33:20 no-preload-527067 kubelet[4397]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:33:20 no-preload-527067 kubelet[4397]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:33:20 no-preload-527067 kubelet[4397]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:33:31 no-preload-527067 kubelet[4397]: E0214 04:33:31.679799 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:33:44 no-preload-527067 kubelet[4397]: E0214 04:33:44.680986 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:33:56 no-preload-527067 kubelet[4397]: E0214 04:33:56.679654 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:34:09 no-preload-527067 kubelet[4397]: E0214 04:34:09.679451 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:34:20 no-preload-527067 kubelet[4397]: E0214 04:34:20.814348 4397 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:34:20 no-preload-527067 kubelet[4397]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:34:20 no-preload-527067 kubelet[4397]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:34:20 no-preload-527067 kubelet[4397]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:34:21 no-preload-527067 kubelet[4397]: E0214 04:34:21.679939 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:34:34 no-preload-527067 kubelet[4397]: E0214 04:34:34.680129 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:34:48 no-preload-527067 kubelet[4397]: E0214 04:34:48.684326 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:35:02 no-preload-527067 kubelet[4397]: E0214 04:35:02.679492 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:35:15 no-preload-527067 kubelet[4397]: E0214 04:35:15.680163 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:35:20 no-preload-527067 kubelet[4397]: E0214 04:35:20.814779 4397 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:35:20 no-preload-527067 kubelet[4397]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:35:20 no-preload-527067 kubelet[4397]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:35:20 no-preload-527067 kubelet[4397]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:35:27 no-preload-527067 kubelet[4397]: E0214 04:35:27.679044 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:35:38 no-preload-527067 kubelet[4397]: E0214 04:35:38.679561 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
==> storage-provisioner [6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684] <==
I0214 04:26:38.263939 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 04:26:38.358230 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 04:26:38.358369 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 04:26:38.369420 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 04:26:38.369606 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_no-preload-527067_86f31ec5-cfdc-4404-882d-99538e04eb25!
I0214 04:26:38.370539 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"c571cf7e-2e5e-492d-9bcf-cf2719d1a943", APIVersion:"v1", ResourceVersion:"456", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' no-preload-527067_86f31ec5-cfdc-4404-882d-99538e04eb25 became leader
I0214 04:26:38.470675 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_no-preload-527067_86f31ec5-cfdc-4404-882d-99538e04eb25!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-527067 -n no-preload-527067
helpers_test.go:261: (dbg) Run: kubectl --context no-preload-527067 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-57f55c9bc5-rkc5k
helpers_test.go:274: ======> post-mortem[TestStartStop/group/no-preload/serial/UserAppExistsAfterStop]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context no-preload-527067 describe pod metrics-server-57f55c9bc5-rkc5k
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context no-preload-527067 describe pod metrics-server-57f55c9bc5-rkc5k: exit status 1 (62.682951ms)
** stderr **
Error from server (NotFound): pods "metrics-server-57f55c9bc5-rkc5k" not found
** /stderr **
helpers_test.go:279: kubectl --context no-preload-527067 describe pod metrics-server-57f55c9bc5-rkc5k: exit status 1
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (543.10s)
=== RUN TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
E0214 04:28:32.335043 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:28:40.533398 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:28:52.697952 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:29:16.660466 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 04:29:18.020053 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:29:58.298508 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 04:30:05.112673 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:30:15.741576 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:30:41.064699 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:30:50.025885 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:30:56.223102 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 04:31:13.611713 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 04:31:28.158091 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:31:31.957957 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:32:09.288989 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:32:13.072029 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:32:17.489202 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:32:55.003060 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:33:52.697488 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:34:18.020712 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
start_stop_delete_test.go:274: ***** TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:274: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-960884 -n old-k8s-version-960884
start_stop_delete_test.go:274: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: showing logs for failed pods as of 2024-02-14 04:37:20.270704992 +0000 UTC m=+6557.235322590
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-960884 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-960884 logs -n 25: (1.732532342s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p bridge-528898 sudo cat | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | containerd config dump | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p bridge-528898 sudo find | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p bridge-528898 sudo crio | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:12 UTC |
| | config | | | | | |
| delete | -p bridge-528898 | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| delete | -p | disable-driver-mounts-648156 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | disable-driver-mounts-648156 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:13 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable metrics-server -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | default-k8s-diff-port-224675 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable dashboard -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:26 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable dashboard -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:16:21
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:16:21.016222 1548589 out.go:291] Setting OutFile to fd 1 ...
I0214 04:16:21.016364 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016373 1548589 out.go:304] Setting ErrFile to fd 2...
I0214 04:16:21.016378 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016548 1548589 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:16:21.017128 1548589 out.go:298] Setting JSON to false
I0214 04:16:21.018088 1548589 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":25128,"bootTime":1707859053,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:16:21.018154 1548589 start.go:138] virtualization: kvm guest
I0214 04:16:21.020869 1548589 out.go:177] * [default-k8s-diff-port-224675] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:16:21.022663 1548589 notify.go:220] Checking for updates...
I0214 04:16:21.022671 1548589 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:16:21.024231 1548589 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:16:21.025835 1548589 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:16:21.027384 1548589 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:16:21.028899 1548589 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:16:21.030391 1548589 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:16:21.032286 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:16:21.032695 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.032740 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.048006 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36251
I0214 04:16:21.048486 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.049074 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.049097 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.049529 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.049715 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.049979 1548589 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:16:21.050268 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.050306 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.064529 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34885
I0214 04:16:21.064932 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.065386 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.065417 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.065713 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.065881 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.102150 1548589 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:16:21.104036 1548589 start.go:296] selected driver: kvm2
I0214 04:16:21.104047 1548589 start.go:900] validating driver "kvm2" against &{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisk
s:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.104144 1548589 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:16:21.104799 1548589 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.104878 1548589 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:16:21.119570 1548589 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:16:21.119934 1548589 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:16:21.120000 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:16:21.120015 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:16:21.120050 1548589 start.go:339] cluster config:
{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Names
pace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.120145 1548589 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.122309 1548589 out.go:177] * Starting "default-k8s-diff-port-224675" primary control-plane node in "default-k8s-diff-port-224675" cluster
I0214 04:16:20.509543 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:23.581533 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:21.123776 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:16:21.123806 1548589 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 04:16:21.123816 1548589 cache.go:56] Caching tarball of preloaded images
I0214 04:16:21.123877 1548589 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:16:21.123887 1548589 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 04:16:21.123977 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:16:21.124153 1548589 start.go:360] acquireMachinesLock for default-k8s-diff-port-224675: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:16:29.661593 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:32.733584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:38.813574 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:41.885576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:47.965558 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:51.037514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:57.117639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:00.189564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:06.269549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:09.341644 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:15.421514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:18.493573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:24.573561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:27.645587 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:33.725630 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:36.797500 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:42.877547 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:45.949563 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:52.029594 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:55.101598 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:01.181611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:04.253573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:10.333576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:13.405584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:19.485564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:22.557519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:28.637560 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:31.709570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:37.789577 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:40.861658 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:46.941582 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:50.013561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:56.093507 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:59.165639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:05.245643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:08.317643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:14.397568 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:17.469610 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:23.549636 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:26.621578 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:32.701570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:35.773525 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:41.853530 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:44.925611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:51.005519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:54.077549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:57.080691 1548199 start.go:364] duration metric: took 4m20.251500972s to acquireMachinesLock for "no-preload-527067"
I0214 04:19:57.080766 1548199 start.go:96] Skipping create...Using existing machine configuration
I0214 04:19:57.080773 1548199 fix.go:54] fixHost starting:
I0214 04:19:57.081118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:19:57.081148 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:19:57.096555 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44277
I0214 04:19:57.097002 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:19:57.097550 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:19:57.097577 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:19:57.097855 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:19:57.098034 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:19:57.098149 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:19:57.099876 1548199 fix.go:112] recreateIfNeeded on no-preload-527067: state=Stopped err=<nil>
I0214 04:19:57.099914 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
W0214 04:19:57.100102 1548199 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:19:57.102069 1548199 out.go:177] * Restarting existing kvm2 VM for "no-preload-527067" ...
I0214 04:19:57.077816 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:19:57.077865 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078255 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:19:57.078287 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078566 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:19:57.080537 1548015 machine.go:97] duration metric: took 4m37.408761431s to provisionDockerMachine
I0214 04:19:57.080584 1548015 fix.go:56] duration metric: took 4m37.431215989s for fixHost
I0214 04:19:57.080596 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 4m37.431242855s
W0214 04:19:57.080624 1548015 start.go:713] error starting host: provision: host is not running
W0214 04:19:57.080748 1548015 out.go:239] ! StartHost failed, but will try again: provision: host is not running
I0214 04:19:57.080758 1548015 start.go:728] Will try again in 5 seconds ...
I0214 04:19:57.103328 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Start
I0214 04:19:57.103512 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring networks are active...
I0214 04:19:57.104245 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network default is active
I0214 04:19:57.104698 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network mk-no-preload-527067 is active
I0214 04:19:57.105038 1548199 main.go:141] libmachine: (no-preload-527067) Getting domain xml...
I0214 04:19:57.105698 1548199 main.go:141] libmachine: (no-preload-527067) Creating domain...
I0214 04:19:58.292262 1548199 main.go:141] libmachine: (no-preload-527067) Waiting to get IP...
I0214 04:19:58.293277 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.293718 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.293762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.293632 1549610 retry.go:31] will retry after 307.836827ms: waiting for machine to come up
I0214 04:19:58.603354 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.603935 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.603965 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.603876 1549610 retry.go:31] will retry after 375.894078ms: waiting for machine to come up
I0214 04:19:58.981513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.981981 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.982015 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.981916 1549610 retry.go:31] will retry after 451.678342ms: waiting for machine to come up
I0214 04:19:59.435521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.435921 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.435961 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.435861 1549610 retry.go:31] will retry after 481.719322ms: waiting for machine to come up
I0214 04:19:59.919474 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.919914 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.919949 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.919839 1549610 retry.go:31] will retry after 586.359357ms: waiting for machine to come up
I0214 04:20:00.507667 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:00.508169 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:00.508197 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:00.508112 1549610 retry.go:31] will retry after 703.740251ms: waiting for machine to come up
I0214 04:20:01.213009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:01.213504 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:01.213531 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:01.213452 1549610 retry.go:31] will retry after 979.462057ms: waiting for machine to come up
I0214 04:20:02.082344 1548015 start.go:360] acquireMachinesLock for old-k8s-version-960884: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:20:02.194117 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:02.194497 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:02.194521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:02.194467 1549610 retry.go:31] will retry after 1.278763641s: waiting for machine to come up
I0214 04:20:03.474465 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:03.474892 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:03.474922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:03.474853 1549610 retry.go:31] will retry after 1.500263985s: waiting for machine to come up
I0214 04:20:04.977136 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:04.977601 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:04.977627 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:04.977565 1549610 retry.go:31] will retry after 2.055604163s: waiting for machine to come up
I0214 04:20:07.036030 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:07.036483 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:07.036527 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:07.036415 1549610 retry.go:31] will retry after 2.711272112s: waiting for machine to come up
I0214 04:20:09.750977 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:09.751371 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:09.751404 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:09.751317 1549610 retry.go:31] will retry after 2.924789693s: waiting for machine to come up
I0214 04:20:12.678157 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:12.678553 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:12.678615 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:12.678494 1549610 retry.go:31] will retry after 3.785040141s: waiting for machine to come up
I0214 04:20:16.468466 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468926 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has current primary IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468949 1548199 main.go:141] libmachine: (no-preload-527067) Found IP for machine: 192.168.39.167
I0214 04:20:16.468966 1548199 main.go:141] libmachine: (no-preload-527067) Reserving static IP address...
I0214 04:20:16.469414 1548199 main.go:141] libmachine: (no-preload-527067) Reserved static IP address: 192.168.39.167
I0214 04:20:16.469449 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.469476 1548199 main.go:141] libmachine: (no-preload-527067) Waiting for SSH to be available...
I0214 04:20:16.469513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | skip adding static IP to network mk-no-preload-527067 - found existing host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"}
I0214 04:20:16.469530 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Getting to WaitForSSH function...
I0214 04:20:16.471450 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471707 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.471728 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471812 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH client type: external
I0214 04:20:16.471845 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa (-rw-------)
I0214 04:20:16.471925 1548199 main.go:141] libmachine: (no-preload-527067) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.167 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:16.471947 1548199 main.go:141] libmachine: (no-preload-527067) DBG | About to run SSH command:
I0214 04:20:16.471958 1548199 main.go:141] libmachine: (no-preload-527067) DBG | exit 0
I0214 04:20:16.557177 1548199 main.go:141] libmachine: (no-preload-527067) DBG | SSH cmd err, output: <nil>:
I0214 04:20:16.557638 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetConfigRaw
I0214 04:20:16.558256 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.560907 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561244 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.561290 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561493 1548199 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/config.json ...
I0214 04:20:16.561699 1548199 machine.go:94] provisionDockerMachine start ...
I0214 04:20:16.561722 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:16.561930 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.564237 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564637 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.564664 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.565051 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565394 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.565620 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.565992 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.566004 1548199 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:16.673468 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:16.673502 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.673763 1548199 buildroot.go:166] provisioning hostname "no-preload-527067"
I0214 04:20:16.673799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.674010 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.676849 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677243 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.677291 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677404 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.677612 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677784 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677899 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.678062 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.678523 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.678543 1548199 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-527067 && echo "no-preload-527067" | sudo tee /etc/hostname
I0214 04:20:17.989797 1548416 start.go:364] duration metric: took 4m17.605388932s to acquireMachinesLock for "embed-certs-722906"
I0214 04:20:17.989877 1548416 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:17.989886 1548416 fix.go:54] fixHost starting:
I0214 04:20:17.990389 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:17.990441 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:18.007849 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36303
I0214 04:20:18.008367 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:18.008941 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:20:18.008970 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:18.009367 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:18.009556 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:18.009721 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:20:18.011258 1548416 fix.go:112] recreateIfNeeded on embed-certs-722906: state=Stopped err=<nil>
I0214 04:20:18.011289 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
W0214 04:20:18.011467 1548416 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:18.013874 1548416 out.go:177] * Restarting existing kvm2 VM for "embed-certs-722906" ...
I0214 04:20:16.797274 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-527067
I0214 04:20:16.797308 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.800396 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.800792 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800948 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.801172 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801409 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801569 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.801716 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.802024 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.802041 1548199 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-527067' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-527067/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-527067' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:16.921808 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:16.921851 1548199 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:16.921907 1548199 buildroot.go:174] setting up certificates
I0214 04:20:16.921921 1548199 provision.go:84] configureAuth start
I0214 04:20:16.921942 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.922243 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.924941 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925246 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.925294 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925448 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.927542 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.927839 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.927881 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.928073 1548199 provision.go:143] copyHostCerts
I0214 04:20:16.928185 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:16.928201 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:16.928289 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:16.928403 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:16.928413 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:16.928442 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:16.928502 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:16.928509 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:16.928529 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:16.928578 1548199 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.no-preload-527067 san=[127.0.0.1 192.168.39.167 localhost minikube no-preload-527067]
I0214 04:20:17.305617 1548199 provision.go:177] copyRemoteCerts
I0214 04:20:17.305690 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:17.305716 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.308699 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309038 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.309061 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.309485 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.309657 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.309802 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.394912 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:17.416301 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0214 04:20:17.437138 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:17.457797 1548199 provision.go:87] duration metric: took 535.857617ms to configureAuth
I0214 04:20:17.457828 1548199 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:17.458050 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:20:17.458158 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.460939 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461355 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.461402 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461525 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.461750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.461928 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.462085 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.462252 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.462572 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.462588 1548199 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:17.755399 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:17.755434 1548199 machine.go:97] duration metric: took 1.19371818s to provisionDockerMachine
I0214 04:20:17.755449 1548199 start.go:293] postStartSetup for "no-preload-527067" (driver="kvm2")
I0214 04:20:17.755463 1548199 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:17.755479 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.755812 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:17.755844 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.758654 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.758940 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.758993 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.759135 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.759342 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.759503 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.759639 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.842683 1548199 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:17.847099 1548199 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:17.847127 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:17.847225 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:17.847324 1548199 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:17.847427 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:17.855667 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:17.878842 1548199 start.go:296] duration metric: took 123.375783ms for postStartSetup
I0214 04:20:17.878892 1548199 fix.go:56] duration metric: took 20.79811795s for fixHost
I0214 04:20:17.878923 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.881702 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.882041 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882222 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.882464 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882624 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882782 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.882993 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.883487 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.883502 1548199 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:17.989605 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884417.936736993
I0214 04:20:17.989641 1548199 fix.go:216] guest clock: 1707884417.936736993
I0214 04:20:17.989651 1548199 fix.go:229] Guest: 2024-02-14 04:20:17.936736993 +0000 UTC Remote: 2024-02-14 04:20:17.878897601 +0000 UTC m=+281.200605630 (delta=57.839392ms)
I0214 04:20:17.989679 1548199 fix.go:200] guest clock delta is within tolerance: 57.839392ms
I0214 04:20:17.989697 1548199 start.go:83] releasing machines lock for "no-preload-527067", held for 20.908940374s
I0214 04:20:17.989737 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.990017 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:17.993106 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993551 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.993583 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994292 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994496 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994549 1548199 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:17.994608 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.994767 1548199 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:17.994851 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.997321 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997570 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997602 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997622 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997736 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.997968 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.998111 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.998159 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998305 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.998422 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.998602 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998747 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:18.106735 1548199 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:18.112352 1548199 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:18.256984 1548199 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:18.262909 1548199 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:18.262978 1548199 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:18.279371 1548199 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:18.279399 1548199 start.go:494] detecting cgroup driver to use...
I0214 04:20:18.279462 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:18.294016 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:18.307013 1548199 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:18.307077 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:18.320441 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:18.334729 1548199 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:18.435265 1548199 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:18.543248 1548199 docker.go:233] disabling docker service ...
I0214 04:20:18.543333 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:18.555985 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:18.566967 1548199 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:18.680096 1548199 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:18.798889 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:18.813158 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:18.831387 1548199 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:18.831446 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.841300 1548199 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:18.841352 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.851097 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.860948 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.870710 1548199 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:18.880195 1548199 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:18.889041 1548199 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:18.889111 1548199 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:18.902760 1548199 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:18.912155 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:19.032843 1548199 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:19.218049 1548199 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:19.218136 1548199 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:19.223483 1548199 start.go:562] Will wait 60s for crictl version
I0214 04:20:19.223562 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.227341 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:19.269198 1548199 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:19.269316 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.314795 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.363241 1548199 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on CRI-O 1.24.1 ...
I0214 04:20:18.015330 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Start
I0214 04:20:18.015514 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring networks are active...
I0214 04:20:18.016153 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network default is active
I0214 04:20:18.016585 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network mk-embed-certs-722906 is active
I0214 04:20:18.017058 1548416 main.go:141] libmachine: (embed-certs-722906) Getting domain xml...
I0214 04:20:18.017739 1548416 main.go:141] libmachine: (embed-certs-722906) Creating domain...
I0214 04:20:19.267998 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting to get IP...
I0214 04:20:19.269071 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.269626 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.269744 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.269612 1549739 retry.go:31] will retry after 206.534163ms: waiting for machine to come up
I0214 04:20:19.478352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.478984 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.479109 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.479039 1549739 retry.go:31] will retry after 329.891336ms: waiting for machine to come up
I0214 04:20:19.810738 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.811201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.811225 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.811148 1549739 retry.go:31] will retry after 297.899998ms: waiting for machine to come up
I0214 04:20:20.110861 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.111307 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.111340 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.111260 1549739 retry.go:31] will retry after 483.120653ms: waiting for machine to come up
I0214 04:20:19.364761 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:19.367698 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368111 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:19.368141 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368326 1548199 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 04:20:19.372316 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:19.384595 1548199 kubeadm.go:877] updating cluster {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m
0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:19.384737 1548199 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:20:19.384782 1548199 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:19.428992 1548199 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.29.0-rc.2". assuming images are not preloaded.
I0214 04:20:19.429025 1548199 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.29.0-rc.2 registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 registry.k8s.io/kube-scheduler:v1.29.0-rc.2 registry.k8s.io/kube-proxy:v1.29.0-rc.2 registry.k8s.io/pause:3.9 registry.k8s.io/etcd:3.5.10-0 registry.k8s.io/coredns/coredns:v1.11.1 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.429150 1548199 image.go:134] retrieving image: registry.k8s.io/pause:3.9
I0214 04:20:19.429159 1548199 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.429177 1548199 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.429328 1548199 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.429332 1548199 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.429351 1548199 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.431104 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.431106 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.431123 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.431216 1548199 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.431226 1548199 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
I0214 04:20:19.431239 1548199 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.431291 1548199 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.431826 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.613887 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.614261 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.626641 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.9
I0214 04:20:19.630913 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.638603 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.652797 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.654940 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.656778 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.698298 1548199 cache_images.go:116] "registry.k8s.io/etcd:3.5.10-0" needs transfer: "registry.k8s.io/etcd:3.5.10-0" does not exist at hash "a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7" in container runtime
I0214 04:20:19.698355 1548199 cri.go:218] Removing image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.698414 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.757753 1548199 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" does not exist at hash "bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f" in container runtime
I0214 04:20:19.757810 1548199 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.757870 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941144 1548199 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" does not exist at hash "4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210" in container runtime
I0214 04:20:19.941166 1548199 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.11.1" needs transfer: "registry.k8s.io/coredns/coredns:v1.11.1" does not exist at hash "cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4" in container runtime
I0214 04:20:19.941188 1548199 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime
I0214 04:20:19.941198 1548199 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.941201 1548199 cri.go:218] Removing image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.941205 1548199 cri.go:218] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941337 1548199 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" does not exist at hash "d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d" in container runtime
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941382 1548199 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.941415 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941482 1548199 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-proxy:v1.29.0-rc.2" does not exist at hash "cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834" in container runtime
I0214 04:20:19.941506 1548199 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.941537 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941549 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.941643 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.955388 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.955421 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.969125 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.969198 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.969166 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:20.061499 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
I0214 04:20:20.061591 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.061633 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.061699 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.094179 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094180 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
I0214 04:20:20.094312 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094395 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:20.124555 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
I0214 04:20:20.124585 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124670 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:20.124703 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124677 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124746 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/etcd_3.5.10-0 (exists)
I0214 04:20:20.124760 1548199 crio.go:257] Loading image: /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124793 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124803 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2 (exists)
I0214 04:20:20.124829 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124877 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2 (exists)
I0214 04:20:20.124902 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/storage-provisioner_v5 (exists)
I0214 04:20:20.136587 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/coredns_v1.11.1 (exists)
I0214 04:20:20.136626 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2 (exists)
I0214 04:20:20.595903 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.596479 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.596504 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.596431 1549739 retry.go:31] will retry after 541.170149ms: waiting for machine to come up
I0214 04:20:21.139128 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.139587 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.139619 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.139543 1549739 retry.go:31] will retry after 609.736734ms: waiting for machine to come up
I0214 04:20:21.750821 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.751430 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.751476 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.751373 1549739 retry.go:31] will retry after 889.762874ms: waiting for machine to come up
I0214 04:20:22.642380 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:22.642915 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:22.642966 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:22.642850 1549739 retry.go:31] will retry after 1.310308388s: waiting for machine to come up
I0214 04:20:23.954650 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:23.955082 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:23.955114 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:23.955032 1549739 retry.go:31] will retry after 1.186449176s: waiting for machine to come up
I0214 04:20:25.143888 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:25.144379 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:25.144409 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:25.144331 1549739 retry.go:31] will retry after 1.870374645s: waiting for machine to come up
I0214 04:20:24.103814 1548199 ssh_runner.go:235] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (3.97895084s)
I0214 04:20:24.103870 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2 (exists)
I0214 04:20:24.104023 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0: (3.979201042s)
I0214 04:20:24.104052 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 from cache
I0214 04:20:24.104094 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:24.104197 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:27.017422 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:27.017923 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:27.017949 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:27.017821 1549739 retry.go:31] will retry after 2.372344988s: waiting for machine to come up
I0214 04:20:29.391597 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:29.392177 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:29.392212 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:29.392127 1549739 retry.go:31] will retry after 2.760319549s: waiting for machine to come up
I0214 04:20:27.189223 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2: (3.084990766s)
I0214 04:20:27.189276 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 from cache
I0214 04:20:27.189310 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:27.189404 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:29.355802 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2: (2.166363074s)
I0214 04:20:29.355840 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 from cache
I0214 04:20:29.355881 1548199 crio.go:257] Loading image: /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:29.355951 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:30.013381 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
I0214 04:20:30.013438 1548199 crio.go:257] Loading image: /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:30.013501 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:32.155254 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:32.155727 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:32.155753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:32.155677 1549739 retry.go:31] will retry after 4.524050008s: waiting for machine to come up
I0214 04:20:31.977727 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1: (1.964188552s)
I0214 04:20:31.977769 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 from cache
I0214 04:20:31.977802 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:31.977872 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:34.535494 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2: (2.557583724s)
I0214 04:20:34.535538 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 from cache
I0214 04:20:34.535571 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:34.535624 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:35.791070 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (1.255414762s)
I0214 04:20:35.791122 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 from cache
I0214 04:20:35.791154 1548199 cache_images.go:123] Successfully loaded all cached images
I0214 04:20:35.791166 1548199 cache_images.go:92] duration metric: took 16.362124396s to LoadCachedImages
I0214 04:20:35.791179 1548199 kubeadm.go:928] updating node { 192.168.39.167 8443 v1.29.0-rc.2 crio true true} ...
I0214 04:20:35.791336 1548199 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-527067 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.167
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:35.791437 1548199 ssh_runner.go:195] Run: crio config
I0214 04:20:35.848895 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:20:35.848923 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:35.848935 1548199 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:35.848985 1548199 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.167 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-527067 NodeName:no-preload-527067 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.167"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.167 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:35.849152 1548199 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.167
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-527067"
kubeletExtraArgs:
node-ip: 192.168.39.167
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.167"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:35.849221 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0214 04:20:35.859377 1548199 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:35.859443 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:35.868486 1548199 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0214 04:20:35.885091 1548199 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0214 04:20:35.901749 1548199 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2166 bytes)
I0214 04:20:35.919596 1548199 ssh_runner.go:195] Run: grep 192.168.39.167 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:35.923203 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.167 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:35.934756 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:36.048443 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:36.063403 1548199 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067 for IP: 192.168.39.167
I0214 04:20:36.063423 1548199 certs.go:194] generating shared ca certs ...
I0214 04:20:36.063440 1548199 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:36.063607 1548199 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:36.063675 1548199 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:36.063691 1548199 certs.go:256] generating profile certs ...
I0214 04:20:36.063805 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/client.key
I0214 04:20:36.063903 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key.79c0eebd
I0214 04:20:36.063964 1548199 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key
I0214 04:20:36.064127 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:36.064168 1548199 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:36.064182 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:36.064220 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:36.064249 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:36.064281 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:36.064332 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:36.065313 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:36.101889 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:36.135234 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:36.168832 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:36.204188 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 04:20:36.230823 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 04:20:36.254917 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:36.282014 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:36.303131 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:36.323933 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:36.344419 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:36.365038 1548199 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:36.380645 1548199 ssh_runner.go:195] Run: openssl version
I0214 04:20:36.386091 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:36.395680 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399890 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399959 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.405132 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:36.415168 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:36.424870 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.428976 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.429025 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.434401 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:36.443848 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:36.453658 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457908 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457963 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.463066 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:36.472994 1548199 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:36.477141 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:36.482809 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:36.488342 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:36.493884 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:36.499087 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:36.504410 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:36.509751 1548199 kubeadm.go:391] StartCluster: {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29
.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s
Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:36.509849 1548199 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:36.509914 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.547323 1548199 cri.go:89] found id: ""
I0214 04:20:36.547408 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:36.556907 1548199 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:36.556928 1548199 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:36.556935 1548199 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:36.557012 1548199 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:36.566003 1548199 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:36.567328 1548199 kubeconfig.go:125] found "no-preload-527067" server: "https://192.168.39.167:8443"
I0214 04:20:36.570250 1548199 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:36.578772 1548199 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.167
I0214 04:20:36.578805 1548199 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:36.578819 1548199 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:36.578868 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.615271 1548199 cri.go:89] found id: ""
I0214 04:20:36.615369 1548199 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:36.631254 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:36.640513 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:36.640544 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:20:36.640605 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:36.649213 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:36.649289 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:36.658011 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:36.667277 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:36.667461 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:36.677535 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:36.686189 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:36.686248 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:36.696716 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:36.706405 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:36.706442 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:36.715622 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:36.725241 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.074017 1548589 start.go:364] duration metric: took 4m16.949827565s to acquireMachinesLock for "default-k8s-diff-port-224675"
I0214 04:20:38.074099 1548589 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:38.074107 1548589 fix.go:54] fixHost starting:
I0214 04:20:38.074546 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:38.074596 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:38.092223 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32909
I0214 04:20:38.092628 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:38.093091 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:20:38.093112 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:38.093545 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:38.093743 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:38.093902 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:20:38.095356 1548589 fix.go:112] recreateIfNeeded on default-k8s-diff-port-224675: state=Stopped err=<nil>
I0214 04:20:38.095385 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
W0214 04:20:38.095570 1548589 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:38.097728 1548589 out.go:177] * Restarting existing kvm2 VM for "default-k8s-diff-port-224675" ...
I0214 04:20:36.682303 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.682827 1548416 main.go:141] libmachine: (embed-certs-722906) Found IP for machine: 192.168.50.108
I0214 04:20:36.682865 1548416 main.go:141] libmachine: (embed-certs-722906) Reserving static IP address...
I0214 04:20:36.682884 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has current primary IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.683294 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.683326 1548416 main.go:141] libmachine: (embed-certs-722906) Reserved static IP address: 192.168.50.108
I0214 04:20:36.683352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | skip adding static IP to network mk-embed-certs-722906 - found existing host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"}
I0214 04:20:36.683370 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Getting to WaitForSSH function...
I0214 04:20:36.683386 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting for SSH to be available...
I0214 04:20:36.685555 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.685877 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.685912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.686044 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH client type: external
I0214 04:20:36.686073 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa (-rw-------)
I0214 04:20:36.686108 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.108 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:36.686121 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | About to run SSH command:
I0214 04:20:36.686136 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | exit 0
I0214 04:20:36.777374 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | SSH cmd err, output: <nil>:
I0214 04:20:36.777749 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetConfigRaw
I0214 04:20:36.778583 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:36.781415 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.781891 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.781918 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.782292 1548416 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/config.json ...
I0214 04:20:36.782531 1548416 machine.go:94] provisionDockerMachine start ...
I0214 04:20:36.782576 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:36.782816 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.785327 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.785737 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785996 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.786168 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786327 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786501 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.786710 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.787196 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.787214 1548416 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:36.905657 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:36.905687 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.905964 1548416 buildroot.go:166] provisioning hostname "embed-certs-722906"
I0214 04:20:36.905990 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.906183 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.909442 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.909874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.909912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.910070 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.910262 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910445 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910582 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.910738 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.911264 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.911289 1548416 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-722906 && echo "embed-certs-722906" | sudo tee /etc/hostname
I0214 04:20:37.046181 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-722906
I0214 04:20:37.046216 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.049414 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.049785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.049819 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.050075 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.050291 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050646 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.050842 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.051191 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.051235 1548416 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-722906' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-722906/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-722906' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:37.177589 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:37.177622 1548416 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:37.177646 1548416 buildroot.go:174] setting up certificates
I0214 04:20:37.177657 1548416 provision.go:84] configureAuth start
I0214 04:20:37.177668 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:37.178023 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:37.181013 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181404 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.181435 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181606 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.183959 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184300 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.184329 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184472 1548416 provision.go:143] copyHostCerts
I0214 04:20:37.184534 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:37.184544 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:37.184594 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:37.184678 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:37.184685 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:37.184710 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:37.184785 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:37.184794 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:37.184813 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:37.184881 1548416 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.embed-certs-722906 san=[127.0.0.1 192.168.50.108 embed-certs-722906 localhost minikube]
I0214 04:20:37.334150 1548416 provision.go:177] copyRemoteCerts
I0214 04:20:37.334225 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:37.334258 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.336874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337245 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.337299 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337492 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.337693 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.337868 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.338016 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.424211 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:37.448257 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0214 04:20:37.472132 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:20:37.496606 1548416 provision.go:87] duration metric: took 318.923431ms to configureAuth
I0214 04:20:37.496633 1548416 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:37.496815 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:37.496904 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.499706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500129 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.500174 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500359 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.500566 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500738 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500873 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.501094 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.501587 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.501614 1548416 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:37.814749 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:37.814781 1548416 machine.go:97] duration metric: took 1.032234304s to provisionDockerMachine
I0214 04:20:37.814796 1548416 start.go:293] postStartSetup for "embed-certs-722906" (driver="kvm2")
I0214 04:20:37.814811 1548416 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:37.814848 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:37.815206 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:37.815237 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.818201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818621 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.818644 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818819 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.819026 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.819221 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.819386 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.913636 1548416 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:37.919126 1548416 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:37.919153 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:37.919231 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:37.919328 1548416 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:37.919441 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:37.930902 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:37.955477 1548416 start.go:296] duration metric: took 140.651894ms for postStartSetup
I0214 04:20:37.955515 1548416 fix.go:56] duration metric: took 19.965630101s for fixHost
I0214 04:20:37.955546 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.958406 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.958844 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.958883 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.959025 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.959250 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959490 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.959876 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.960220 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.960236 1548416 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:38.073852 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884438.021225394
I0214 04:20:38.073878 1548416 fix.go:216] guest clock: 1707884438.021225394
I0214 04:20:38.073897 1548416 fix.go:229] Guest: 2024-02-14 04:20:38.021225394 +0000 UTC Remote: 2024-02-14 04:20:37.955524144 +0000 UTC m=+277.725419033 (delta=65.70125ms)
I0214 04:20:38.073926 1548416 fix.go:200] guest clock delta is within tolerance: 65.70125ms
I0214 04:20:38.073936 1548416 start.go:83] releasing machines lock for "embed-certs-722906", held for 20.084084933s
I0214 04:20:38.073965 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.074261 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:38.077151 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077577 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.077612 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077814 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078403 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078604 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078683 1548416 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:38.078733 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.078839 1548416 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:38.078867 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.081284 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081692 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.081758 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081784 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081870 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082041 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082218 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082256 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.082293 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.082336 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.082457 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082607 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082726 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082903 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.190317 1548416 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:38.196626 1548416 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:38.349673 1548416 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:38.356571 1548416 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:38.356677 1548416 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:38.377847 1548416 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:38.377877 1548416 start.go:494] detecting cgroup driver to use...
I0214 04:20:38.377956 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:38.395591 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:38.411254 1548416 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:38.411337 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:38.429922 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:38.446585 1548416 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:38.576797 1548416 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:38.708684 1548416 docker.go:233] disabling docker service ...
I0214 04:20:38.708752 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:38.723898 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:38.736512 1548416 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:38.864382 1548416 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:38.978645 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:38.995888 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:39.015920 1548416 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:39.015998 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.028138 1548416 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:39.028205 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.041203 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.054736 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.064851 1548416 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:39.074475 1548416 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:39.085772 1548416 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:39.085839 1548416 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:39.102669 1548416 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:39.117041 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:39.248406 1548416 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:39.438738 1548416 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:39.438820 1548416 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:39.445895 1548416 start.go:562] Will wait 60s for crictl version
I0214 04:20:39.445969 1548416 ssh_runner.go:195] Run: which crictl
I0214 04:20:39.450199 1548416 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:39.491583 1548416 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:39.491674 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.534681 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.593285 1548416 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:39.594908 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:39.598263 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.598753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:39.598785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.599034 1548416 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0214 04:20:39.603478 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:39.621148 1548416 kubeadm.go:877] updating cluster {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:
false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:39.621309 1548416 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:39.621379 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:39.676783 1548416 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:39.676909 1548416 ssh_runner.go:195] Run: which lz4
I0214 04:20:39.681410 1548416 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:39.686690 1548416 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:39.686727 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:20:38.099207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Start
I0214 04:20:38.099430 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring networks are active...
I0214 04:20:38.100228 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network default is active
I0214 04:20:38.100585 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network mk-default-k8s-diff-port-224675 is active
I0214 04:20:38.101059 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Getting domain xml...
I0214 04:20:38.101854 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Creating domain...
I0214 04:20:39.454986 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting to get IP...
I0214 04:20:39.456025 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456576 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456614 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.456520 1549871 retry.go:31] will retry after 292.69131ms: waiting for machine to come up
I0214 04:20:39.751334 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751908 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751956 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.751858 1549871 retry.go:31] will retry after 340.869303ms: waiting for machine to come up
I0214 04:20:40.094535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095142 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.095051 1549871 retry.go:31] will retry after 293.465495ms: waiting for machine to come up
I0214 04:20:40.390912 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391346 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391377 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.391290 1549871 retry.go:31] will retry after 457.62012ms: waiting for machine to come up
I0214 04:20:40.851151 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851616 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851645 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.851547 1549871 retry.go:31] will retry after 539.345518ms: waiting for machine to come up
I0214 04:20:36.851047 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.089975 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.238873301s)
I0214 04:20:38.090005 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.309755 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.378436 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.478394 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:38.478509 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:38.979577 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.478754 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.979574 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.479243 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.978672 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:41.006970 1548199 api_server.go:72] duration metric: took 2.528578043s to wait for apiserver process to appear ...
I0214 04:20:41.007003 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:41.007024 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.008150 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:20:41.507776 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.762516 1548416 crio.go:444] duration metric: took 2.081156311s to copy over tarball
I0214 04:20:41.762608 1548416 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:20:44.980302 1548416 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.217656042s)
I0214 04:20:44.980335 1548416 crio.go:451] duration metric: took 3.217784443s to extract the tarball
I0214 04:20:44.980346 1548416 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:20:45.024706 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:45.082193 1548416 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:20:45.082217 1548416 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:20:45.082225 1548416 kubeadm.go:928] updating node { 192.168.50.108 8443 v1.28.4 crio true true} ...
I0214 04:20:45.082349 1548416 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-722906 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.50.108
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:45.082447 1548416 ssh_runner.go:195] Run: crio config
I0214 04:20:45.147931 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:45.147969 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:45.147982 1548416 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:45.148006 1548416 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.108 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-722906 NodeName:embed-certs-722906 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.108"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.108 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:45.148164 1548416 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.108
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-722906"
kubeletExtraArgs:
node-ip: 192.168.50.108
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.108"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:45.148232 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:20:45.158479 1548416 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:45.158553 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:45.167772 1548416 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)
I0214 04:20:45.184110 1548416 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:20:45.200469 1548416 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
I0214 04:20:45.217332 1548416 ssh_runner.go:195] Run: grep 192.168.50.108 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:45.221512 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.108 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:45.233317 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:41.392312 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393904 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:41.393756 1549871 retry.go:31] will retry after 729.897424ms: waiting for machine to come up
I0214 04:20:42.125952 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126513 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126542 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:42.126448 1549871 retry.go:31] will retry after 1.070487026s: waiting for machine to come up
I0214 04:20:43.198768 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199234 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199269 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:43.199179 1549871 retry.go:31] will retry after 1.144751625s: waiting for machine to come up
I0214 04:20:44.345532 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345958 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345989 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:44.345929 1549871 retry.go:31] will retry after 1.430046726s: waiting for machine to come up
I0214 04:20:45.778221 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778683 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778713 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:45.778628 1549871 retry.go:31] will retry after 2.320641186s: waiting for machine to come up
I0214 04:20:46.508190 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:46.508231 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:45.341316 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:45.781473 1548416 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906 for IP: 192.168.50.108
I0214 04:20:45.781494 1548416 certs.go:194] generating shared ca certs ...
I0214 04:20:45.781513 1548416 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:45.781690 1548416 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:45.781760 1548416 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:45.781777 1548416 certs.go:256] generating profile certs ...
I0214 04:20:45.781960 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/client.key
I0214 04:20:45.782154 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key.de29a2e4
I0214 04:20:45.782215 1548416 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key
I0214 04:20:45.782395 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:45.782438 1548416 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:45.782453 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:45.782491 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:45.782537 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:45.782570 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:45.782625 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:45.783482 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:45.822613 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:45.853037 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:45.898215 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:45.938947 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0214 04:20:45.965143 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:20:45.994794 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:46.018374 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:46.044018 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:46.067499 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:46.090920 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:46.114475 1548416 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:46.132051 1548416 ssh_runner.go:195] Run: openssl version
I0214 04:20:46.137746 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:46.147403 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152220 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152298 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.158254 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:46.167536 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:46.179112 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184157 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184219 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.190110 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:46.200066 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:46.210093 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214882 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214955 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.220636 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:46.230395 1548416 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:46.235238 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:46.241337 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:46.247195 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:46.253414 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:46.259696 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:46.266214 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:46.272246 1548416 kubeadm.go:391] StartCluster: {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fal
se MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:46.272384 1548416 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:46.272458 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.322213 1548416 cri.go:89] found id: ""
I0214 04:20:46.322303 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:46.334965 1548416 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:46.334993 1548416 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:46.334999 1548416 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:46.335055 1548416 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:46.344493 1548416 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:46.345570 1548416 kubeconfig.go:125] found "embed-certs-722906" server: "https://192.168.50.108:8443"
I0214 04:20:46.347818 1548416 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:46.357313 1548416 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.50.108
I0214 04:20:46.357349 1548416 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:46.357365 1548416 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:46.357429 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.403854 1548416 cri.go:89] found id: ""
I0214 04:20:46.403945 1548416 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:46.418730 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:46.432468 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:46.432491 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:20:46.432541 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:46.441218 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:46.441346 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:46.450078 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:46.458158 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:46.458261 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:46.472089 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:46.480354 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:46.480425 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:46.489174 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:46.497321 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:46.497406 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:46.506204 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:46.517469 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:46.646342 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.587291 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.799709 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.882294 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.990798 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:47.990913 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.491970 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.991676 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.491048 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.991348 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.100608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:48.101075 1549871 retry.go:31] will retry after 2.658096517s: waiting for machine to come up
I0214 04:20:50.762784 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763407 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:50.763316 1549871 retry.go:31] will retry after 2.514722067s: waiting for machine to come up
I0214 04:20:51.508782 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:51.508854 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:50.491707 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:50.511999 1548416 api_server.go:72] duration metric: took 2.521202011s to wait for apiserver process to appear ...
I0214 04:20:50.512032 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:50.512056 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.915403 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:20:53.915447 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:20:53.915465 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.961623 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:53.961686 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.012877 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.029797 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.029829 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.512349 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.517512 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.517539 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.013148 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.019019 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:55.019067 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.512961 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.520464 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:20:55.529064 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:20:55.529096 1548416 api_server.go:131] duration metric: took 5.017056759s to wait for apiserver health ...
I0214 04:20:55.529107 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:55.529117 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:55.531379 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:20:53.279582 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280038 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:53.279941 1549871 retry.go:31] will retry after 3.362064709s: waiting for machine to come up
I0214 04:20:56.510005 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:56.510055 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:58.174260 1548015 start.go:364] duration metric: took 56.091842509s to acquireMachinesLock for "old-k8s-version-960884"
I0214 04:20:58.174320 1548015 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:58.174329 1548015 fix.go:54] fixHost starting:
I0214 04:20:58.174723 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:58.174759 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:58.194079 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41161
I0214 04:20:58.194519 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:58.195088 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:20:58.195119 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:58.195478 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:58.195686 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:20:58.195855 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:20:58.197422 1548015 fix.go:112] recreateIfNeeded on old-k8s-version-960884: state=Stopped err=<nil>
I0214 04:20:58.197454 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
W0214 04:20:58.197646 1548015 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:58.200239 1548015 out.go:177] * Restarting existing kvm2 VM for "old-k8s-version-960884" ...
I0214 04:20:58.201659 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Start
I0214 04:20:58.201846 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring networks are active...
I0214 04:20:58.202622 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network default is active
I0214 04:20:58.202951 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network mk-old-k8s-version-960884 is active
I0214 04:20:58.203335 1548015 main.go:141] libmachine: (old-k8s-version-960884) Getting domain xml...
I0214 04:20:58.204058 1548015 main.go:141] libmachine: (old-k8s-version-960884) Creating domain...
I0214 04:20:59.499603 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting to get IP...
I0214 04:20:59.500457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.500948 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.501078 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.500925 1550044 retry.go:31] will retry after 268.008751ms: waiting for machine to come up
I0214 04:20:56.646632 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647206 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has current primary IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Found IP for machine: 192.168.61.188
I0214 04:20:56.647242 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserving static IP address...
I0214 04:20:56.647731 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserved static IP address: 192.168.61.188
I0214 04:20:56.647765 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for SSH to be available...
I0214 04:20:56.647794 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.647835 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | skip adding static IP to network mk-default-k8s-diff-port-224675 - found existing host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"}
I0214 04:20:56.647855 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Getting to WaitForSSH function...
I0214 04:20:56.650403 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.650820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.650856 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.651067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH client type: external
I0214 04:20:56.651100 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa (-rw-------)
I0214 04:20:56.651166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.188 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:56.651192 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | About to run SSH command:
I0214 04:20:56.651207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | exit 0
I0214 04:20:56.745447 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | SSH cmd err, output: <nil>:
I0214 04:20:56.745839 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetConfigRaw
I0214 04:20:56.746577 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:56.749052 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749421 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.749460 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749749 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:20:56.750003 1548589 machine.go:94] provisionDockerMachine start ...
I0214 04:20:56.750032 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:56.750283 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.752289 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.752669 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752745 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.752923 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753226 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.753428 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.753775 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.753787 1548589 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:56.885360 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:56.885414 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885730 1548589 buildroot.go:166] provisioning hostname "default-k8s-diff-port-224675"
I0214 04:20:56.885763 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885965 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.889200 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889612 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.889646 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.889979 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890304 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.890522 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.890994 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.891016 1548589 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-224675 && echo "default-k8s-diff-port-224675" | sudo tee /etc/hostname
I0214 04:20:57.036037 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-224675
I0214 04:20:57.036072 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.039174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039572 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.039608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039755 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.039972 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040163 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040409 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.040613 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.040946 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.040964 1548589 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-224675' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-224675/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-224675' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:57.182677 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:57.182717 1548589 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:57.182783 1548589 buildroot.go:174] setting up certificates
I0214 04:20:57.182802 1548589 provision.go:84] configureAuth start
I0214 04:20:57.182822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:57.183166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:57.186475 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.186873 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.186913 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.187230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.189476 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189790 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.189822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189971 1548589 provision.go:143] copyHostCerts
I0214 04:20:57.190038 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:57.190049 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:57.190098 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:57.190266 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:57.190280 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:57.190314 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:57.190386 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:57.190394 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:57.190412 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:57.190461 1548589 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-224675 san=[127.0.0.1 192.168.61.188 default-k8s-diff-port-224675 localhost minikube]
I0214 04:20:57.387080 1548589 provision.go:177] copyRemoteCerts
I0214 04:20:57.387149 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:57.387175 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.390293 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.390630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.391007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.391181 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.391322 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.485912 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:57.512761 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0214 04:20:57.536095 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:57.558680 1548589 provision.go:87] duration metric: took 375.857715ms to configureAuth
I0214 04:20:57.558710 1548589 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:57.558918 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:57.559003 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.562067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562500 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.562537 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562704 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.562907 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563106 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563246 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.563461 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.563823 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.563850 1548589 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:57.893504 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:57.893536 1548589 machine.go:97] duration metric: took 1.143516422s to provisionDockerMachine
I0214 04:20:57.893548 1548589 start.go:293] postStartSetup for "default-k8s-diff-port-224675" (driver="kvm2")
I0214 04:20:57.893559 1548589 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:57.893575 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:57.893941 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:57.893974 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.896371 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896764 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.896795 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896910 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.897116 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.897286 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.897442 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.996592 1548589 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:58.000872 1548589 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:58.000900 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:58.000983 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:58.001088 1548589 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:58.001183 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:58.011272 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:58.034964 1548589 start.go:296] duration metric: took 141.398226ms for postStartSetup
I0214 04:20:58.035023 1548589 fix.go:56] duration metric: took 19.960915344s for fixHost
I0214 04:20:58.035053 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.037914 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038291 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.038324 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038581 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.038811 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.038999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.039138 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.039329 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:58.039672 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:58.039684 1548589 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:58.174082 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884458.118396657
I0214 04:20:58.174110 1548589 fix.go:216] guest clock: 1707884458.118396657
I0214 04:20:58.174121 1548589 fix.go:229] Guest: 2024-02-14 04:20:58.118396657 +0000 UTC Remote: 2024-02-14 04:20:58.035028403 +0000 UTC m=+277.067763536 (delta=83.368254ms)
I0214 04:20:58.174148 1548589 fix.go:200] guest clock delta is within tolerance: 83.368254ms
I0214 04:20:58.174154 1548589 start.go:83] releasing machines lock for "default-k8s-diff-port-224675", held for 20.100083449s
I0214 04:20:58.174185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.174605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:58.177237 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177662 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.177693 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177891 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178381 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178690 1548589 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:58.178744 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.178844 1548589 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:58.178867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.181490 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181819 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.181842 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182009 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.182292 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.182352 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.182420 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182520 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182582 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.182999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.183208 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.183377 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.279272 1548589 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:58.306096 1548589 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:58.464434 1548589 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:58.471146 1548589 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:58.471214 1548589 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:58.488300 1548589 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:58.488334 1548589 start.go:494] detecting cgroup driver to use...
I0214 04:20:58.488423 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:58.506634 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:58.521226 1548589 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:58.521315 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:58.536720 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:58.549326 1548589 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:58.661636 1548589 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:58.783909 1548589 docker.go:233] disabling docker service ...
I0214 04:20:58.784000 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:58.796379 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:58.807498 1548589 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:58.924871 1548589 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:59.041964 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:59.055151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:59.082093 1548589 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:59.082175 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.095126 1548589 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:59.095227 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.104759 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.117356 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.126315 1548589 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:59.135891 1548589 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:59.146513 1548589 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:59.146572 1548589 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:59.162055 1548589 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:59.172668 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:59.323690 1548589 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:59.554209 1548589 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:59.554296 1548589 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:59.559401 1548589 start.go:562] Will wait 60s for crictl version
I0214 04:20:59.559471 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:20:59.563786 1548589 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:59.606476 1548589 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:59.606583 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.676861 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.739175 1548589 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:55.532872 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:20:55.548094 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:20:55.582319 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:20:55.595384 1548416 system_pods.go:59] 8 kube-system pods found
I0214 04:20:55.595415 1548416 system_pods.go:61] "coredns-5dd5756b68-4njjf" [3526e55f-d197-40a9-a939-bdc324aa0214] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:20:55.595422 1548416 system_pods.go:61] "etcd-embed-certs-722906" [cc60420b-dd77-4385-86f9-d2ddaa5a9b22] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:20:55.595429 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [850aef3c-4402-4e33-a81d-2d4bd97c5503] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:20:55.595435 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [5f2cc407-f67a-4779-ab0d-1a739e070df4] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:20:55.595443 1548416 system_pods.go:61] "kube-proxy-4wk86" [de0506d7-756a-4ce1-ab3c-54aaf8c041ad] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:20:55.595449 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [05db3b4a-941a-4aaf-88e3-35ec35176042] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:20:55.595458 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-5nqbv" [7784c464-f718-4eb0-b9dd-ebb579ead3bc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:20:55.595464 1548416 system_pods.go:61] "storage-provisioner" [d272841c-697d-4708-bce6-6fcad0d9d2b4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:20:55.595471 1548416 system_pods.go:74] duration metric: took 13.129235ms to wait for pod list to return data ...
I0214 04:20:55.595482 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:20:55.601854 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:20:55.601918 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:20:55.601935 1548416 node_conditions.go:105] duration metric: took 6.44739ms to run NodePressure ...
I0214 04:20:55.601957 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:55.954027 1548416 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:20:55.970665 1548416 kubeadm.go:733] kubelet initialised
I0214 04:20:55.970695 1548416 kubeadm.go:734] duration metric: took 16.634129ms waiting for restarted kubelet to initialise ...
I0214 04:20:55.970708 1548416 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:20:55.978062 1548416 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:20:57.985711 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.989728 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.740766 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:59.744066 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744437 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:59.744465 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744727 1548589 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0214 04:20:59.750187 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:59.763984 1548589 kubeadm.go:877] updating cluster {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat
ion:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:59.764177 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:59.764235 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:59.814567 1548589 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:59.814655 1548589 ssh_runner.go:195] Run: which lz4
I0214 04:20:59.819563 1548589 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:59.824793 1548589 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:59.824844 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:21:01.511247 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:01.511301 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:01.665765 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": read tcp 192.168.39.1:46006->192.168.39.167:8443: read: connection reset by peer
I0214 04:20:59.770509 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.770916 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.770941 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.770880 1550044 retry.go:31] will retry after 254.3155ms: waiting for machine to come up
I0214 04:21:00.027295 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.028116 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.028281 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.028236 1550044 retry.go:31] will retry after 304.399751ms: waiting for machine to come up
I0214 04:21:00.334939 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.335679 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.335710 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.335610 1550044 retry.go:31] will retry after 495.017444ms: waiting for machine to come up
I0214 04:21:00.833716 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.834301 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.834332 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.834259 1550044 retry.go:31] will retry after 586.036153ms: waiting for machine to come up
I0214 04:21:01.422440 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:01.423042 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:01.423073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:01.423002 1550044 retry.go:31] will retry after 893.296492ms: waiting for machine to come up
I0214 04:21:02.318089 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:02.318517 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:02.318553 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:02.318444 1550044 retry.go:31] will retry after 890.603828ms: waiting for machine to come up
I0214 04:21:03.210695 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:03.211183 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:03.211219 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:03.211140 1550044 retry.go:31] will retry after 1.068479468s: waiting for machine to come up
I0214 04:21:04.281009 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:04.281818 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:04.281859 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:04.281713 1550044 retry.go:31] will retry after 1.48876639s: waiting for machine to come up
I0214 04:21:00.490145 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:00.490174 1548416 pod_ready.go:81] duration metric: took 4.512078435s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:21:00.490188 1548416 pod_ready.go:78] waiting up to 4m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:02.498108 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:04.500186 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:01.782168 1548589 crio.go:444] duration metric: took 1.962621296s to copy over tarball
I0214 04:21:01.782265 1548589 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:05.094954 1548589 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.312628523s)
I0214 04:21:05.094995 1548589 crio.go:451] duration metric: took 3.312794343s to extract the tarball
I0214 04:21:05.095005 1548589 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:05.138877 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:05.189028 1548589 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:21:05.189067 1548589 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:21:05.189079 1548589 kubeadm.go:928] updating node { 192.168.61.188 8444 v1.28.4 crio true true} ...
I0214 04:21:05.189273 1548589 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=default-k8s-diff-port-224675 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.188
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:05.189360 1548589 ssh_runner.go:195] Run: crio config
I0214 04:21:05.268931 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:05.268970 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:05.268985 1548589 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:05.269014 1548589 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.188 APIServerPort:8444 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-224675 NodeName:default-k8s-diff-port-224675 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.188"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.188 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cer
ts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:21:05.269248 1548589 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.188
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-224675"
kubeletExtraArgs:
node-ip: 192.168.61.188
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.188"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:05.269373 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:21:05.282570 1548589 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:05.282677 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:05.294227 1548589 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (328 bytes)
I0214 04:21:05.314442 1548589 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:05.335296 1548589 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0214 04:21:05.355453 1548589 ssh_runner.go:195] Run: grep 192.168.61.188 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:05.359558 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.188 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:05.374035 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:05.500958 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:05.517736 1548589 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675 for IP: 192.168.61.188
I0214 04:21:05.517761 1548589 certs.go:194] generating shared ca certs ...
I0214 04:21:05.517784 1548589 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:05.518063 1548589 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:05.518133 1548589 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:05.518149 1548589 certs.go:256] generating profile certs ...
I0214 04:21:05.518278 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/client.key
I0214 04:21:05.518378 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key.107453ef
I0214 04:21:05.518440 1548589 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key
I0214 04:21:05.518591 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:05.518663 1548589 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:05.518679 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:05.518715 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:05.518750 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:05.518786 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:05.518843 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:05.519732 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:05.563956 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:05.600031 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:05.637740 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:05.690706 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0214 04:21:05.737661 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:05.775249 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:05.808393 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:21:05.835096 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:05.859782 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:05.885907 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:05.912030 1548589 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:05.929758 1548589 ssh_runner.go:195] Run: openssl version
I0214 04:21:05.935156 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:05.945003 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949769 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949864 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.955524 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:05.965551 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:05.975674 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980561 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980621 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.986257 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:05.997315 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:06.007670 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012694 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012766 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:02.007691 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.008567 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:02.507730 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.508577 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.007700 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:03.008475 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.507127 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.797126 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.797164 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:07.797184 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.883078 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.883120 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:08.007346 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.097373 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.097412 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:08.507874 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.516200 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.516246 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:09.007697 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:09.012802 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:21:09.021792 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:21:09.021833 1548199 api_server.go:131] duration metric: took 28.01482277s to wait for apiserver health ...
I0214 04:21:09.021845 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:21:09.021853 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:09.023946 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:05.771858 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:05.772454 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:05.772494 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:05.772403 1550044 retry.go:31] will retry after 2.280902204s: waiting for machine to come up
I0214 04:21:08.054571 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:08.055138 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:08.055173 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:08.055076 1550044 retry.go:31] will retry after 1.815235532s: waiting for machine to come up
I0214 04:21:06.844839 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:07.283580 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.283613 1548416 pod_ready.go:81] duration metric: took 6.793414916s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.283638 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294673 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.294704 1548416 pod_ready.go:81] duration metric: took 11.057139ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294719 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303085 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.303113 1548416 pod_ready.go:81] duration metric: took 8.385115ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303125 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310622 1548416 pod_ready.go:92] pod "kube-proxy-4wk86" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.310649 1548416 pod_ready.go:81] duration metric: took 7.515057ms for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310661 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.323237 1548416 pod_ready.go:102] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:09.821404 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:09.821523 1548416 pod_ready.go:81] duration metric: took 2.510851991s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.821565 1548416 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:06.018693 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:06.380858 1548589 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:06.387108 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:06.393578 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:06.399652 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:06.405980 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:06.412267 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:06.419780 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:06.427216 1548589 kubeadm.go:391] StartCluster: {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration
:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:06.427363 1548589 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:06.427422 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.497747 1548589 cri.go:89] found id: ""
I0214 04:21:06.497834 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:06.516612 1548589 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:06.516658 1548589 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:06.516667 1548589 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:06.516733 1548589 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:06.529291 1548589 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:06.531168 1548589 kubeconfig.go:125] found "default-k8s-diff-port-224675" server: "https://192.168.61.188:8444"
I0214 04:21:06.535161 1548589 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:06.546663 1548589 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.61.188
I0214 04:21:06.546708 1548589 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:06.546726 1548589 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:06.546803 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.597843 1548589 cri.go:89] found id: ""
I0214 04:21:06.597935 1548589 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:06.616190 1548589 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:06.628139 1548589 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:06.628171 1548589 kubeadm.go:156] found existing configuration files:
I0214 04:21:06.628236 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I0214 04:21:06.638453 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:06.638512 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:06.648959 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I0214 04:21:06.660706 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:06.660788 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:06.671857 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I0214 04:21:06.682340 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:06.682407 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:06.692058 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I0214 04:21:06.701943 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:06.702022 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:06.711790 1548589 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:06.721996 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:06.889535 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.226025 1548589 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.336439873s)
I0214 04:21:08.226061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.459929 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.556113 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.663379 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:08.663488 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.164266 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.664203 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.163698 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.663743 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.689408 1548589 api_server.go:72] duration metric: took 2.026029304s to wait for apiserver process to appear ...
I0214 04:21:10.689439 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:10.689466 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:10.690130 1548589 api_server.go:269] stopped: https://192.168.61.188:8444/healthz: Get "https://192.168.61.188:8444/healthz": dial tcp 192.168.61.188:8444: connect: connection refused
I0214 04:21:09.025318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:09.044094 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:09.065032 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:09.077574 1548199 system_pods.go:59] 8 kube-system pods found
I0214 04:21:09.077615 1548199 system_pods.go:61] "coredns-76f75df574-kszkn" [e042e368-b6a1-481d-ac0e-a41fded08d17] Running
I0214 04:21:09.077624 1548199 system_pods.go:61] "etcd-no-preload-527067" [f9eb0545-49ea-4302-89ba-f897701543c8] Running
I0214 04:21:09.077632 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [294a622e-a6af-46f1-b011-4d932202c48c] Running
I0214 04:21:09.077641 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [cb6ca785-3638-4e5c-8950-bddb982904b4] Running
I0214 04:21:09.077648 1548199 system_pods.go:61] "kube-proxy-x55kr" [b523c872-d6f6-4522-b3f0-669b55d4784c] Running
I0214 04:21:09.077656 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [7e451830-0a27-4fa9-8ebd-36ae39aa0214] Running
I0214 04:21:09.077669 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-jq29b" [0c974098-1c0c-482e-a187-95f35842b947] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:09.077686 1548199 system_pods.go:61] "storage-provisioner" [d4ce4210-3a50-4839-9266-54a8a6725728] Running
I0214 04:21:09.077698 1548199 system_pods.go:74] duration metric: took 12.635754ms to wait for pod list to return data ...
I0214 04:21:09.077713 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:09.080917 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:09.080955 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:09.080972 1548199 node_conditions.go:105] duration metric: took 3.250174ms to run NodePressure ...
I0214 04:21:09.080995 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:09.378306 1548199 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:09.384151 1548199 retry.go:31] will retry after 170.068456ms: kubelet not initialised
I0214 04:21:09.560919 1548199 retry.go:31] will retry after 290.437429ms: kubelet not initialised
I0214 04:21:09.859277 1548199 retry.go:31] will retry after 624.738868ms: kubelet not initialised
I0214 04:21:10.492136 1548199 retry.go:31] will retry after 533.792177ms: kubelet not initialised
I0214 04:21:11.034100 1548199 retry.go:31] will retry after 1.244408489s: kubelet not initialised
I0214 04:21:09.872580 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:09.873073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:09.873109 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:09.873043 1550044 retry.go:31] will retry after 2.578927184s: waiting for machine to come up
I0214 04:21:12.454474 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:12.454906 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:12.454940 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:12.454858 1550044 retry.go:31] will retry after 3.936870017s: waiting for machine to come up
I0214 04:21:11.833118 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:14.329353 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:11.190349 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.926174 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.926304 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:14.926353 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.981084 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.981133 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:15.190448 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.196250 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.196274 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:15.690479 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.698329 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.698362 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:16.190232 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:16.195910 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:21:16.205529 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:21:16.205562 1548589 api_server.go:131] duration metric: took 5.516113354s to wait for apiserver health ...
I0214 04:21:16.205575 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:16.205584 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:16.207433 1548589 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:12.289467 1548199 retry.go:31] will retry after 1.910737554s: kubelet not initialised
I0214 04:21:14.207622 1548199 retry.go:31] will retry after 2.041648758s: kubelet not initialised
I0214 04:21:16.260641 1548199 kubeadm.go:733] kubelet initialised
I0214 04:21:16.260666 1548199 kubeadm.go:734] duration metric: took 6.882327169s waiting for restarted kubelet to initialise ...
I0214 04:21:16.260677 1548199 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.271440 1548199 pod_ready.go:78] waiting up to 4m0s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.208874 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:16.223699 1548589 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:16.242002 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:16.258621 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:21:16.258672 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:21:16.258684 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:21:16.258702 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:21:16.258720 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:21:16.258735 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:21:16.258745 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:21:16.258757 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:16.258773 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:21:16.258782 1548589 system_pods.go:74] duration metric: took 16.754069ms to wait for pod list to return data ...
I0214 04:21:16.258804 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:16.262763 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:16.262799 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:16.262812 1548589 node_conditions.go:105] duration metric: took 4.002558ms to run NodePressure ...
I0214 04:21:16.262833 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:16.517025 1548589 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:16.522602 1548589 kubeadm.go:733] kubelet initialised
I0214 04:21:16.522681 1548589 kubeadm.go:734] duration metric: took 5.568582ms waiting for restarted kubelet to initialise ...
I0214 04:21:16.522703 1548589 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.529946 1548589 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.535926 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535952 1548589 pod_ready.go:81] duration metric: took 5.972224ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.535962 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535971 1548589 pod_ready.go:78] waiting up to 4m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.541171 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541207 1548589 pod_ready.go:81] duration metric: took 5.225365ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.541221 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541229 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.546186 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546218 1548589 pod_ready.go:81] duration metric: took 4.980231ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.546231 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546239 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.646668 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646709 1548589 pod_ready.go:81] duration metric: took 100.455975ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.646726 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646735 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.049656 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049690 1548589 pod_ready.go:81] duration metric: took 402.946278ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.049704 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049713 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.445638 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445677 1548589 pod_ready.go:81] duration metric: took 395.952591ms for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.445694 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445703 1548589 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.847249 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847282 1548589 pod_ready.go:81] duration metric: took 401.569704ms for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.847311 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847322 1548589 pod_ready.go:38] duration metric: took 1.324598748s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:17.847345 1548589 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:21:17.861893 1548589 ops.go:34] apiserver oom_adj: -16
I0214 04:21:17.861926 1548589 kubeadm.go:591] duration metric: took 11.345250928s to restartPrimaryControlPlane
I0214 04:21:17.861937 1548589 kubeadm.go:393] duration metric: took 11.434732694s to StartCluster
I0214 04:21:17.861963 1548589 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.862046 1548589 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:21:17.864089 1548589 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.864357 1548589 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:21:17.866315 1548589 out.go:177] * Verifying Kubernetes components...
I0214 04:21:17.864450 1548589 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:21:17.864662 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:21:17.867813 1548589 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867813 1548589 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867893 1548589 addons.go:234] Setting addon storage-provisioner=true in "default-k8s-diff-port-224675"
W0214 04:21:17.867911 1548589 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:21:17.867931 1548589 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-224675"
I0214 04:21:17.867822 1548589 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867990 1548589 addons.go:234] Setting addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:17.867995 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
W0214 04:21:17.868002 1548589 addons.go:243] addon metrics-server should already be in state true
I0214 04:21:17.868067 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.868372 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868405 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868471 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868586 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868630 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:17.885511 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35721
I0214 04:21:17.886123 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.886736 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.886761 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.887121 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.887700 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.887744 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.888429 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36919
I0214 04:21:17.888436 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37749
I0214 04:21:17.888934 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.888943 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.889459 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889479 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889628 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889638 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889897 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.890090 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.894107 1548589 addons.go:234] Setting addon default-storageclass=true in "default-k8s-diff-port-224675"
W0214 04:21:17.894129 1548589 addons.go:243] addon default-storageclass should already be in state true
I0214 04:21:17.894158 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.894527 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.894573 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.897686 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.898250 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.898277 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.905863 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43347
I0214 04:21:17.906256 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.906706 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.906719 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.907066 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.907252 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.909082 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.912129 1548589 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:17.913850 1548589 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:17.913867 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:21:17.913882 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.913431 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41665
I0214 04:21:17.914856 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.915448 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.915472 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.916246 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.916924 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.916952 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.917227 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917496 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.917535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917782 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.917997 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.918516 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44391
I0214 04:21:17.918650 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.919229 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.919243 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.919838 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.919858 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.920242 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.921364 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.922929 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.925090 1548589 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:21:16.394555 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:16.395079 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:16.395118 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:16.395000 1550044 retry.go:31] will retry after 4.184306662s: waiting for machine to come up
I0214 04:21:17.930415 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:21:17.930435 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:21:17.930457 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.934174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934210 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.934233 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934380 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.937367 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42083
I0214 04:21:17.937375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.937552 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.937951 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.937949 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.938390 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.938405 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.938789 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.939000 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.940318 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.940561 1548589 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:17.940575 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:21:17.940588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.943188 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943558 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.943600 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943816 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.943954 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.944088 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.944168 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:18.108100 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:18.126785 1548589 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:18.199680 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:21:18.199711 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:21:18.211800 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:18.225027 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:21:18.225053 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:21:18.244323 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.244358 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:21:18.276796 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.350125 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:19.154449 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154480 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.154805 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.154827 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.154841 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154853 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.155094 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.155200 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.155172 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.163519 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.163539 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.163825 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.163880 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.561946 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.28509634s)
I0214 04:21:19.562006 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562027 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562344 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.562355 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562371 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562386 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562395 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562697 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562718 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562731 1548589 addons.go:470] Verifying addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:19.632363 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.282192396s)
I0214 04:21:19.632421 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632434 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.632756 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.632777 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.632777 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.632787 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632796 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.633163 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.633192 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.633209 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.635385 1548589 out.go:177] * Enabled addons: default-storageclass, metrics-server, storage-provisioner
I0214 04:21:16.330627 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:18.829917 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:19.636745 1548589 addons.go:505] duration metric: took 1.772300134s for enable addons: enabled=[default-storageclass metrics-server storage-provisioner]
I0214 04:21:20.130535 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:18.278986 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.279953 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.581058 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581627 1548015 main.go:141] libmachine: (old-k8s-version-960884) Found IP for machine: 192.168.72.206
I0214 04:21:20.581661 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has current primary IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581676 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserving static IP address...
I0214 04:21:20.582088 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.582127 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | skip adding static IP to network mk-old-k8s-version-960884 - found existing host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"}
I0214 04:21:20.582141 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserved static IP address: 192.168.72.206
I0214 04:21:20.582161 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting for SSH to be available...
I0214 04:21:20.582177 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Getting to WaitForSSH function...
I0214 04:21:20.584389 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584675 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.584703 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584856 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH client type: external
I0214 04:21:20.584883 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa (-rw-------)
I0214 04:21:20.584919 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.206 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:21:20.584935 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | About to run SSH command:
I0214 04:21:20.584946 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | exit 0
I0214 04:21:20.681801 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | SSH cmd err, output: <nil>:
I0214 04:21:20.682218 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetConfigRaw
I0214 04:21:20.683002 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:20.686419 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.686997 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.687032 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.687340 1548015 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/config.json ...
I0214 04:21:20.687596 1548015 machine.go:94] provisionDockerMachine start ...
I0214 04:21:20.687624 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:20.687892 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.690877 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691276 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.691307 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691491 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.691695 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.691868 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.692066 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.692276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.692587 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.692598 1548015 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:21:20.821994 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:21:20.822030 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822348 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:21:20.822383 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822629 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.825677 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826050 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.826081 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826289 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.826531 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826688 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826859 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.827085 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.827569 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.827591 1548015 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-960884 && echo "old-k8s-version-960884" | sudo tee /etc/hostname
I0214 04:21:20.970187 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-960884
I0214 04:21:20.970224 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.972969 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973418 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.973457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973649 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.973838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.973991 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.974112 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.974276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.974644 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.974663 1548015 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-960884' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-960884/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-960884' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:21:21.109947 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:21:21.109989 1548015 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:21:21.110028 1548015 buildroot.go:174] setting up certificates
I0214 04:21:21.110040 1548015 provision.go:84] configureAuth start
I0214 04:21:21.110055 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:21.110430 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:21.113401 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113720 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.113755 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.116563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.116901 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.116928 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.117065 1548015 provision.go:143] copyHostCerts
I0214 04:21:21.117136 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:21:21.117149 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:21:21.117216 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:21:21.117349 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:21:21.117363 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:21:21.117397 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:21:21.117479 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:21:21.117495 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:21:21.117525 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:21:21.117600 1548015 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-960884 san=[127.0.0.1 192.168.72.206 localhost minikube old-k8s-version-960884]
I0214 04:21:21.249602 1548015 provision.go:177] copyRemoteCerts
I0214 04:21:21.249679 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:21:21.249705 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.252629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253091 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.253120 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253338 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.253535 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.253683 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.253817 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.352374 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:21:21.376684 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0214 04:21:21.400100 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:21:21.422025 1548015 provision.go:87] duration metric: took 311.969213ms to configureAuth
I0214 04:21:21.422062 1548015 buildroot.go:189] setting minikube options for container-runtime
I0214 04:21:21.422289 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:21:21.422388 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.425363 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425732 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.425769 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425922 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.426103 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426259 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426369 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.426526 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.426855 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.426883 1548015 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:21:21.762573 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:21:21.762683 1548015 machine.go:97] duration metric: took 1.075066333s to provisionDockerMachine
I0214 04:21:21.762703 1548015 start.go:293] postStartSetup for "old-k8s-version-960884" (driver="kvm2")
I0214 04:21:21.762722 1548015 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:21:21.762772 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:21.763195 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:21:21.763254 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.766548 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.766932 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.766960 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.767123 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.767363 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.767558 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.767724 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.864283 1548015 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:21:21.869125 1548015 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:21:21.869155 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:21:21.869235 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:21:21.869404 1548015 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:21:21.869542 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:21:21.879233 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:21.901977 1548015 start.go:296] duration metric: took 139.253065ms for postStartSetup
I0214 04:21:21.902024 1548015 fix.go:56] duration metric: took 23.727695033s for fixHost
I0214 04:21:21.902051 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.904963 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905391 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.905429 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905645 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.905838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906175 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.906361 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.906733 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.906748 1548015 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:21:22.034574 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884481.977175244
I0214 04:21:22.034604 1548015 fix.go:216] guest clock: 1707884481.977175244
I0214 04:21:22.034613 1548015 fix.go:229] Guest: 2024-02-14 04:21:21.977175244 +0000 UTC Remote: 2024-02-14 04:21:21.902028761 +0000 UTC m=+362.408004482 (delta=75.146483ms)
I0214 04:21:22.034653 1548015 fix.go:200] guest clock delta is within tolerance: 75.146483ms
I0214 04:21:22.034658 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 23.860366317s
I0214 04:21:22.034685 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.034987 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:22.038178 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038662 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.038693 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038881 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039433 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039661 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039752 1548015 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:21:22.039824 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.039923 1548015 ssh_runner.go:195] Run: cat /version.json
I0214 04:21:22.039956 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.042871 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.042905 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043230 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043269 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043303 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043320 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043406 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043515 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043651 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043738 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043831 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043988 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.044088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.155962 1548015 ssh_runner.go:195] Run: systemctl --version
I0214 04:21:22.161514 1548015 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:21:22.307311 1548015 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:21:22.313795 1548015 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:21:22.313886 1548015 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:21:22.331192 1548015 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:21:22.331219 1548015 start.go:494] detecting cgroup driver to use...
I0214 04:21:22.331295 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:21:22.348525 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:21:22.360700 1548015 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:21:22.360765 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:21:22.373323 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:21:22.386326 1548015 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:21:22.500712 1548015 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:21:22.628951 1548015 docker.go:233] disabling docker service ...
I0214 04:21:22.629047 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:21:22.644389 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:21:22.656100 1548015 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:21:22.771454 1548015 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:21:22.890367 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:21:22.906025 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:21:22.923645 1548015 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0214 04:21:22.923718 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.934179 1548015 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:21:22.934261 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.945371 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.955276 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.965963 1548015 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:21:22.977213 1548015 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:21:22.987180 1548015 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:21:22.987242 1548015 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:21:23.001621 1548015 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:21:23.011279 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:23.138894 1548015 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:21:23.320312 1548015 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:21:23.320405 1548015 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:21:23.331416 1548015 start.go:562] Will wait 60s for crictl version
I0214 04:21:23.331498 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:23.336532 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:21:23.383038 1548015 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:21:23.383147 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.439429 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.497766 1548015 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.24.1 ...
I0214 04:21:23.499416 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:23.502453 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.502863 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:23.502890 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.503096 1548015 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:21:23.507846 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:23.521497 1548015 kubeadm.go:877] updating cluster {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0
s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:21:23.521668 1548015 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0214 04:21:23.521743 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:23.563000 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:23.563077 1548015 ssh_runner.go:195] Run: which lz4
I0214 04:21:23.567232 1548015 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:21:23.571918 1548015 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:21:23.571956 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0214 04:21:20.832765 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:23.331172 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:22.131519 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:24.132734 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:25.632316 1548589 node_ready.go:49] node "default-k8s-diff-port-224675" has status "Ready":"True"
I0214 04:21:25.632355 1548589 node_ready.go:38] duration metric: took 7.505537722s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:25.632378 1548589 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:25.644082 1548589 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663622 1548589 pod_ready.go:92] pod "coredns-5dd5756b68-27jph" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.663652 1548589 pod_ready.go:81] duration metric: took 19.53614ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663665 1548589 pod_ready.go:78] waiting up to 6m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684330 1548589 pod_ready.go:92] pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.684364 1548589 pod_ready.go:81] duration metric: took 20.690068ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684381 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701825 1548589 pod_ready.go:92] pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.701861 1548589 pod_ready.go:81] duration metric: took 17.469749ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701880 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720092 1548589 pod_ready.go:92] pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.720116 1548589 pod_ready.go:81] duration metric: took 18.227307ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720126 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:22.282916 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:24.790590 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:25.407536 1548015 crio.go:444] duration metric: took 1.840347288s to copy over tarball
I0214 04:21:25.407632 1548015 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:28.466951 1548015 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.059268232s)
I0214 04:21:28.466988 1548015 crio.go:451] duration metric: took 3.059413422s to extract the tarball
I0214 04:21:28.466998 1548015 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:28.508517 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:28.568984 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:28.569019 1548015 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:21:28.569089 1548015 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.569113 1548015 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.569124 1548015 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.569194 1548015 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0214 04:21:28.569261 1548015 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.569341 1548015 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.569195 1548015 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.569577 1548015 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570792 1548015 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.570765 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570822 1548015 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0214 04:21:28.570828 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.570830 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.570764 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.570777 1548015 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.570853 1548015 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.761944 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.765651 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.768487 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0214 04:21:28.777658 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.789124 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.831672 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0214 04:21:28.834241 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.835723 1548015 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0214 04:21:28.835774 1548015 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.835821 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.846042 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.894678 1548015 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0214 04:21:28.894728 1548015 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.894778 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944386 1548015 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0214 04:21:28.944443 1548015 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.944481 1548015 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0214 04:21:28.944507 1548015 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0214 04:21:28.944509 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944535 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989723 1548015 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0214 04:21:28.989774 1548015 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0214 04:21:28.989812 1548015 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.989821 1548015 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0214 04:21:28.989853 1548015 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.989779 1548015 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.989907 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989931 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989873 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989933 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:29.110089 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:29.110123 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0214 04:21:29.110142 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0214 04:21:29.110230 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0214 04:21:29.110281 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0214 04:21:29.110339 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:29.110389 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:29.250488 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0214 04:21:29.250791 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0214 04:21:29.254821 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0214 04:21:29.254967 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0214 04:21:29.255074 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0214 04:21:29.255084 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0214 04:21:29.255142 1548015 cache_images.go:92] duration metric: took 686.107956ms to LoadCachedImages
W0214 04:21:29.255222 1548015 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0: no such file or directory
I0214 04:21:29.255239 1548015 kubeadm.go:928] updating node { 192.168.72.206 8443 v1.16.0 crio true true} ...
I0214 04:21:29.255399 1548015 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-960884 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.206
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:29.255479 1548015 ssh_runner.go:195] Run: crio config
I0214 04:21:29.317891 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:29.317923 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:29.317935 1548015 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:29.317961 1548015 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.206 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-960884 NodeName:old-k8s-version-960884 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.206"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.206 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0214 04:21:29.318104 1548015 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.206
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-960884"
kubeletExtraArgs:
node-ip: 192.168.72.206
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.206"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-960884
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.72.206:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:29.318193 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0214 04:21:29.327452 1548015 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:29.327531 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:29.337200 1548015 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0214 04:21:29.352775 1548015 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:29.370691 1548015 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2181 bytes)
I0214 04:21:29.391607 1548015 ssh_runner.go:195] Run: grep 192.168.72.206 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:29.395665 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.206 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:29.409170 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:29.518566 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:29.534160 1548015 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884 for IP: 192.168.72.206
I0214 04:21:29.534202 1548015 certs.go:194] generating shared ca certs ...
I0214 04:21:29.534231 1548015 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:29.534487 1548015 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:29.534575 1548015 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:29.534595 1548015 certs.go:256] generating profile certs ...
I0214 04:21:29.534721 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/client.key
I0214 04:21:29.534813 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key.83e6709b
I0214 04:21:29.534879 1548015 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key
I0214 04:21:29.535019 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:29.535076 1548015 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:29.535089 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:29.535122 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:29.535155 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:29.535198 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:29.535265 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:29.536212 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:25.332784 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:27.830166 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:26.031649 1548589 pod_ready.go:92] pod "kube-proxy-dbkzv" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:26.031684 1548589 pod_ready.go:81] duration metric: took 311.550001ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:26.031698 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:28.040585 1548589 pod_ready.go:102] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:30.465468 1548589 pod_ready.go:92] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:30.465504 1548589 pod_ready.go:81] duration metric: took 4.433796246s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:30.465519 1548589 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:27.279574 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.552593 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.576065 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:29.714093 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:29.748054 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:29.777699 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0214 04:21:29.804606 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:29.829987 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:29.853803 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0214 04:21:29.878360 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:29.901845 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:29.926801 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:29.951044 1548015 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:29.970807 1548015 ssh_runner.go:195] Run: openssl version
I0214 04:21:29.977053 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:29.990302 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996045 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996150 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:30.002320 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:30.014065 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:30.027194 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032670 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032739 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.039164 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:30.051920 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:30.064135 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070013 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070096 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.076531 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:30.087989 1548015 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:30.094182 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:30.100653 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:30.106827 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:30.112695 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:30.118991 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:30.124783 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:30.130728 1548015 kubeadm.go:391] StartCluster: {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s M
ount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:30.130856 1548015 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:30.130920 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.172760 1548015 cri.go:89] found id: ""
I0214 04:21:30.172844 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:30.182798 1548015 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:30.182820 1548015 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:30.182833 1548015 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:30.182890 1548015 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:30.191987 1548015 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:30.193332 1548015 kubeconfig.go:125] found "old-k8s-version-960884" server: "https://192.168.72.206:8443"
I0214 04:21:30.195906 1548015 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:30.204941 1548015 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.72.206
I0214 04:21:30.204971 1548015 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:30.204983 1548015 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:30.205030 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.246746 1548015 cri.go:89] found id: ""
I0214 04:21:30.246835 1548015 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:30.265837 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:30.277949 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:30.277986 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:21:30.278049 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:21:30.287840 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:30.287899 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:30.298734 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:21:30.307885 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:30.307983 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:30.317668 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:21:30.326303 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:30.326366 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:30.335884 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:21:30.344902 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:30.345020 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:30.355826 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:30.366201 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:30.517881 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.202023 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.400048 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.491748 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.625368 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:31.625475 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.126481 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.626533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.126533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.625871 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.658063 1548015 api_server.go:72] duration metric: took 2.032718395s to wait for apiserver process to appear ...
I0214 04:21:33.658096 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:33.658118 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:30.329984 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.830531 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.831590 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.475902 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.973325 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:31.780474 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.281836 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:36.284001 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.658562 1548015 api_server.go:269] stopped: https://192.168.72.206:8443/healthz: Get "https://192.168.72.206:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:38.658613 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.453628 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.453667 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:39.453686 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.476016 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.476042 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:37.330750 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.829556 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.659245 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.678800 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:39.678842 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.158920 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.165230 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:40.165286 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.659134 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.666024 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:21:40.674534 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:21:40.674571 1548015 api_server.go:131] duration metric: took 7.016466266s to wait for apiserver health ...
I0214 04:21:40.674584 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:40.674594 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:40.676474 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:36.974542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.474238 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.781991 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.280560 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:40.677823 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:40.689136 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:40.709008 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:40.719306 1548015 system_pods.go:59] 7 kube-system pods found
I0214 04:21:40.719343 1548015 system_pods.go:61] "coredns-5644d7b6d9-9ph4x" [6f0623c3-2524-4ba1-b0f2-43c8cdf5d3b2] Running
I0214 04:21:40.719350 1548015 system_pods.go:61] "etcd-old-k8s-version-960884" [6b8c8c75-cb3e-4b82-bc58-51b05ed826a7] Running
I0214 04:21:40.719357 1548015 system_pods.go:61] "kube-apiserver-old-k8s-version-960884" [2d8f7b59-3872-4499-9504-1f030e7c8094] Running
I0214 04:21:40.719364 1548015 system_pods.go:61] "kube-controller-manager-old-k8s-version-960884" [78c409e9-42ac-447c-99c6-6f9b687c2d36] Running
I0214 04:21:40.719378 1548015 system_pods.go:61] "kube-proxy-csc94" [091dfdb5-e19e-40c3-8d1a-e27448a61134] Running
I0214 04:21:40.719384 1548015 system_pods.go:61] "kube-scheduler-old-k8s-version-960884" [7cd0a53c-f839-4886-8902-95a9617c0223] Running
I0214 04:21:40.719390 1548015 system_pods.go:61] "storage-provisioner" [1531bf30-b7cb-46dd-8059-139eda59ab91] Running
I0214 04:21:40.719402 1548015 system_pods.go:74] duration metric: took 10.361661ms to wait for pod list to return data ...
I0214 04:21:40.719419 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:40.723811 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:40.723849 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:40.723864 1548015 node_conditions.go:105] duration metric: took 4.43897ms to run NodePressure ...
I0214 04:21:40.723893 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:40.977897 1548015 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:40.981121 1548015 retry.go:31] will retry after 128.555505ms: kubelet not initialised
I0214 04:21:41.115327 1548015 retry.go:31] will retry after 372.280627ms: kubelet not initialised
I0214 04:21:41.502405 1548015 retry.go:31] will retry after 313.632774ms: kubelet not initialised
I0214 04:21:41.825529 1548015 retry.go:31] will retry after 544.787289ms: kubelet not initialised
I0214 04:21:42.384758 1548015 retry.go:31] will retry after 1.43607177s: kubelet not initialised
I0214 04:21:43.832903 1548015 retry.go:31] will retry after 1.235835339s: kubelet not initialised
I0214 04:21:42.329232 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.330406 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.974395 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.477378 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:43.778781 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.778914 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.073614 1548015 retry.go:31] will retry after 4.115318211s: kubelet not initialised
I0214 04:21:49.193659 1548015 retry.go:31] will retry after 3.071167603s: kubelet not initialised
I0214 04:21:46.829802 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.331008 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:46.974416 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.473600 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:48.278392 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:50.279104 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.271827 1548015 retry.go:31] will retry after 4.905866185s: kubelet not initialised
I0214 04:21:51.331690 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.829509 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:51.973092 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.974274 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.280558 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:54.782002 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:55.278849 1548199 pod_ready.go:92] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.278875 1548199 pod_ready.go:81] duration metric: took 39.007391751s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.278887 1548199 pod_ready.go:78] waiting up to 4m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284671 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.284698 1548199 pod_ready.go:81] duration metric: took 5.804847ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284711 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289743 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.289762 1548199 pod_ready.go:81] duration metric: took 5.043413ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289770 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294751 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.294769 1548199 pod_ready.go:81] duration metric: took 4.99309ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294778 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299781 1548199 pod_ready.go:92] pod "kube-proxy-x55kr" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.299805 1548199 pod_ready.go:81] duration metric: took 5.020271ms for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299817 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677017 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.677045 1548199 pod_ready.go:81] duration metric: took 377.218998ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677059 1548199 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
I0214 04:21:57.184269 1548015 retry.go:31] will retry after 9.183740474s: kubelet not initialised
I0214 04:21:56.331498 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.828024 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:56.473208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.475219 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.974208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:57.684889 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.187231 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.829899 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.329789 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.474087 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:05.973662 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:02.683519 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:04.686765 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:06.375294 1548015 retry.go:31] will retry after 10.020373951s: kubelet not initialised
I0214 04:22:05.330250 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.829740 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.830530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.978588 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:10.473694 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.184721 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:11.185656 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.329405 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.829220 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.474366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.975443 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:13.683763 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:15.683805 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:16.402320 1548015 retry.go:31] will retry after 15.374173134s: kubelet not initialised
I0214 04:22:16.829525 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.330075 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:17.474403 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.973780 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:18.185466 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:20.186291 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.829432 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:23.834007 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.976320 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.474283 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:22.684964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.685062 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.685477 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.329169 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.329997 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.476641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.973366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:30.974012 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:29.184272 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.184459 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.781677 1548015 kubeadm.go:733] kubelet initialised
I0214 04:22:31.781704 1548015 kubeadm.go:734] duration metric: took 50.803779674s waiting for restarted kubelet to initialise ...
I0214 04:22:31.781719 1548015 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:22:31.786850 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791542 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.791560 1548015 pod_ready.go:81] duration metric: took 4.686316ms for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791568 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796485 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.796505 1548015 pod_ready.go:81] duration metric: took 4.931563ms for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796514 1548015 pod_ready.go:78] waiting up to 4m0s for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805785 1548015 pod_ready.go:92] pod "etcd-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.805802 1548015 pod_ready.go:81] duration metric: took 9.282838ms for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805810 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810054 1548015 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.810071 1548015 pod_ready.go:81] duration metric: took 4.255532ms for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810082 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182215 1548015 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.182243 1548015 pod_ready.go:81] duration metric: took 372.153995ms for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182252 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582145 1548015 pod_ready.go:92] pod "kube-proxy-csc94" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.582173 1548015 pod_ready.go:81] duration metric: took 399.915006ms for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582181 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981350 1548015 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.981378 1548015 pod_ready.go:81] duration metric: took 399.188492ms for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981415 1548015 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
I0214 04:22:30.830906 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.330140 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.473744 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.973699 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.186827 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.686309 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:34.989538 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.488713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.488883 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.828958 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.829284 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.829823 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.974025 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.473910 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.688964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.185392 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:41.989551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.487817 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.329132 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.329344 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.475040 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.972605 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.187968 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.683996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.685030 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.488902 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.489494 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.829203 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.829494 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.973991 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:49.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.685120 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.686084 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.988398 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:52.988448 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.332998 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.829030 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.979340 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.476506 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.184251 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:55.685108 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.990421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:57.488098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:59.489487 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.328826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.973425 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.973762 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.185513 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.684633 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.989929 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:04.489964 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.828826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.832159 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.473241 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:03.474787 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.474970 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.685927 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.184376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:06.494093 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:08.989439 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.328777 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.828637 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.829373 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.973237 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.975687 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.184628 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.184711 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.187647 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.488966 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.988214 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.830718 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.329069 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:12.474693 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.977568 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.189114 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:15.684342 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.490073 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.989036 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.329532 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.332792 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:17.475839 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:19.972797 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.184713 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.683768 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.489160 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.489440 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.829097 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.830033 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.830536 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.974815 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.976133 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.684285 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.685554 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:25.988251 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.988908 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.329244 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.330485 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:26.475964 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:28.982419 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.184598 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.683919 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.684156 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.991522 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:32.488915 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.829760 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.329419 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.473542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.973595 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.973745 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.685000 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.685530 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.988612 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.988713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.989808 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.829339 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:39.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.473757 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.474119 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.184045 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.185960 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.488363 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.989158 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.329290 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.329388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.975321 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.473736 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.683468 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:44.690416 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:46.489697 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:48.989092 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.829184 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.831722 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.474154 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.974446 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.184559 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.186644 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.687583 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.489421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:53.988562 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:50.329667 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.338563 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.829530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.472871 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.473807 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.184095 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.687057 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.488978 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.989503 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.829824 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.329912 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.474847 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.973570 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:00.973652 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.184086 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.488818 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.987787 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.830119 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:04.329491 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:02.973916 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.473218 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.686039 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.184833 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.988871 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.989591 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.329626 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.330752 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.973857 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.474126 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.185966 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.684238 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.489965 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.989505 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.829538 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.830552 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.834481 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.973081 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.474984 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.686130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.184428 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.989770 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.488555 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.828863 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.974045 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:20.474441 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.185605 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.684728 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.685632 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.988389 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.989011 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.491174 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.829015 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:23.830388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:22.974348 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:25.473908 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.183571 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.184732 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.989443 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:29.489238 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.329468 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.829440 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:27.973912 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.472580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.184943 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.684148 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.489461 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.989426 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.328521 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.474634 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:34.476234 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.684963 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.185485 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.488685 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.489813 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.829187 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.829640 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.973580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.974641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.684542 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.186898 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.490022 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.988898 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.328976 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.329745 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.829057 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:41.473013 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:43.473476 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:45.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.683866 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.684597 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:46.687189 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.994614 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.489146 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.329572 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.831061 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.474959 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.973243 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.187340 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.684163 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.988804 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.989029 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.489969 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.328728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.328898 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.473423 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.975259 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.184131 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.184881 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.490033 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.989280 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.329901 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.827955 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:57.473867 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:59.973370 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.684729 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.684873 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.487690 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.988399 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.828728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:02.829737 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.973785 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:04.472611 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.183568 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.184388 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.988477 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.989996 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.329020 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.829709 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.821931 1548416 pod_ready.go:81] duration metric: took 4m0.000330437s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
E0214 04:25:09.821969 1548416 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:09.821992 1548416 pod_ready.go:38] duration metric: took 4m13.851272943s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:09.822023 1548416 kubeadm.go:591] duration metric: took 4m23.487018823s to restartPrimaryControlPlane
W0214 04:25:09.822227 1548416 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:09.822321 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:06.472962 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:08.473224 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.475222 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.184478 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.185147 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:11.186402 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.490868 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.989663 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.974982 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.472802 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:13.187130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.685270 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.489955 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.988265 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.473792 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:19.974720 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:18.185036 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:20.687587 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.917450 1548416 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (14.095094363s)
I0214 04:25:23.917578 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:23.933147 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:25:23.944003 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:25:23.954648 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:25:23.954670 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:25:23.954721 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:25:23.964628 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:25:23.964687 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:25:23.975077 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:25:23.985324 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:25:23.985395 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:25:23.994917 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:25:24.003630 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:25:24.003677 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:25:24.012938 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:25:24.021462 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:25:24.021516 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:25:24.030687 1548416 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:25:24.084345 1548416 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:25:24.084459 1548416 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:25:24.247090 1548416 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:25:24.247242 1548416 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:25:24.247374 1548416 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:25:24.485795 1548416 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:25:19.988669 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:21.988724 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.989786 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.487801 1548416 out.go:204] - Generating certificates and keys ...
I0214 04:25:24.487929 1548416 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:25:24.488045 1548416 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:25:24.488156 1548416 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:25:24.488237 1548416 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:25:24.488319 1548416 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:25:24.488383 1548416 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:25:24.488535 1548416 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:25:24.489833 1548416 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:25:24.491055 1548416 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:25:24.492160 1548416 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:25:24.492954 1548416 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:25:24.493057 1548416 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:25:24.698026 1548416 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:25:24.804410 1548416 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:25:24.911827 1548416 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:25:25.071754 1548416 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:25:25.072362 1548416 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:25:25.074829 1548416 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:25:25.076806 1548416 out.go:204] - Booting up control plane ...
I0214 04:25:25.076910 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:25:25.077012 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:25:25.077429 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:25:25.093739 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:25:25.094504 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:25:25.094594 1548416 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:25:25.245976 1548416 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:25:22.473854 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.474402 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.183996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:25.186464 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.489150 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.489653 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.974174 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.975072 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.473411 1548589 pod_ready.go:81] duration metric: took 4m0.007878225s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:25:30.473436 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0214 04:25:30.473443 1548589 pod_ready.go:38] duration metric: took 4m4.841053907s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:30.473469 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:30.473534 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:30.473603 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:30.529327 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:30.529352 1548589 cri.go:89] found id: ""
I0214 04:25:30.529362 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:30.529463 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.538030 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:30.538092 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:30.589897 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:30.589925 1548589 cri.go:89] found id: ""
I0214 04:25:30.589936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:30.590005 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.595536 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:30.595652 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:30.650191 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:30.650224 1548589 cri.go:89] found id: ""
I0214 04:25:30.650235 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:30.650305 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.666693 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:30.666780 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:30.725870 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:30.725896 1548589 cri.go:89] found id: ""
I0214 04:25:30.725906 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:30.725982 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.731165 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:30.731252 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:30.772330 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:30.772361 1548589 cri.go:89] found id: ""
I0214 04:25:30.772372 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:30.772432 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.777656 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:30.777735 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:30.825727 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:30.825760 1548589 cri.go:89] found id: ""
I0214 04:25:30.825771 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:30.825849 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.830555 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:30.830636 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:30.885427 1548589 cri.go:89] found id: ""
I0214 04:25:30.885461 1548589 logs.go:276] 0 containers: []
W0214 04:25:30.885471 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:30.885480 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:30.885549 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:30.932894 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:30.932928 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:30.932935 1548589 cri.go:89] found id: ""
I0214 04:25:30.932945 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:30.933011 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.937903 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.941946 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:30.941972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:30.957244 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:30.957298 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:31.006421 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:31.006469 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:27.687719 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.184052 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:33.251700 1548416 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.005690 seconds
I0214 04:25:33.251865 1548416 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:25:33.279172 1548416 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:25:33.813646 1548416 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:25:33.813879 1548416 kubeadm.go:309] [mark-control-plane] Marking the node embed-certs-722906 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:25:34.330117 1548416 kubeadm.go:309] [bootstrap-token] Using token: ljwfse.zvxgc1v12nz5i5q8
I0214 04:25:30.490723 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:32.490888 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.331680 1548416 out.go:204] - Configuring RBAC rules ...
I0214 04:25:34.331854 1548416 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:25:34.338019 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:25:34.346414 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:25:34.356280 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:25:34.363364 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:25:34.367537 1548416 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:25:34.386334 1548416 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:25:34.635264 1548416 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:25:34.746128 1548416 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:25:34.747640 1548416 kubeadm.go:309]
I0214 04:25:34.747718 1548416 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:25:34.747729 1548416 kubeadm.go:309]
I0214 04:25:34.747815 1548416 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:25:34.747825 1548416 kubeadm.go:309]
I0214 04:25:34.747855 1548416 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:25:34.747919 1548416 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:25:34.747991 1548416 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:25:34.748001 1548416 kubeadm.go:309]
I0214 04:25:34.748053 1548416 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:25:34.748057 1548416 kubeadm.go:309]
I0214 04:25:34.748096 1548416 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:25:34.748102 1548416 kubeadm.go:309]
I0214 04:25:34.748166 1548416 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:25:34.748221 1548416 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:25:34.748286 1548416 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:25:34.748293 1548416 kubeadm.go:309]
I0214 04:25:34.748388 1548416 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:25:34.748476 1548416 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:25:34.748483 1548416 kubeadm.go:309]
I0214 04:25:34.748576 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748694 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:25:34.748719 1548416 kubeadm.go:309] --control-plane
I0214 04:25:34.748725 1548416 kubeadm.go:309]
I0214 04:25:34.748824 1548416 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:25:34.748831 1548416 kubeadm.go:309]
I0214 04:25:34.748897 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748999 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:25:34.752065 1548416 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:25:34.752103 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:25:34.752116 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:25:34.753766 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:25:34.754902 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:25:34.796511 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:25:34.854873 1548416 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:25:34.855010 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:34.855147 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-722906 minikube.k8s.io/updated_at=2024_02_14T04_25_34_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=embed-certs-722906 minikube.k8s.io/primary=true
I0214 04:25:34.950220 1548416 ops.go:34] apiserver oom_adj: -16
I0214 04:25:35.202083 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:31.057754 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:31.057788 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:31.119551 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:31.119592 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:31.180933 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:31.180972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:31.236512 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:31.236559 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:31.290709 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:31.290749 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:31.343989 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:31.344029 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:31.391042 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:31.391076 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:31.436728 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:31.436768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:31.924773 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:31.924835 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:32.076912 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:32.076958 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.634522 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:34.660761 1548589 api_server.go:72] duration metric: took 4m16.796363202s to wait for apiserver process to appear ...
I0214 04:25:34.660794 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:34.660846 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:34.660918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:34.730857 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.730891 1548589 cri.go:89] found id: ""
I0214 04:25:34.730902 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:34.730963 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.735849 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:34.735918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:34.791895 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:34.791926 1548589 cri.go:89] found id: ""
I0214 04:25:34.791936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:34.791999 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.798706 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:34.798792 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:34.848256 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:34.848280 1548589 cri.go:89] found id: ""
I0214 04:25:34.848288 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:34.848339 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.853629 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:34.853699 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:34.908476 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:34.908509 1548589 cri.go:89] found id: ""
I0214 04:25:34.908521 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:34.908586 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.913799 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:34.913881 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:34.956647 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:34.956733 1548589 cri.go:89] found id: ""
I0214 04:25:34.956747 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:34.956799 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.961972 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:34.962058 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:35.005734 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.005763 1548589 cri.go:89] found id: ""
I0214 04:25:35.005772 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:35.005824 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.012134 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:35.012215 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:35.057761 1548589 cri.go:89] found id: ""
I0214 04:25:35.057788 1548589 logs.go:276] 0 containers: []
W0214 04:25:35.057795 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:35.057801 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:35.057902 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:35.100965 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.100992 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.100996 1548589 cri.go:89] found id: ""
I0214 04:25:35.101003 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:35.101058 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.105885 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.110123 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:35.110151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:35.189435 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:35.189477 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:35.206289 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:35.206328 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:35.263399 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:35.263450 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.329373 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:35.329410 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.370980 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:35.371016 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:35.519971 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:35.520010 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.565453 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:35.565488 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:35.622596 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:35.622626 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:35.679526 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:35.679563 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:35.726343 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:35.726386 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:35.774533 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:35.774578 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:35.819726 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:35.819758 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:32.186812 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.686565 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.989832 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:37.489923 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:35.702927 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.203043 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.702176 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.203031 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.702509 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.203045 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.703098 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.203120 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.702193 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:40.202469 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.718371 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:25:38.726571 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:25:38.728501 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:25:38.728531 1548589 api_server.go:131] duration metric: took 4.067727996s to wait for apiserver health ...
I0214 04:25:38.728543 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:38.728574 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:38.728639 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:38.777478 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:38.777506 1548589 cri.go:89] found id: ""
I0214 04:25:38.777516 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:38.777582 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.785109 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:38.785170 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:38.829370 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:38.829398 1548589 cri.go:89] found id: ""
I0214 04:25:38.829409 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:38.829475 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.834285 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:38.834359 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:38.879921 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:38.879967 1548589 cri.go:89] found id: ""
I0214 04:25:38.879978 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:38.880045 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.884937 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:38.884994 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:38.929638 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:38.929663 1548589 cri.go:89] found id: ""
I0214 04:25:38.929672 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:38.929739 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.934420 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:38.934485 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:38.982428 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:38.982464 1548589 cri.go:89] found id: ""
I0214 04:25:38.982476 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:38.982541 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.987942 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:38.988014 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:39.027009 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:39.027041 1548589 cri.go:89] found id: ""
I0214 04:25:39.027051 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:39.027115 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.031258 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:39.031312 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:39.074333 1548589 cri.go:89] found id: ""
I0214 04:25:39.074363 1548589 logs.go:276] 0 containers: []
W0214 04:25:39.074374 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:39.074382 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:39.074445 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:39.121097 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.121119 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.121125 1548589 cri.go:89] found id: ""
I0214 04:25:39.121132 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:39.121192 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.125559 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.129744 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:39.129768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:39.169819 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:39.169857 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:39.217193 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:39.217224 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:39.267119 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:39.267173 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:39.333382 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:39.333426 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.380541 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:39.380575 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.426020 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:39.426061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:39.787418 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:39.787471 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:39.850366 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:39.850412 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:39.970082 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:39.970127 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:40.014849 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:40.014876 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:40.064556 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:40.064597 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:40.116058 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:40.116092 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:37.187809 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:39.684638 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.642784 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:25:42.642824 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.642836 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.642847 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.642854 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.642860 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.642866 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.642876 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.642889 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.642900 1548589 system_pods.go:74] duration metric: took 3.914348976s to wait for pod list to return data ...
I0214 04:25:42.642913 1548589 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:42.647178 1548589 default_sa.go:45] found service account: "default"
I0214 04:25:42.647199 1548589 default_sa.go:55] duration metric: took 4.279291ms for default service account to be created ...
I0214 04:25:42.647208 1548589 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:42.656453 1548589 system_pods.go:86] 8 kube-system pods found
I0214 04:25:42.656474 1548589 system_pods.go:89] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.656480 1548589 system_pods.go:89] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.656485 1548589 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.656490 1548589 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.656494 1548589 system_pods.go:89] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.656498 1548589 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.656504 1548589 system_pods.go:89] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.656509 1548589 system_pods.go:89] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.656517 1548589 system_pods.go:126] duration metric: took 9.303804ms to wait for k8s-apps to be running ...
I0214 04:25:42.656523 1548589 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:42.656567 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:42.675938 1548589 system_svc.go:56] duration metric: took 19.40332ms WaitForService to wait for kubelet
I0214 04:25:42.675968 1548589 kubeadm.go:576] duration metric: took 4m24.811581461s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:42.675997 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:42.680017 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:42.680051 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:42.680099 1548589 node_conditions.go:105] duration metric: took 4.09496ms to run NodePressure ...
I0214 04:25:42.680116 1548589 start.go:240] waiting for startup goroutines ...
I0214 04:25:42.680129 1548589 start.go:245] waiting for cluster config update ...
I0214 04:25:42.680147 1548589 start.go:254] writing updated cluster config ...
I0214 04:25:42.680530 1548589 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:42.736509 1548589 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:42.739295 1548589 out.go:177] * Done! kubectl is now configured to use "default-k8s-diff-port-224675" cluster and "default" namespace by default
I0214 04:25:39.988499 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.487797 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.488009 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:40.702290 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.202214 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.702270 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.202407 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.702166 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.202987 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.702484 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.202110 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.702114 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:45.202558 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.184826 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.685376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.685510 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:45.702721 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.202291 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.703068 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.837652 1548416 kubeadm.go:1106] duration metric: took 11.982686598s to wait for elevateKubeSystemPrivileges
W0214 04:25:46.837704 1548416 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:25:46.837716 1548416 kubeadm.go:393] duration metric: took 5m0.565491944s to StartCluster
I0214 04:25:46.837742 1548416 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.837855 1548416 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:25:46.840795 1548416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.841125 1548416 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:25:46.842696 1548416 out.go:177] * Verifying Kubernetes components...
I0214 04:25:46.841205 1548416 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:25:46.841387 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:25:46.844126 1548416 addons.go:69] Setting default-storageclass=true in profile "embed-certs-722906"
I0214 04:25:46.844139 1548416 addons.go:69] Setting metrics-server=true in profile "embed-certs-722906"
I0214 04:25:46.844161 1548416 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-722906"
I0214 04:25:46.844186 1548416 addons.go:234] Setting addon metrics-server=true in "embed-certs-722906"
W0214 04:25:46.844201 1548416 addons.go:243] addon metrics-server should already be in state true
I0214 04:25:46.844238 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844126 1548416 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-722906"
I0214 04:25:46.844300 1548416 addons.go:234] Setting addon storage-provisioner=true in "embed-certs-722906"
W0214 04:25:46.844326 1548416 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:25:46.844126 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:25:46.844363 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844562 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844592 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844663 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844699 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844736 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844799 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.861369 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43067
I0214 04:25:46.861608 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41001
I0214 04:25:46.862027 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862176 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862591 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862626 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.862672 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862689 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.863022 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863215 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37963
I0214 04:25:46.863398 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863596 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.863763 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.864032 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.864056 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.864428 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.864568 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.864611 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.864955 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.865007 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.867986 1548416 addons.go:234] Setting addon default-storageclass=true in "embed-certs-722906"
W0214 04:25:46.868013 1548416 addons.go:243] addon default-storageclass should already be in state true
I0214 04:25:46.868058 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.868432 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.868487 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.881291 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39701
I0214 04:25:46.882035 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.882540 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.882555 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.883263 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34619
I0214 04:25:46.883304 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.883548 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.883717 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.884554 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.884580 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.885036 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.885241 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.885647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.885718 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35895
I0214 04:25:46.887988 1548416 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:25:46.886555 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.886681 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.889304 1548416 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:46.889318 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:25:46.889335 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.890487 1548416 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:25:46.489212 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:48.990116 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.890206 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.891625 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.891590 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:25:46.891694 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:25:46.891710 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.892169 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.892674 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893285 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.893311 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.893494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.893556 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.893583 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893734 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.893993 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.894174 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.894439 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.894862 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.894886 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.895040 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.895172 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.895286 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.895362 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.912395 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38507
I0214 04:25:46.912945 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.913571 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.913598 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.913955 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.914139 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.915701 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.915924 1548416 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:46.915936 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:25:46.915949 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.918689 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919161 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.919259 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919614 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.919795 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.919991 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.920118 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:47.174988 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:25:47.211043 1548416 node_ready.go:35] waiting up to 6m0s for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248873 1548416 node_ready.go:49] node "embed-certs-722906" has status "Ready":"True"
I0214 04:25:47.248902 1548416 node_ready.go:38] duration metric: took 37.827003ms for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248914 1548416 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:47.291049 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:47.295308 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:47.304396 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:25:47.304431 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:25:47.312577 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:47.352103 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:25:47.352142 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:25:47.652975 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:47.653009 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:25:47.701829 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:49.316545 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.106061464s)
I0214 04:25:49.397232 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397245 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.084547595s)
I0214 04:25:49.397335 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397353 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397607 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397715 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397743 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397752 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397771 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397807 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397824 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397839 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397694 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.397987 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.398013 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398033 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.398118 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398132 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.454369 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.454395 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.454743 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.454768 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.658753 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.956862479s)
I0214 04:25:49.658827 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.658845 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659187 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659205 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659217 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.659226 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659474 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659492 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659501 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.659504 1548416 addons.go:470] Verifying addon metrics-server=true in "embed-certs-722906"
I0214 04:25:49.662582 1548416 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:25:49.664096 1548416 addons.go:505] duration metric: took 2.82289258s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:25:48.687996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:51.185303 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:50.303857 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:50.303890 1548416 pod_ready.go:81] duration metric: took 3.008544941s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:50.303906 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312602 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.312630 1548416 pod_ready.go:81] duration metric: took 1.008715179s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312643 1548416 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318888 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.318913 1548416 pod_ready.go:81] duration metric: took 6.260888ms for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318925 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326339 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.326358 1548416 pod_ready.go:81] duration metric: took 7.425473ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326366 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336131 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.336157 1548416 pod_ready.go:81] duration metric: took 9.784766ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336170 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344427 1548416 pod_ready.go:92] pod "kube-proxy-tzpr9" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.344452 1548416 pod_ready.go:81] duration metric: took 1.008276095s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344461 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703142 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.703165 1548416 pod_ready.go:81] duration metric: took 358.6975ms for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703173 1548416 pod_ready.go:38] duration metric: took 5.454247611s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:52.703187 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:52.703240 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:52.721042 1548416 api_server.go:72] duration metric: took 5.879877619s to wait for apiserver process to appear ...
I0214 04:25:52.721069 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:52.721091 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:25:52.727234 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:25:52.728584 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:25:52.728607 1548416 api_server.go:131] duration metric: took 7.530707ms to wait for apiserver health ...
I0214 04:25:52.728617 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:52.905660 1548416 system_pods.go:59] 9 kube-system pods found
I0214 04:25:52.905694 1548416 system_pods.go:61] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:52.905702 1548416 system_pods.go:61] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:52.905709 1548416 system_pods.go:61] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:52.905714 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:52.905719 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:52.905724 1548416 system_pods.go:61] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:52.905731 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:52.905740 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:52.905753 1548416 system_pods.go:61] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:52.905764 1548416 system_pods.go:74] duration metric: took 177.140213ms to wait for pod list to return data ...
I0214 04:25:52.905777 1548416 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:53.100558 1548416 default_sa.go:45] found service account: "default"
I0214 04:25:53.100586 1548416 default_sa.go:55] duration metric: took 194.801355ms for default service account to be created ...
I0214 04:25:53.100596 1548416 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:53.304778 1548416 system_pods.go:86] 9 kube-system pods found
I0214 04:25:53.304808 1548416 system_pods.go:89] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:53.304814 1548416 system_pods.go:89] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:53.304818 1548416 system_pods.go:89] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:53.304822 1548416 system_pods.go:89] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:53.304826 1548416 system_pods.go:89] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:53.304830 1548416 system_pods.go:89] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:53.304836 1548416 system_pods.go:89] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:53.304843 1548416 system_pods.go:89] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:53.304848 1548416 system_pods.go:89] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:53.304857 1548416 system_pods.go:126] duration metric: took 204.2556ms to wait for k8s-apps to be running ...
I0214 04:25:53.304863 1548416 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:53.304908 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:53.321806 1548416 system_svc.go:56] duration metric: took 16.912625ms WaitForService to wait for kubelet
I0214 04:25:53.321844 1548416 kubeadm.go:576] duration metric: took 6.480687176s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:53.321873 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:53.501541 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:53.501571 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:53.501582 1548416 node_conditions.go:105] duration metric: took 179.703171ms to run NodePressure ...
I0214 04:25:53.501593 1548416 start.go:240] waiting for startup goroutines ...
I0214 04:25:53.501600 1548416 start.go:245] waiting for cluster config update ...
I0214 04:25:53.501610 1548416 start.go:254] writing updated cluster config ...
I0214 04:25:53.501868 1548416 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:53.554017 1548416 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:53.556089 1548416 out.go:177] * Done! kubectl is now configured to use "embed-certs-722906" cluster and "default" namespace by default
I0214 04:25:51.488936 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.988506 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.686041 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:55.677854 1548199 pod_ready.go:81] duration metric: took 4m0.000776482s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
E0214 04:25:55.677886 1548199 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:55.677908 1548199 pod_ready.go:38] duration metric: took 4m39.417217273s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:55.677936 1548199 kubeadm.go:591] duration metric: took 5m19.120995318s to restartPrimaryControlPlane
W0214 04:25:55.678003 1548199 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:55.678033 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:55.989446 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:58.490001 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:00.989098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:03.488351 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:05.491080 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:07.990103 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:09.129870 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (13.451791169s)
I0214 04:26:09.129957 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:09.143478 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:09.153419 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:09.162505 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:09.162527 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:26:09.162576 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:09.171259 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:09.171322 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:09.179961 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:09.188272 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:09.188334 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:09.197398 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:09.206885 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:09.206953 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:09.215702 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:09.224447 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:09.224504 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:09.233076 1548199 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:26:09.449400 1548199 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:10.489135 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:12.490085 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:14.989284 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:16.989501 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:19.489121 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:20.589989 1548199 kubeadm.go:309] [init] Using Kubernetes version: v1.29.0-rc.2
I0214 04:26:20.590079 1548199 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:20.590160 1548199 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:20.590282 1548199 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:20.590404 1548199 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:20.590459 1548199 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:20.592006 1548199 out.go:204] - Generating certificates and keys ...
I0214 04:26:20.592122 1548199 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:20.592229 1548199 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:20.592338 1548199 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:20.592403 1548199 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:20.592503 1548199 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:20.592599 1548199 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:20.592693 1548199 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:20.592787 1548199 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:20.592902 1548199 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:20.592997 1548199 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:20.593045 1548199 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:20.593123 1548199 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:20.593198 1548199 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:20.593294 1548199 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0214 04:26:20.593365 1548199 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:20.593442 1548199 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:20.593534 1548199 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:20.593660 1548199 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:20.593761 1548199 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:20.595405 1548199 out.go:204] - Booting up control plane ...
I0214 04:26:20.595518 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:20.595632 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:20.595748 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:20.595890 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:20.596009 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:20.596086 1548199 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:26:20.596252 1548199 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:20.596349 1548199 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.003185 seconds
I0214 04:26:20.596497 1548199 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:20.596673 1548199 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:20.596762 1548199 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:20.597019 1548199 kubeadm.go:309] [mark-control-plane] Marking the node no-preload-527067 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:26:20.597103 1548199 kubeadm.go:309] [bootstrap-token] Using token: yl18az.ikdg7kzcuqfvy8ic
I0214 04:26:20.598756 1548199 out.go:204] - Configuring RBAC rules ...
I0214 04:26:20.598884 1548199 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:20.598995 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:26:20.599173 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:20.599325 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:20.599486 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:20.599606 1548199 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:20.599753 1548199 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:26:20.599838 1548199 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:20.599907 1548199 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:20.599918 1548199 kubeadm.go:309]
I0214 04:26:20.599999 1548199 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:20.600014 1548199 kubeadm.go:309]
I0214 04:26:20.600130 1548199 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:20.600144 1548199 kubeadm.go:309]
I0214 04:26:20.600185 1548199 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:20.600262 1548199 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:20.600334 1548199 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:20.600344 1548199 kubeadm.go:309]
I0214 04:26:20.600414 1548199 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:26:20.600423 1548199 kubeadm.go:309]
I0214 04:26:20.600486 1548199 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:26:20.600494 1548199 kubeadm.go:309]
I0214 04:26:20.600559 1548199 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:20.600678 1548199 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:20.600743 1548199 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:20.600749 1548199 kubeadm.go:309]
I0214 04:26:20.600828 1548199 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:20.600931 1548199 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:20.600952 1548199 kubeadm.go:309]
I0214 04:26:20.601036 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601125 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:20.601144 1548199 kubeadm.go:309] --control-plane
I0214 04:26:20.601149 1548199 kubeadm.go:309]
I0214 04:26:20.601216 1548199 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:20.601222 1548199 kubeadm.go:309]
I0214 04:26:20.601302 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601453 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:20.601475 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:26:20.601488 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:20.603974 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:20.605318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:20.625217 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:20.665755 1548199 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:20.665828 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:20.665845 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes no-preload-527067 minikube.k8s.io/updated_at=2024_02_14T04_26_20_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=no-preload-527067 minikube.k8s.io/primary=true
I0214 04:26:20.978111 1548199 ops.go:34] apiserver oom_adj: -16
I0214 04:26:20.978350 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.478785 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.490359 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:23.988822 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:21.979082 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.478676 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.978647 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.479016 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.979139 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.478469 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.979026 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.478991 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.979248 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:26.478422 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.989074 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:28.488567 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:26.978971 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.478678 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.978661 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.479360 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.978439 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.479419 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.978677 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.478657 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.979294 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:31.478514 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.489293 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.490551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.982429 1548015 pod_ready.go:81] duration metric: took 4m0.000999321s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
E0214 04:26:32.982455 1548015 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:26:32.982485 1548015 pod_ready.go:38] duration metric: took 4m1.20075372s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:32.982524 1548015 kubeadm.go:591] duration metric: took 5m2.799685673s to restartPrimaryControlPlane
W0214 04:26:32.982589 1548015 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:26:32.982617 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:26:31.979099 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.478987 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.979077 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.479009 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.979314 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.478489 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.612101 1548199 kubeadm.go:1106] duration metric: took 13.946337661s to wait for elevateKubeSystemPrivileges
W0214 04:26:34.612159 1548199 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:26:34.612171 1548199 kubeadm.go:393] duration metric: took 5m58.102428414s to StartCluster
I0214 04:26:34.612196 1548199 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.612300 1548199 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:26:34.615005 1548199 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.615369 1548199 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:26:34.617155 1548199 out.go:177] * Verifying Kubernetes components...
I0214 04:26:34.615466 1548199 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:26:34.615560 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:26:34.618768 1548199 addons.go:69] Setting storage-provisioner=true in profile "no-preload-527067"
I0214 04:26:34.618791 1548199 addons.go:69] Setting metrics-server=true in profile "no-preload-527067"
I0214 04:26:34.618813 1548199 addons.go:234] Setting addon storage-provisioner=true in "no-preload-527067"
I0214 04:26:34.618820 1548199 addons.go:234] Setting addon metrics-server=true in "no-preload-527067"
W0214 04:26:34.618825 1548199 addons.go:243] addon storage-provisioner should already be in state true
W0214 04:26:34.618829 1548199 addons.go:243] addon metrics-server should already be in state true
I0214 04:26:34.618772 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:26:34.618884 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618886 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618775 1548199 addons.go:69] Setting default-storageclass=true in profile "no-preload-527067"
I0214 04:26:34.618993 1548199 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-527067"
I0214 04:26:34.619298 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619308 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619333 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619337 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619341 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619372 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.640257 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32983
I0214 04:26:34.640580 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36149
I0214 04:26:34.640597 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39493
I0214 04:26:34.640873 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.640987 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641373 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641523 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641545 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.641583 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641611 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642323 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642329 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642423 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.642449 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642627 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.642851 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.643118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643159 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.643410 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643444 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.646798 1548199 addons.go:234] Setting addon default-storageclass=true in "no-preload-527067"
W0214 04:26:34.646822 1548199 addons.go:243] addon default-storageclass should already be in state true
I0214 04:26:34.646854 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.647219 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.647255 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.661218 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42977
I0214 04:26:34.661948 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.662433 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.662460 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.662620 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33585
I0214 04:26:34.662742 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43125
I0214 04:26:34.662815 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.662980 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.663003 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663243 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663722 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663743 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.663678 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663990 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.664043 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664472 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664637 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.664688 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.664751 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.665180 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.667379 1548199 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:26:34.668945 1548199 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:34.668969 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:26:34.668989 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.666787 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.670977 1548199 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:26:34.672956 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:26:34.672975 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:26:34.672994 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.673016 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.672384 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673068 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.673095 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673204 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.673357 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.673524 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.676340 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.676867 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.676922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.677027 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.677226 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.677799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.677995 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.688291 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46577
I0214 04:26:34.688787 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.689408 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.689428 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.689974 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.690207 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.691884 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.692131 1548199 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:34.692145 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:26:34.692161 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.695649 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696104 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.696127 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696274 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.696463 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.696600 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.696724 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.961474 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:26:34.991187 1548199 node_ready.go:35] waiting up to 6m0s for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001485 1548199 node_ready.go:49] node "no-preload-527067" has status "Ready":"True"
I0214 04:26:35.001505 1548199 node_ready.go:38] duration metric: took 10.286336ms for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001515 1548199 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:35.008527 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:35.194026 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:26:35.194058 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:26:35.195705 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:35.220973 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:35.241307 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:26:35.241374 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:26:35.312068 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:35.312103 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:26:35.375420 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169901 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170341 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170364 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170376 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170386 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170395 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170472 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170493 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170504 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170514 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170906 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170927 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170931 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170961 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170970 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.240387 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.240440 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.240813 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.240831 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365401 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365431 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.365774 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.365798 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365808 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.365814 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365836 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.366107 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.366128 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.366141 1548199 addons.go:470] Verifying addon metrics-server=true in "no-preload-527067"
I0214 04:26:36.367846 1548199 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:26:36.369323 1548199 addons.go:505] duration metric: took 1.753864307s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:26:37.042437 1548199 pod_ready.go:102] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:38.019213 1548199 pod_ready.go:92] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.019249 1548199 pod_ready.go:81] duration metric: took 3.010693835s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.019263 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027650 1548199 pod_ready.go:92] pod "coredns-76f75df574-m2q5f" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.027677 1548199 pod_ready.go:81] duration metric: took 8.406148ms for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027690 1548199 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.033993 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.034019 1548199 pod_ready.go:81] duration metric: took 6.321413ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.034028 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042724 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.042759 1548199 pod_ready.go:81] duration metric: took 8.716807ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042772 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050793 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.050819 1548199 pod_ready.go:81] duration metric: took 8.039526ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050828 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213505 1548199 pod_ready.go:92] pod "kube-proxy-66w6n" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.213536 1548199 pod_ready.go:81] duration metric: took 1.162700616s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213550 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613918 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.613945 1548199 pod_ready.go:81] duration metric: took 400.387683ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613953 1548199 pod_ready.go:38] duration metric: took 4.6124289s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:39.613972 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:26:39.614036 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:26:39.630218 1548199 api_server.go:72] duration metric: took 5.014782329s to wait for apiserver process to appear ...
I0214 04:26:39.630255 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:26:39.630286 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:26:39.637180 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:26:39.638716 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:26:39.638768 1548199 api_server.go:131] duration metric: took 8.502857ms to wait for apiserver health ...
I0214 04:26:39.638776 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:26:39.824405 1548199 system_pods.go:59] 9 kube-system pods found
I0214 04:26:39.824444 1548199 system_pods.go:61] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:39.824452 1548199 system_pods.go:61] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:39.824459 1548199 system_pods.go:61] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:39.824466 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:39.824473 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:39.824480 1548199 system_pods.go:61] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:39.824486 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:39.824497 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:39.824506 1548199 system_pods.go:61] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:39.824520 1548199 system_pods.go:74] duration metric: took 185.738017ms to wait for pod list to return data ...
I0214 04:26:39.824530 1548199 default_sa.go:34] waiting for default service account to be created ...
I0214 04:26:40.013391 1548199 default_sa.go:45] found service account: "default"
I0214 04:26:40.013415 1548199 default_sa.go:55] duration metric: took 188.875578ms for default service account to be created ...
I0214 04:26:40.013424 1548199 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:26:40.217587 1548199 system_pods.go:86] 9 kube-system pods found
I0214 04:26:40.217616 1548199 system_pods.go:89] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:40.217622 1548199 system_pods.go:89] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:40.217626 1548199 system_pods.go:89] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:40.217630 1548199 system_pods.go:89] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:40.217635 1548199 system_pods.go:89] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:40.217639 1548199 system_pods.go:89] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:40.217644 1548199 system_pods.go:89] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:40.217651 1548199 system_pods.go:89] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:40.217656 1548199 system_pods.go:89] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:40.217665 1548199 system_pods.go:126] duration metric: took 204.236287ms to wait for k8s-apps to be running ...
I0214 04:26:40.217672 1548199 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:26:40.217718 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:40.234093 1548199 system_svc.go:56] duration metric: took 16.409726ms WaitForService to wait for kubelet
I0214 04:26:40.234124 1548199 kubeadm.go:576] duration metric: took 5.61871569s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:26:40.234149 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:26:40.414050 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:26:40.414083 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:26:40.414095 1548199 node_conditions.go:105] duration metric: took 179.940381ms to run NodePressure ...
I0214 04:26:40.414107 1548199 start.go:240] waiting for startup goroutines ...
I0214 04:26:40.414113 1548199 start.go:245] waiting for cluster config update ...
I0214 04:26:40.414123 1548199 start.go:254] writing updated cluster config ...
I0214 04:26:40.414399 1548199 ssh_runner.go:195] Run: rm -f paused
I0214 04:26:40.471952 1548199 start.go:599] kubectl: 1.29.1, cluster: 1.29.0-rc.2 (minor skew: 0)
I0214 04:26:40.474067 1548199 out.go:177] * Done! kubectl is now configured to use "no-preload-527067" cluster and "default" namespace by default
I0214 04:26:39.897152 1548015 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (6.91450391s)
I0214 04:26:39.897269 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:39.912739 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:39.923449 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:39.939932 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:39.939961 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:26:39.940018 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:39.953815 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:39.953883 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:39.962552 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:39.971167 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:39.971216 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:39.979864 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:39.988192 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:39.988315 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:39.997134 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:40.005722 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:40.005762 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:40.015266 1548015 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0214 04:26:40.076413 1548015 kubeadm.go:309] [init] Using Kubernetes version: v1.16.0
I0214 04:26:40.076723 1548015 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:40.230449 1548015 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:40.230618 1548015 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:40.230731 1548015 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:40.478573 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:40.479934 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:40.489997 1548015 kubeadm.go:309] [kubelet-start] Activating the kubelet service
I0214 04:26:40.644188 1548015 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:40.646342 1548015 out.go:204] - Generating certificates and keys ...
I0214 04:26:40.646467 1548015 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:40.646561 1548015 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:40.646688 1548015 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:40.646835 1548015 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:40.646956 1548015 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:40.647034 1548015 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:40.647235 1548015 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:40.647843 1548015 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:40.648304 1548015 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:40.649043 1548015 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:40.649108 1548015 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:40.649182 1548015 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:40.935104 1548015 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:41.023680 1548015 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:41.246180 1548015 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:41.346131 1548015 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:41.346986 1548015 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:41.349022 1548015 out.go:204] - Booting up control plane ...
I0214 04:26:41.349146 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:41.352956 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:41.355013 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:41.356192 1548015 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:41.359118 1548015 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:52.863670 1548015 kubeadm.go:309] [apiclient] All control plane components are healthy after 11.504059 seconds
I0214 04:26:52.863792 1548015 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:52.880996 1548015 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config-1.16" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:53.404015 1548015 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:53.404215 1548015 kubeadm.go:309] [mark-control-plane] Marking the node old-k8s-version-960884 as control-plane by adding the label "node-role.kubernetes.io/master=''"
I0214 04:26:53.916361 1548015 kubeadm.go:309] [bootstrap-token] Using token: 0ncwgq.h72unli3702wifzv
I0214 04:26:53.917805 1548015 out.go:204] - Configuring RBAC rules ...
I0214 04:26:53.917949 1548015 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:53.927093 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:53.932015 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:53.935192 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:53.938316 1548015 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:54.012603 1548015 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:54.352255 1548015 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:54.354368 1548015 kubeadm.go:309]
I0214 04:26:54.354465 1548015 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:54.354478 1548015 kubeadm.go:309]
I0214 04:26:54.354557 1548015 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:54.354569 1548015 kubeadm.go:309]
I0214 04:26:54.354605 1548015 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:54.354686 1548015 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:54.354760 1548015 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:54.354775 1548015 kubeadm.go:309]
I0214 04:26:54.354824 1548015 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:54.354894 1548015 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:54.354972 1548015 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:54.354983 1548015 kubeadm.go:309]
I0214 04:26:54.355115 1548015 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:54.355264 1548015 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:54.355276 1548015 kubeadm.go:309]
I0214 04:26:54.355393 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355557 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:54.355606 1548015 kubeadm.go:309] --control-plane
I0214 04:26:54.355613 1548015 kubeadm.go:309]
I0214 04:26:54.355679 1548015 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:54.355686 1548015 kubeadm.go:309]
I0214 04:26:54.355780 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355925 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:54.356354 1548015 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:54.356485 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:26:54.356504 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:54.358086 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:54.359624 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:54.371756 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:54.389927 1548015 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:54.390013 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes old-k8s-version-960884 minikube.k8s.io/updated_at=2024_02_14T04_26_54_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=old-k8s-version-960884 minikube.k8s.io/primary=true
I0214 04:26:54.390016 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:54.431990 1548015 ops.go:34] apiserver oom_adj: -16
I0214 04:26:54.626609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.126943 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.627715 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.127333 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.626894 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.126758 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.626794 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.127609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.627033 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.126732 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.627253 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.127445 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.627305 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.126733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.627428 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.127101 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.627112 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.127318 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.627564 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.127249 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.627430 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.127707 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.627355 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.127647 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.626733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.126735 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.627135 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.127098 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.626845 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.127164 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.627189 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.127584 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.232804 1548015 kubeadm.go:1106] duration metric: took 15.842870427s to wait for elevateKubeSystemPrivileges
W0214 04:27:10.232858 1548015 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:27:10.232867 1548015 kubeadm.go:393] duration metric: took 5m40.102162281s to StartCluster
I0214 04:27:10.232888 1548015 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.233054 1548015 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:27:10.235716 1548015 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.236044 1548015 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:27:10.237600 1548015 out.go:177] * Verifying Kubernetes components...
I0214 04:27:10.236151 1548015 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:27:10.238873 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:27:10.236262 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:27:10.237637 1548015 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-960884"
I0214 04:27:10.238984 1548015 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-960884"
W0214 04:27:10.238997 1548015 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:27:10.237648 1548015 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-960884"
I0214 04:27:10.239056 1548015 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:10.237659 1548015 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-960884"
I0214 04:27:10.239095 1548015 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-960884"
I0214 04:27:10.239028 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
W0214 04:27:10.239066 1548015 addons.go:243] addon metrics-server should already be in state true
I0214 04:27:10.239210 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.239508 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239514 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239536 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239578 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.259948 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37397
I0214 04:27:10.260188 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33423
I0214 04:27:10.260189 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41519
I0214 04:27:10.260483 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260579 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260588 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.261044 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261057 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261069 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261073 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261137 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261152 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261462 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261531 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261578 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261964 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.262091 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262123 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.262177 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262206 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.265041 1548015 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-960884"
W0214 04:27:10.265057 1548015 addons.go:243] addon default-storageclass should already be in state true
I0214 04:27:10.265079 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.265355 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.265388 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.281666 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35115
I0214 04:27:10.282244 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.282939 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.282959 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.283421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.283696 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.285726 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.287965 1548015 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:27:10.287003 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37937
I0214 04:27:10.289469 1548015 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.289494 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:27:10.289513 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.290515 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.291054 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.291066 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.291421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.291810 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.291838 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.295055 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.295588 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295834 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.296046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.296225 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.296429 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.299942 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37359
I0214 04:27:10.300312 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.300732 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.300749 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.301045 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.301234 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.303089 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.304834 1548015 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:27:10.306097 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:27:10.306115 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:27:10.306132 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.308576 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37931
I0214 04:27:10.308935 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.309498 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.309517 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.309629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.309890 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.310082 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.310137 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.310163 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.310357 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.310556 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.310953 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.311088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.311700 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.311908 1548015 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.311922 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:27:10.311935 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.315147 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315579 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.315639 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315862 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.316084 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.316268 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.316454 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.457777 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:27:10.480620 1548015 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.491995 1548015 node_ready.go:49] node "old-k8s-version-960884" has status "Ready":"True"
I0214 04:27:10.492022 1548015 node_ready.go:38] duration metric: took 11.363355ms for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.492035 1548015 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:10.497386 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:10.561045 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.584516 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.593942 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:27:10.593967 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:27:10.621414 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:27:10.621438 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:27:10.694662 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:10.694688 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:27:10.747668 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:11.306565 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306591 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306723 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306756 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306919 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.306969 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.306988 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.306996 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307152 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307075 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307244 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307255 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307265 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307062 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.307496 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307512 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307685 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307698 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.394434 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.394467 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.394790 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.394815 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523086 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523107 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523443 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.523505 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523519 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523534 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523546 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523818 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523839 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523853 1548015 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:11.525563 1548015 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:27:11.526853 1548015 addons.go:505] duration metric: took 1.290704397s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:27:12.555185 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:15.004085 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:17.005427 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:19.506364 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:20.521073 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.521097 1548015 pod_ready.go:81] duration metric: took 10.02368927s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.521114 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530815 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.530849 1548015 pod_ready.go:81] duration metric: took 9.726579ms for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530866 1548015 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.539987 1548015 pod_ready.go:92] pod "kube-proxy-4jhcb" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.540019 1548015 pod_ready.go:81] duration metric: took 9.143682ms for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.540033 1548015 pod_ready.go:38] duration metric: took 10.047982488s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:20.540055 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:27:20.540113 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:27:20.564418 1548015 api_server.go:72] duration metric: took 10.328326886s to wait for apiserver process to appear ...
I0214 04:27:20.564452 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:27:20.564478 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:27:20.573942 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:27:20.575255 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:27:20.575287 1548015 api_server.go:131] duration metric: took 10.826827ms to wait for apiserver health ...
I0214 04:27:20.575298 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:27:20.581952 1548015 system_pods.go:59] 5 kube-system pods found
I0214 04:27:20.581982 1548015 system_pods.go:61] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.581989 1548015 system_pods.go:61] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.581996 1548015 system_pods.go:61] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.582006 1548015 system_pods.go:61] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.582014 1548015 system_pods.go:61] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.582025 1548015 system_pods.go:74] duration metric: took 6.718437ms to wait for pod list to return data ...
I0214 04:27:20.582034 1548015 default_sa.go:34] waiting for default service account to be created ...
I0214 04:27:20.584695 1548015 default_sa.go:45] found service account: "default"
I0214 04:27:20.584724 1548015 default_sa.go:55] duration metric: took 2.678001ms for default service account to be created ...
I0214 04:27:20.584735 1548015 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:27:20.589847 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.589876 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.589886 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.589896 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.589912 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.589924 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.589950 1548015 retry.go:31] will retry after 248.508062ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:20.844936 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.844971 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.844977 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.844981 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.844988 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.844993 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.845010 1548015 retry.go:31] will retry after 367.089613ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.218037 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.218074 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.218082 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.218089 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.218099 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.218105 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.218126 1548015 retry.go:31] will retry after 419.193903ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.642404 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.642441 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.642447 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.642452 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.642459 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.642465 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.642483 1548015 retry.go:31] will retry after 451.345597ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.099422 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.099453 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.099459 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.099466 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.099474 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.099480 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.099499 1548015 retry.go:31] will retry after 651.082119ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.756099 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.756128 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.756134 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.756148 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.756159 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.756169 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.756189 1548015 retry.go:31] will retry after 586.140581ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:23.348131 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:23.348163 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:23.348168 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:23.348172 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:23.348178 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:23.348183 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:23.348202 1548015 retry.go:31] will retry after 870.913743ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:24.224631 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:24.224665 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:24.224674 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:24.224680 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:24.224690 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:24.224697 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:24.224719 1548015 retry.go:31] will retry after 1.13554102s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:25.365563 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:25.365593 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:25.365598 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:25.365603 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:25.365609 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:25.365614 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:25.365633 1548015 retry.go:31] will retry after 1.737635615s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:27.109613 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:27.109642 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:27.109647 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:27.109651 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:27.109657 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:27.109664 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:27.109684 1548015 retry.go:31] will retry after 1.744560644s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:28.860288 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:28.860319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:28.860327 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:28.860333 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:28.860343 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:28.860350 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:28.860372 1548015 retry.go:31] will retry after 2.781231308s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:31.647467 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:31.647509 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:31.647518 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:31.647525 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:31.647536 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:31.647543 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:31.647566 1548015 retry.go:31] will retry after 3.406936773s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:35.060683 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:35.060716 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:35.060721 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:35.060725 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:35.060735 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:35.060742 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:35.060765 1548015 retry.go:31] will retry after 3.181009478s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:38.247591 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:38.247626 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:38.247634 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:38.247639 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:38.247648 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:38.247655 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:38.247679 1548015 retry.go:31] will retry after 4.973684574s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:43.227832 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:43.227888 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:43.227896 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:43.227902 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:43.227914 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:43.227921 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:43.227947 1548015 retry.go:31] will retry after 6.269902816s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:49.502449 1548015 system_pods.go:86] 6 kube-system pods found
I0214 04:27:49.502483 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:49.502491 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:49.502497 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:49.502503 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Pending
I0214 04:27:49.502511 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:49.502518 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:49.502541 1548015 retry.go:31] will retry after 7.09681765s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:56.607786 1548015 system_pods.go:86] 7 kube-system pods found
I0214 04:27:56.607823 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:56.607833 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:56.607843 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:27:56.607850 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:56.607863 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:27:56.607878 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:56.607894 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:56.607917 1548015 retry.go:31] will retry after 9.404244714s: missing components: etcd, kube-apiserver
I0214 04:28:06.017960 1548015 system_pods.go:86] 8 kube-system pods found
I0214 04:28:06.017990 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:06.017995 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:06.017999 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Pending
I0214 04:28:06.018004 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:06.018008 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:06.018012 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:06.018018 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:06.018025 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:06.018044 1548015 retry.go:31] will retry after 13.524747575s: missing components: etcd, kube-apiserver
I0214 04:28:19.549284 1548015 system_pods.go:86] 9 kube-system pods found
I0214 04:28:19.549319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:19.549331 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:19.549337 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Running
I0214 04:28:19.549351 1548015 system_pods.go:89] "kube-apiserver-old-k8s-version-960884" [a70eef81-e29d-4b42-9bba-e396214086b6] Running
I0214 04:28:19.549357 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:19.549364 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:19.549371 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:19.549383 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:19.549394 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:19.549413 1548015 system_pods.go:126] duration metric: took 58.964669894s to wait for k8s-apps to be running ...
I0214 04:28:19.549427 1548015 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:28:19.549488 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:28:19.575300 1548015 system_svc.go:56] duration metric: took 25.86022ms WaitForService to wait for kubelet
I0214 04:28:19.575336 1548015 kubeadm.go:576] duration metric: took 1m9.339251431s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:28:19.575379 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:28:19.579124 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:28:19.579155 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:28:19.579195 1548015 node_conditions.go:105] duration metric: took 3.807562ms to run NodePressure ...
I0214 04:28:19.579211 1548015 start.go:240] waiting for startup goroutines ...
I0214 04:28:19.579226 1548015 start.go:245] waiting for cluster config update ...
I0214 04:28:19.579242 1548015 start.go:254] writing updated cluster config ...
I0214 04:28:19.579574 1548015 ssh_runner.go:195] Run: rm -f paused
I0214 04:28:19.634648 1548015 start.go:599] kubectl: 1.29.1, cluster: 1.16.0 (minor skew: 13)
I0214 04:28:19.636438 1548015 out.go:177]
W0214 04:28:19.637884 1548015 out.go:239] ! /usr/local/bin/kubectl is version 1.29.1, which may have incompatibilities with Kubernetes 1.16.0.
I0214 04:28:19.639178 1548015 out.go:177] - Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'
I0214 04:28:19.640482 1548015 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-960884" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:21:11 UTC, ends at Wed 2024-02-14 04:37:21 UTC. --
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.394831929Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885441394817814,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:114472,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=23c4606a-7be4-4d91-aa2f-287efc2de29c name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.395617502Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=40297079-6e50-4e7a-9f8c-c2f8d9090262 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.395717178Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=40297079-6e50-4e7a-9f8c-c2f8d9090262 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.395913939Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6,PodSandboxId:ff07fb81155289fb8a6ebbbfcab47b4e0a500ea65fbba1a16c09013f4f268811,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884833080487360,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bfd747ba-2943-4b53-b832-efe266cf71c5,},Annotations:map[string]string{io.kubernetes.container.hash: 2d0e57d4,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32,PodSandboxId:3580c876b471dcef719e1086f44004fc29346ab911afaa4d34a2f6d097815a77,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1707884831735054087,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4jhcb,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81b8e912-db95-4b07-83ec-144395d2969b,},Annotations:map[string]string{io.kubernetes.container.hash: 8e540c25,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199,PodSandboxId:0d7bdda5d35df21f4df5358b04bff6cfc7afa188bd16f299e21f548fd5e4e23d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832196386331,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wp56j,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2d917ce5-0b4f-4b60-a90a-d7716ad059fb,},Annotations:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5,PodSandboxId:efbc750f2e830d8d086b170ea40a88a987a93ad4e16479a051a52845e7935f0d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832030508242,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-cvlfp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 134715b3-0a00-4310-96e4-5276e99dadf2,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c,PodSandboxId:f1798de3ba2eaa8be063eb8aaca77f237d6ec7f8a0686ff3c9bac6c37fc1a06a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1707884804816382464,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2f9341bf7e5e91d7a52a6d90438b5af1,},Annotations:map[string]string{io.kubernetes.container.hash: a54cc6c2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422,PodSandboxId:0ed5118dfef28fafafa24aa15b97dd242d196cca23419dfbdf1a8e84a6ca3a68,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1707884803446466737,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602,PodSandboxId:fb1abe14d0dec6293bb4601266ef431981c7454d8d57d26472a94b1225f13993,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1707884803268985505,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1707884802637314638,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_EXITED,CreatedAt:1707884493091572502,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io
.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=40297079-6e50-4e7a-9f8c-c2f8d9090262 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.436215777Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=b42feeb7-bc5f-43c4-91ec-e3aa65b53b36 name=/runtime.v1.RuntimeService/Version
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.436288926Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=b42feeb7-bc5f-43c4-91ec-e3aa65b53b36 name=/runtime.v1.RuntimeService/Version
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.437652681Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=223494cc-790a-4618-83c4-09914948aacc name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.438176104Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885441438161957,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:114472,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=223494cc-790a-4618-83c4-09914948aacc name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.438756515Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=db907344-749d-44a4-aea5-72b235fad175 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.438820518Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=db907344-749d-44a4-aea5-72b235fad175 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.439051424Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6,PodSandboxId:ff07fb81155289fb8a6ebbbfcab47b4e0a500ea65fbba1a16c09013f4f268811,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884833080487360,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bfd747ba-2943-4b53-b832-efe266cf71c5,},Annotations:map[string]string{io.kubernetes.container.hash: 2d0e57d4,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32,PodSandboxId:3580c876b471dcef719e1086f44004fc29346ab911afaa4d34a2f6d097815a77,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1707884831735054087,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4jhcb,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81b8e912-db95-4b07-83ec-144395d2969b,},Annotations:map[string]string{io.kubernetes.container.hash: 8e540c25,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199,PodSandboxId:0d7bdda5d35df21f4df5358b04bff6cfc7afa188bd16f299e21f548fd5e4e23d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832196386331,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wp56j,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2d917ce5-0b4f-4b60-a90a-d7716ad059fb,},Annotations:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5,PodSandboxId:efbc750f2e830d8d086b170ea40a88a987a93ad4e16479a051a52845e7935f0d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832030508242,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-cvlfp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 134715b3-0a00-4310-96e4-5276e99dadf2,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c,PodSandboxId:f1798de3ba2eaa8be063eb8aaca77f237d6ec7f8a0686ff3c9bac6c37fc1a06a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1707884804816382464,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2f9341bf7e5e91d7a52a6d90438b5af1,},Annotations:map[string]string{io.kubernetes.container.hash: a54cc6c2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422,PodSandboxId:0ed5118dfef28fafafa24aa15b97dd242d196cca23419dfbdf1a8e84a6ca3a68,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1707884803446466737,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602,PodSandboxId:fb1abe14d0dec6293bb4601266ef431981c7454d8d57d26472a94b1225f13993,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1707884803268985505,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1707884802637314638,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_EXITED,CreatedAt:1707884493091572502,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io
.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=db907344-749d-44a4-aea5-72b235fad175 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.479954889Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=e5c7d3e9-4b4d-4cf4-be2f-2c96507c3c9f name=/runtime.v1.RuntimeService/Version
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.480014192Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=e5c7d3e9-4b4d-4cf4-be2f-2c96507c3c9f name=/runtime.v1.RuntimeService/Version
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.481225954Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=c145b233-9241-4dd8-9829-19ae2948bd54 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.481821224Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885441481796074,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:114472,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=c145b233-9241-4dd8-9829-19ae2948bd54 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.482395893Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=358afe30-b379-4d20-9693-4740a4365c53 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.482472267Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=358afe30-b379-4d20-9693-4740a4365c53 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.482747915Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6,PodSandboxId:ff07fb81155289fb8a6ebbbfcab47b4e0a500ea65fbba1a16c09013f4f268811,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884833080487360,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bfd747ba-2943-4b53-b832-efe266cf71c5,},Annotations:map[string]string{io.kubernetes.container.hash: 2d0e57d4,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32,PodSandboxId:3580c876b471dcef719e1086f44004fc29346ab911afaa4d34a2f6d097815a77,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1707884831735054087,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4jhcb,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81b8e912-db95-4b07-83ec-144395d2969b,},Annotations:map[string]string{io.kubernetes.container.hash: 8e540c25,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199,PodSandboxId:0d7bdda5d35df21f4df5358b04bff6cfc7afa188bd16f299e21f548fd5e4e23d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832196386331,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wp56j,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2d917ce5-0b4f-4b60-a90a-d7716ad059fb,},Annotations:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5,PodSandboxId:efbc750f2e830d8d086b170ea40a88a987a93ad4e16479a051a52845e7935f0d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832030508242,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-cvlfp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 134715b3-0a00-4310-96e4-5276e99dadf2,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c,PodSandboxId:f1798de3ba2eaa8be063eb8aaca77f237d6ec7f8a0686ff3c9bac6c37fc1a06a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1707884804816382464,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2f9341bf7e5e91d7a52a6d90438b5af1,},Annotations:map[string]string{io.kubernetes.container.hash: a54cc6c2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422,PodSandboxId:0ed5118dfef28fafafa24aa15b97dd242d196cca23419dfbdf1a8e84a6ca3a68,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1707884803446466737,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602,PodSandboxId:fb1abe14d0dec6293bb4601266ef431981c7454d8d57d26472a94b1225f13993,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1707884803268985505,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1707884802637314638,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_EXITED,CreatedAt:1707884493091572502,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io
.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=358afe30-b379-4d20-9693-4740a4365c53 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.520807229Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=2d0cc328-1f5b-4724-b615-6aa9f2f77e91 name=/runtime.v1.RuntimeService/Version
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.520869764Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=2d0cc328-1f5b-4724-b615-6aa9f2f77e91 name=/runtime.v1.RuntimeService/Version
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.521854996Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=b841b461-e4e2-4fca-85e0-24a2a7ea4e73 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.522993232Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885441522976435,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:114472,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=b841b461-e4e2-4fca-85e0-24a2a7ea4e73 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.523598453Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=b1314487-9990-45a0-9066-10b9192191c5 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.523743361Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=b1314487-9990-45a0-9066-10b9192191c5 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:37:21 old-k8s-version-960884 crio[721]: time="2024-02-14 04:37:21.523935441Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6,PodSandboxId:ff07fb81155289fb8a6ebbbfcab47b4e0a500ea65fbba1a16c09013f4f268811,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884833080487360,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bfd747ba-2943-4b53-b832-efe266cf71c5,},Annotations:map[string]string{io.kubernetes.container.hash: 2d0e57d4,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32,PodSandboxId:3580c876b471dcef719e1086f44004fc29346ab911afaa4d34a2f6d097815a77,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1707884831735054087,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4jhcb,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81b8e912-db95-4b07-83ec-144395d2969b,},Annotations:map[string]string{io.kubernetes.container.hash: 8e540c25,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199,PodSandboxId:0d7bdda5d35df21f4df5358b04bff6cfc7afa188bd16f299e21f548fd5e4e23d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832196386331,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wp56j,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2d917ce5-0b4f-4b60-a90a-d7716ad059fb,},Annotations:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5,PodSandboxId:efbc750f2e830d8d086b170ea40a88a987a93ad4e16479a051a52845e7935f0d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832030508242,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-cvlfp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 134715b3-0a00-4310-96e4-5276e99dadf2,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c,PodSandboxId:f1798de3ba2eaa8be063eb8aaca77f237d6ec7f8a0686ff3c9bac6c37fc1a06a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1707884804816382464,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2f9341bf7e5e91d7a52a6d90438b5af1,},Annotations:map[string]string{io.kubernetes.container.hash: a54cc6c2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422,PodSandboxId:0ed5118dfef28fafafa24aa15b97dd242d196cca23419dfbdf1a8e84a6ca3a68,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1707884803446466737,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602,PodSandboxId:fb1abe14d0dec6293bb4601266ef431981c7454d8d57d26472a94b1225f13993,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1707884803268985505,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1707884802637314638,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_EXITED,CreatedAt:1707884493091572502,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io
.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=b1314487-9990-45a0-9066-10b9192191c5 name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
8f5f681f9794f 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 10 minutes ago Running storage-provisioner 0 ff07fb8115528 storage-provisioner
b3af97708606f bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b 10 minutes ago Running coredns 0 0d7bdda5d35df coredns-5644d7b6d9-wp56j
6793f1bcffc53 bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b 10 minutes ago Running coredns 0 efbc750f2e830 coredns-5644d7b6d9-cvlfp
74da573ff459c c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384 10 minutes ago Running kube-proxy 0 3580c876b471d kube-proxy-4jhcb
287d9af047b57 b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed 10 minutes ago Running etcd 0 f1798de3ba2ea etcd-old-k8s-version-960884
56049750a916d 06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d 10 minutes ago Running kube-controller-manager 0 0ed5118dfef28 kube-controller-manager-old-k8s-version-960884
7c48edb0479b7 301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a 10 minutes ago Running kube-scheduler 0 fb1abe14d0dec kube-scheduler-old-k8s-version-960884
0a8601ad92afc b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e 10 minutes ago Running kube-apiserver 1 613da19332bc0 kube-apiserver-old-k8s-version-960884
d44a0803bd8b3 b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e 15 minutes ago Exited kube-apiserver 0 613da19332bc0 kube-apiserver-old-k8s-version-960884
==> coredns [6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5] <==
.:53
2024-02-14T04:27:12.445Z [INFO] plugin/reload: Running configuration MD5 = f64cb9b977c7dfca58c4fab108535a76
2024-02-14T04:27:12.445Z [INFO] CoreDNS-1.6.2
2024-02-14T04:27:12.445Z [INFO] linux/amd64, go1.12.8, 795a3eb
CoreDNS-1.6.2
linux/amd64, go1.12.8, 795a3eb
==> coredns [b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199] <==
.:53
2024-02-14T04:27:12.525Z [INFO] plugin/reload: Running configuration MD5 = f64cb9b977c7dfca58c4fab108535a76
2024-02-14T04:27:12.525Z [INFO] CoreDNS-1.6.2
2024-02-14T04:27:12.525Z [INFO] linux/amd64, go1.12.8, 795a3eb
CoreDNS-1.6.2
linux/amd64, go1.12.8, 795a3eb
==> describe nodes <==
Name: old-k8s-version-960884
Roles: master
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-960884
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=old-k8s-version-960884
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_26_54_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:26:49 +0000
Taints: <none>
Unschedulable: false
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:36:49 +0000 Wed, 14 Feb 2024 04:26:43 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:36:49 +0000 Wed, 14 Feb 2024 04:26:43 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:36:49 +0000 Wed, 14 Feb 2024 04:26:43 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:36:49 +0000 Wed, 14 Feb 2024 04:26:43 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.72.206
Hostname: old-k8s-version-960884
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: adaba3ef87084e6f99d0d445b2725ddc
System UUID: adaba3ef-8708-4e6f-99d0-d445b2725ddc
Boot ID: 79e47847-5a37-42d7-9558-08eba00fc214
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.16.0
Kube-Proxy Version: v1.16.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-5644d7b6d9-cvlfp 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 10m
kube-system coredns-5644d7b6d9-wp56j 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 10m
kube-system etcd-old-k8s-version-960884 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m19s
kube-system kube-apiserver-old-k8s-version-960884 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m15s
kube-system kube-controller-manager-old-k8s-version-960884 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m31s
kube-system kube-proxy-4jhcb 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 10m
kube-system kube-scheduler-old-k8s-version-960884 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m36s
kube-system metrics-server-74d5856cc6-msxjd 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (9%!)(MISSING) 0 (0%!)(MISSING) 10m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 10m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 340Mi (16%!)(MISSING) 340Mi (16%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 10m (x8 over 10m) kubelet, old-k8s-version-960884 Node old-k8s-version-960884 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 10m (x8 over 10m) kubelet, old-k8s-version-960884 Node old-k8s-version-960884 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 10m (x7 over 10m) kubelet, old-k8s-version-960884 Node old-k8s-version-960884 status is now: NodeHasSufficientPID
Normal Starting 10m kube-proxy, old-k8s-version-960884 Starting kube-proxy.
==> dmesg <==
[Feb14 04:21] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.073447] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.910068] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.700119] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.163664] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.513975] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000014] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)
[ +8.835753] systemd-fstab-generator[648]: Ignoring "noauto" for root device
[ +0.120817] systemd-fstab-generator[659]: Ignoring "noauto" for root device
[ +0.154928] systemd-fstab-generator[672]: Ignoring "noauto" for root device
[ +0.111437] systemd-fstab-generator[683]: Ignoring "noauto" for root device
[ +0.248002] systemd-fstab-generator[707]: Ignoring "noauto" for root device
[ +6.383332] systemd-fstab-generator[908]: Ignoring "noauto" for root device
[ +1.873409] systemd-fstab-generator[1033]: Ignoring "noauto" for root device
[ +0.344071] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[ +25.807621] kauditd_printk_skb: 13 callbacks suppressed
[Feb14 04:22] kauditd_printk_skb: 2 callbacks suppressed
[Feb14 04:26] systemd-fstab-generator[3151]: Ignoring "noauto" for root device
[Feb14 04:27] systemd-fstab-generator[3774]: Ignoring "noauto" for root device
[ +1.388754] kauditd_printk_skb: 7 callbacks suppressed
[ +8.501614] kauditd_printk_skb: 7 callbacks suppressed
==> etcd [287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c] <==
2024-02-14 04:26:44.970764 I | raft: 9632424b77387a60 became follower at term 0
2024-02-14 04:26:44.970787 I | raft: newRaft 9632424b77387a60 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
2024-02-14 04:26:44.970899 I | raft: 9632424b77387a60 became follower at term 1
2024-02-14 04:26:44.981938 W | auth: simple token is not cryptographically signed
2024-02-14 04:26:44.987381 I | etcdserver: starting server... [version: 3.3.15, cluster version: to_be_decided]
2024-02-14 04:26:44.989827 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file =
2024-02-14 04:26:44.989967 I | embed: listening for metrics on http://192.168.72.206:2381
2024-02-14 04:26:44.990215 I | embed: listening for metrics on http://127.0.0.1:2381
2024-02-14 04:26:44.990318 I | etcdserver: 9632424b77387a60 as single-node; fast-forwarding 9 ticks (election ticks 10)
2024-02-14 04:26:44.990811 I | etcdserver/membership: added member 9632424b77387a60 [https://192.168.72.206:2380] to cluster 388f1870140103c
2024-02-14 04:26:45.571588 I | raft: 9632424b77387a60 is starting a new election at term 1
2024-02-14 04:26:45.571639 I | raft: 9632424b77387a60 became candidate at term 2
2024-02-14 04:26:45.571653 I | raft: 9632424b77387a60 received MsgVoteResp from 9632424b77387a60 at term 2
2024-02-14 04:26:45.571740 I | raft: 9632424b77387a60 became leader at term 2
2024-02-14 04:26:45.571751 I | raft: raft.node: 9632424b77387a60 elected leader 9632424b77387a60 at term 2
2024-02-14 04:26:45.571907 I | etcdserver: setting up the initial cluster version to 3.3
2024-02-14 04:26:45.573550 N | etcdserver/membership: set the initial cluster version to 3.3
2024-02-14 04:26:45.573813 I | etcdserver/api: enabled capabilities for version 3.3
2024-02-14 04:26:45.574009 I | etcdserver: published {Name:old-k8s-version-960884 ClientURLs:[https://192.168.72.206:2379]} to cluster 388f1870140103c
2024-02-14 04:26:45.574057 I | embed: ready to serve client requests
2024-02-14 04:26:45.574845 I | embed: ready to serve client requests
2024-02-14 04:26:45.575493 I | embed: serving client requests on 192.168.72.206:2379
2024-02-14 04:26:45.575819 I | embed: serving client requests on 127.0.0.1:2379
2024-02-14 04:36:46.052294 I | mvcc: store.index: compact 663
2024-02-14 04:36:46.054461 I | mvcc: finished scheduled compaction at 663 (took 1.613182ms)
==> kernel <==
04:37:21 up 16 min, 0 users, load average: 0.23, 0.39, 0.28
Linux old-k8s-version-960884 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5] <==
I0214 04:30:13.527107 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:30:13.527466 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:30:13.527579 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:30:13.527609 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:31:50.289133 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:31:50.289242 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:31:50.289290 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:31:50.289297 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:32:50.289803 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:32:50.289907 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:32:50.289946 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:32:50.289953 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:34:50.290490 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:34:50.290870 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:34:50.290977 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:34:50.291009 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:36:50.292723 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:36:50.293062 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:36:50.293148 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:36:50.293172 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
==> kube-apiserver [d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed] <==
W0214 04:26:39.633916 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.647544 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.650439 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.659080 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.662481 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.676395 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.679572 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.720510 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.724276 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.733347 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.737282 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.737951 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.741522 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.758023 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.761901 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.763652 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.763966 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.786260 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.797297 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.835957 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.844085 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.849750 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.872485 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.875513 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.881621 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
==> kube-controller-manager [56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422] <==
E0214 04:31:12.373918 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:31:26.371065 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:31:42.626993 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:31:58.373412 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:32:12.878891 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:32:30.375271 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:32:43.130731 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:33:02.377191 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:33:13.382849 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:33:34.379366 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:33:43.634734 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:34:06.381356 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:34:13.886813 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:34:38.383790 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:34:44.139441 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:35:10.385976 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:35:14.391785 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:35:42.387984 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:35:44.643826 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:36:14.389833 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:36:14.895872 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0214 04:36:45.147439 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:36:46.392021 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:37:15.399360 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:37:18.393880 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32] <==
W0214 04:27:12.734965 1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy
I0214 04:27:12.751075 1 node.go:135] Successfully retrieved node IP: 192.168.72.206
I0214 04:27:12.751325 1 server_others.go:149] Using iptables Proxier.
I0214 04:27:12.758656 1 server.go:529] Version: v1.16.0
I0214 04:27:12.761905 1 config.go:131] Starting endpoints config controller
I0214 04:27:12.762081 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
I0214 04:27:12.762330 1 config.go:313] Starting service config controller
I0214 04:27:12.762340 1 shared_informer.go:197] Waiting for caches to sync for service config
I0214 04:27:12.888946 1 shared_informer.go:204] Caches are synced for endpoints config
I0214 04:27:12.889031 1 shared_informer.go:204] Caches are synced for service config
==> kube-scheduler [7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602] <==
I0214 04:26:49.302541 1 secure_serving.go:123] Serving securely on 127.0.0.1:10259
E0214 04:26:49.339111 1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:26:49.342083 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 04:26:49.342243 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 04:26:49.349890 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 04:26:49.351058 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 04:26:49.351232 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:26:49.351262 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:49.351378 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 04:26:49.352808 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 04:26:49.352856 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:26:49.352931 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:50.341298 1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:26:50.344225 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 04:26:50.354049 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 04:26:50.354902 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 04:26:50.355795 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 04:26:50.356957 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:26:50.358359 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:50.359398 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 04:26:50.363540 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 04:26:50.364920 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:26:50.365820 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:27:09.860295 1 factory.go:585] pod is already present in the activeQ
E0214 04:27:09.893518 1 factory.go:585] pod is already present in the activeQ
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:21:11 UTC, ends at Wed 2024-02-14 04:37:22 UTC. --
Feb 14 04:32:59 old-k8s-version-960884 kubelet[3169]: E0214 04:32:59.021554 3169 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Feb 14 04:32:59 old-k8s-version-960884 kubelet[3169]: E0214 04:32:59.021737 3169 kuberuntime_image.go:50] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Feb 14 04:32:59 old-k8s-version-960884 kubelet[3169]: E0214 04:32:59.021793 3169 kuberuntime_manager.go:783] container start failed: ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Feb 14 04:32:59 old-k8s-version-960884 kubelet[3169]: E0214 04:32:59.021829 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
Feb 14 04:33:11 old-k8s-version-960884 kubelet[3169]: E0214 04:33:11.986825 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:33:25 old-k8s-version-960884 kubelet[3169]: E0214 04:33:25.989135 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:33:37 old-k8s-version-960884 kubelet[3169]: E0214 04:33:37.986597 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:33:52 old-k8s-version-960884 kubelet[3169]: E0214 04:33:52.985875 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:34:04 old-k8s-version-960884 kubelet[3169]: E0214 04:34:04.986437 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:34:16 old-k8s-version-960884 kubelet[3169]: E0214 04:34:16.986864 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:34:31 old-k8s-version-960884 kubelet[3169]: E0214 04:34:31.987151 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:34:44 old-k8s-version-960884 kubelet[3169]: E0214 04:34:44.986881 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:34:55 old-k8s-version-960884 kubelet[3169]: E0214 04:34:55.986524 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:35:08 old-k8s-version-960884 kubelet[3169]: E0214 04:35:08.986365 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:35:19 old-k8s-version-960884 kubelet[3169]: E0214 04:35:19.987107 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:35:31 old-k8s-version-960884 kubelet[3169]: E0214 04:35:31.986539 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:35:42 old-k8s-version-960884 kubelet[3169]: E0214 04:35:42.986749 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:35:55 old-k8s-version-960884 kubelet[3169]: E0214 04:35:55.987608 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:36:09 old-k8s-version-960884 kubelet[3169]: E0214 04:36:09.986412 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:36:23 old-k8s-version-960884 kubelet[3169]: E0214 04:36:23.986305 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:36:35 old-k8s-version-960884 kubelet[3169]: E0214 04:36:35.987159 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:36:42 old-k8s-version-960884 kubelet[3169]: E0214 04:36:42.088363 3169 container_manager_linux.go:510] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service
Feb 14 04:36:49 old-k8s-version-960884 kubelet[3169]: E0214 04:36:49.985981 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:37:04 old-k8s-version-960884 kubelet[3169]: E0214 04:37:04.986192 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:37:19 old-k8s-version-960884 kubelet[3169]: E0214 04:37:19.986324 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> storage-provisioner [8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6] <==
I0214 04:27:13.221352 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 04:27:13.237375 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 04:27:13.237476 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 04:27:13.246016 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 04:27:13.246216 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-960884_b849acf6-8bb7-4535-aeb5-efb2c4228d0c!
I0214 04:27:13.248314 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"2dbdfca2-a4bf-4471-9a7f-a3d7d8aeef69", APIVersion:"v1", ResourceVersion:"414", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-960884_b849acf6-8bb7-4535-aeb5-efb2c4228d0c became leader
I0214 04:27:13.347964 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-960884_b849acf6-8bb7-4535-aeb5-efb2c4228d0c!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-960884 -n old-k8s-version-960884
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-960884 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-74d5856cc6-msxjd
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-960884 describe pod metrics-server-74d5856cc6-msxjd
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-960884 describe pod metrics-server-74d5856cc6-msxjd: exit status 1 (72.398195ms)
** stderr **
Error from server (NotFound): pods "metrics-server-74d5856cc6-msxjd" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-960884 describe pod metrics-server-74d5856cc6-msxjd: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (543.30s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
start_stop_delete_test.go:287: ***** TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:287: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
start_stop_delete_test.go:287: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: showing logs for failed pods as of 2024-02-14 04:42:01.883204355 +0000 UTC m=+6838.847821954
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
start_stop_delete_test.go:291: (dbg) Run: kubectl --context default-k8s-diff-port-224675 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-224675 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: context deadline exceeded (1.467µs)
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-224675 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": context deadline exceeded
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
helpers_test.go:244: <<< TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p default-k8s-diff-port-224675 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p default-k8s-diff-port-224675 logs -n 25: (1.207423926s)
helpers_test.go:252: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| addons | enable metrics-server -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | default-k8s-diff-port-224675 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable dashboard -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:26 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable dashboard -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| delete | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:39 UTC | 14 Feb 24 04:39 UTC |
| start | -p newest-cni-050621 --memory=2200 --alsologtostderr | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:39 UTC | 14 Feb 24 04:40 UTC |
| | --wait=apiserver,system_pods,default_sa | | | | | |
| | --feature-gates ServerSideApply=true | | | | | |
| | --network-plugin=cni | | | | | |
| | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 | | | | | |
| | --driver=kvm2 --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| delete | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:40 UTC | 14 Feb 24 04:40 UTC |
| addons | enable metrics-server -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:40 UTC | 14 Feb 24 04:40 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:40 UTC | 14 Feb 24 04:41 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p newest-cni-050621 --memory=2200 --alsologtostderr | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
| | --wait=apiserver,system_pods,default_sa | | | | | |
| | --feature-gates ServerSideApply=true | | | | | |
| | --network-plugin=cni | | | | | |
| | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 | | | | | |
| | --driver=kvm2 --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| delete | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
| image | newest-cni-050621 image list | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
| | --format=json | | | | | |
| pause | -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
| delete | -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:41:04
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:41:04.098372 1554519 out.go:291] Setting OutFile to fd 1 ...
I0214 04:41:04.098629 1554519 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:41:04.098638 1554519 out.go:304] Setting ErrFile to fd 2...
I0214 04:41:04.098642 1554519 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:41:04.098811 1554519 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:41:04.099360 1554519 out.go:298] Setting JSON to false
I0214 04:41:04.100354 1554519 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":26611,"bootTime":1707859053,"procs":194,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:41:04.100413 1554519 start.go:138] virtualization: kvm guest
I0214 04:41:04.102615 1554519 out.go:177] * [newest-cni-050621] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:41:04.104114 1554519 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:41:04.105356 1554519 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:41:04.104143 1554519 notify.go:220] Checking for updates...
I0214 04:41:04.106718 1554519 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:41:04.108026 1554519 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:41:04.109336 1554519 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:41:04.110626 1554519 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:41:04.112363 1554519 config.go:182] Loaded profile config "newest-cni-050621": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:41:04.112783 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:04.112858 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:04.128497 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45561
I0214 04:41:04.128985 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:04.129564 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:04.129588 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:04.129930 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:04.130120 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:04.130353 1554519 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:41:04.130646 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:04.130685 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:04.144332 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39197
I0214 04:41:04.144751 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:04.145214 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:04.145235 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:04.145554 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:04.145744 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:04.179463 1554519 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:41:04.180907 1554519 start.go:296] selected driver: kvm2
I0214 04:41:04.180920 1554519 start.go:900] validating driver "kvm2" against &{Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods
:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:41:04.181371 1554519 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:41:04.182667 1554519 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:41:04.183071 1554519 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:41:04.198210 1554519 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:41:04.198573 1554519 start_flags.go:962] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I0214 04:41:04.198633 1554519 cni.go:84] Creating CNI manager for ""
I0214 04:41:04.198648 1554519 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:41:04.198707 1554519 start.go:339] cluster config:
{Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIS
erverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress
: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:41:04.198819 1554519 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:41:04.201531 1554519 out.go:177] * Starting "newest-cni-050621" primary control-plane node in "newest-cni-050621" cluster
I0214 04:41:04.202754 1554519 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:41:04.202789 1554519 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4
I0214 04:41:04.202796 1554519 cache.go:56] Caching tarball of preloaded images
I0214 04:41:04.202891 1554519 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:41:04.202902 1554519 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on crio
I0214 04:41:04.203025 1554519 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/config.json ...
I0214 04:41:04.203267 1554519 start.go:360] acquireMachinesLock for newest-cni-050621: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:41:04.203325 1554519 start.go:364] duration metric: took 31.498µs to acquireMachinesLock for "newest-cni-050621"
I0214 04:41:04.203345 1554519 start.go:96] Skipping create...Using existing machine configuration
I0214 04:41:04.203351 1554519 fix.go:54] fixHost starting:
I0214 04:41:04.203605 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:04.203646 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:04.217027 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46645
I0214 04:41:04.217469 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:04.217904 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:04.217925 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:04.218260 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:04.218471 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:04.218648 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetState
I0214 04:41:04.220106 1554519 fix.go:112] recreateIfNeeded on newest-cni-050621: state=Stopped err=<nil>
I0214 04:41:04.220127 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
W0214 04:41:04.220286 1554519 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:41:04.222084 1554519 out.go:177] * Restarting existing kvm2 VM for "newest-cni-050621" ...
I0214 04:41:04.223251 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Start
I0214 04:41:04.223438 1554519 main.go:141] libmachine: (newest-cni-050621) Ensuring networks are active...
I0214 04:41:04.224151 1554519 main.go:141] libmachine: (newest-cni-050621) Ensuring network default is active
I0214 04:41:04.224504 1554519 main.go:141] libmachine: (newest-cni-050621) Ensuring network mk-newest-cni-050621 is active
I0214 04:41:04.224868 1554519 main.go:141] libmachine: (newest-cni-050621) Getting domain xml...
I0214 04:41:04.225554 1554519 main.go:141] libmachine: (newest-cni-050621) Creating domain...
I0214 04:41:05.444810 1554519 main.go:141] libmachine: (newest-cni-050621) Waiting to get IP...
I0214 04:41:05.445812 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:05.446311 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:05.446417 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:05.446263 1554565 retry.go:31] will retry after 274.164851ms: waiting for machine to come up
I0214 04:41:05.721915 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:05.722461 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:05.722489 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:05.722418 1554565 retry.go:31] will retry after 234.835429ms: waiting for machine to come up
I0214 04:41:05.959142 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:05.959651 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:05.959683 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:05.959610 1554565 retry.go:31] will retry after 456.61086ms: waiting for machine to come up
I0214 04:41:06.418254 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:06.418795 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:06.418831 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:06.418766 1554565 retry.go:31] will retry after 502.651405ms: waiting for machine to come up
I0214 04:41:06.923421 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:06.923955 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:06.923979 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:06.923907 1554565 retry.go:31] will retry after 729.605217ms: waiting for machine to come up
I0214 04:41:07.655092 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:07.655617 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:07.655649 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:07.655544 1554565 retry.go:31] will retry after 878.805127ms: waiting for machine to come up
I0214 04:41:08.535568 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:08.536032 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:08.536058 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:08.535973 1554565 retry.go:31] will retry after 1.0568123s: waiting for machine to come up
I0214 04:41:09.594852 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:09.595222 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:09.595253 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:09.595165 1554565 retry.go:31] will retry after 1.15725394s: waiting for machine to come up
I0214 04:41:10.754512 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:10.754984 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:10.755012 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:10.754941 1554565 retry.go:31] will retry after 1.517605887s: waiting for machine to come up
I0214 04:41:12.274645 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:12.275079 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:12.275108 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:12.275041 1554565 retry.go:31] will retry after 2.095258553s: waiting for machine to come up
I0214 04:41:14.371455 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:14.371913 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:14.371976 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:14.371848 1554565 retry.go:31] will retry after 2.292762691s: waiting for machine to come up
I0214 04:41:16.666488 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:16.666969 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:16.667002 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:16.666910 1554565 retry.go:31] will retry after 2.610696918s: waiting for machine to come up
I0214 04:41:19.279565 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:19.279964 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:19.279994 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:19.279905 1554565 retry.go:31] will retry after 4.432494629s: waiting for machine to come up
I0214 04:41:23.716017 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.716519 1554519 main.go:141] libmachine: (newest-cni-050621) Found IP for machine: 192.168.72.60
I0214 04:41:23.716553 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has current primary IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.716564 1554519 main.go:141] libmachine: (newest-cni-050621) Reserving static IP address...
I0214 04:41:23.717051 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "newest-cni-050621", mac: "52:54:00:e6:10:2e", ip: "192.168.72.60"} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.717083 1554519 main.go:141] libmachine: (newest-cni-050621) Reserved static IP address: 192.168.72.60
I0214 04:41:23.717103 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | skip adding static IP to network mk-newest-cni-050621 - found existing host DHCP lease matching {name: "newest-cni-050621", mac: "52:54:00:e6:10:2e", ip: "192.168.72.60"}
I0214 04:41:23.717120 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Getting to WaitForSSH function...
I0214 04:41:23.717132 1554519 main.go:141] libmachine: (newest-cni-050621) Waiting for SSH to be available...
I0214 04:41:23.719435 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.719831 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.719866 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.719982 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Using SSH client type: external
I0214 04:41:23.720016 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa (-rw-------)
I0214 04:41:23.720055 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.60 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:41:23.720069 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | About to run SSH command:
I0214 04:41:23.720083 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | exit 0
I0214 04:41:23.804663 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | SSH cmd err, output: <nil>:
I0214 04:41:23.805020 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetConfigRaw
I0214 04:41:23.805683 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:41:23.808293 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.808776 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.808807 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.809024 1554519 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/config.json ...
I0214 04:41:23.809306 1554519 machine.go:94] provisionDockerMachine start ...
I0214 04:41:23.809331 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:23.809547 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:23.811897 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.812279 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.812309 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.812433 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:23.812615 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:23.812751 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:23.812894 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:23.813032 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:23.813408 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:23.813423 1554519 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:41:23.921565 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:41:23.921601 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:41:23.921891 1554519 buildroot.go:166] provisioning hostname "newest-cni-050621"
I0214 04:41:23.921921 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:41:23.922126 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:23.924819 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.925291 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.925332 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.925496 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:23.925689 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:23.925855 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:23.926008 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:23.926185 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:23.926671 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:23.926693 1554519 main.go:141] libmachine: About to run SSH command:
sudo hostname newest-cni-050621 && echo "newest-cni-050621" | sudo tee /etc/hostname
I0214 04:41:24.051649 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>: newest-cni-050621
I0214 04:41:24.051697 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.054839 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.055266 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.055289 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.055518 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.055728 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.055902 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.056040 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.056279 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:24.056624 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:24.056642 1554519 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-050621' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-050621/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-050621' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:41:24.173210 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:41:24.173246 1554519 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:41:24.173297 1554519 buildroot.go:174] setting up certificates
I0214 04:41:24.173306 1554519 provision.go:84] configureAuth start
I0214 04:41:24.173316 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:41:24.173600 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:41:24.176263 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.176672 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.176702 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.176853 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.179276 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.179646 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.179678 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.179776 1554519 provision.go:143] copyHostCerts
I0214 04:41:24.179841 1554519 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:41:24.179851 1554519 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:41:24.179916 1554519 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:41:24.180033 1554519 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:41:24.180044 1554519 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:41:24.180078 1554519 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:41:24.180173 1554519 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:41:24.180185 1554519 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:41:24.180220 1554519 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:41:24.180302 1554519 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.newest-cni-050621 san=[127.0.0.1 192.168.72.60 localhost minikube newest-cni-050621]
I0214 04:41:24.330977 1554519 provision.go:177] copyRemoteCerts
I0214 04:41:24.331045 1554519 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:41:24.331070 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.333716 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.334092 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.334124 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.334323 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.334533 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.334699 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.334849 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:24.417890 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0214 04:41:24.442438 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:41:24.464948 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:41:24.486797 1554519 provision.go:87] duration metric: took 313.477889ms to configureAuth
I0214 04:41:24.486825 1554519 buildroot.go:189] setting minikube options for container-runtime
I0214 04:41:24.487034 1554519 config.go:182] Loaded profile config "newest-cni-050621": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:41:24.487161 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.490089 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.490469 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.490499 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.490730 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.490946 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.491095 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.491249 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.491480 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:24.491799 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:24.491816 1554519 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:41:24.805327 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:41:24.805366 1554519 machine.go:97] duration metric: took 996.04399ms to provisionDockerMachine
I0214 04:41:24.805381 1554519 start.go:293] postStartSetup for "newest-cni-050621" (driver="kvm2")
I0214 04:41:24.805401 1554519 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:41:24.805430 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:24.805823 1554519 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:41:24.805860 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.808612 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.809000 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.809032 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.809203 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.809449 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.809631 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.809779 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:24.894785 1554519 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:41:24.898794 1554519 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:41:24.898822 1554519 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:41:24.898946 1554519 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:41:24.899023 1554519 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:41:24.899109 1554519 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:41:24.907239 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:41:24.932045 1554519 start.go:296] duration metric: took 126.650274ms for postStartSetup
I0214 04:41:24.932078 1554519 fix.go:56] duration metric: took 20.728727825s for fixHost
I0214 04:41:24.932103 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.934922 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.935362 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.935398 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.935600 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.935806 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.935979 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.936119 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.936303 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:24.936635 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:24.936647 1554519 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:41:25.045719 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707885684.995868752
I0214 04:41:25.045745 1554519 fix.go:216] guest clock: 1707885684.995868752
I0214 04:41:25.045755 1554519 fix.go:229] Guest: 2024-02-14 04:41:24.995868752 +0000 UTC Remote: 2024-02-14 04:41:24.932082117 +0000 UTC m=+20.882921273 (delta=63.786635ms)
I0214 04:41:25.045779 1554519 fix.go:200] guest clock delta is within tolerance: 63.786635ms
I0214 04:41:25.045787 1554519 start.go:83] releasing machines lock for "newest-cni-050621", held for 20.842449438s
I0214 04:41:25.045815 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:25.046080 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:41:25.048676 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.049069 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:25.049119 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.049306 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:25.049755 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:25.049943 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:25.050034 1554519 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:41:25.050094 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:25.050172 1554519 ssh_runner.go:195] Run: cat /version.json
I0214 04:41:25.050200 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:25.053170 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.053358 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.053529 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:25.053561 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.053689 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:25.053826 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:25.053849 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.053882 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:25.053979 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:25.054066 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:25.054144 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:25.054240 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:25.054334 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:25.054473 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:25.156305 1554519 ssh_runner.go:195] Run: systemctl --version
I0214 04:41:25.162012 1554519 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:41:25.307172 1554519 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:41:25.313108 1554519 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:41:25.313168 1554519 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:41:25.328857 1554519 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:41:25.328875 1554519 start.go:494] detecting cgroup driver to use...
I0214 04:41:25.328943 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:41:25.346327 1554519 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:41:25.361040 1554519 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:41:25.361102 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:41:25.376029 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:41:25.390979 1554519 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:41:25.492540 1554519 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:41:25.607973 1554519 docker.go:233] disabling docker service ...
I0214 04:41:25.608076 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:41:25.624727 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:41:25.636350 1554519 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:41:25.742743 1554519 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:41:25.843447 1554519 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:41:25.856268 1554519 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:41:25.873703 1554519 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:41:25.873762 1554519 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:41:25.883342 1554519 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:41:25.883394 1554519 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:41:25.892956 1554519 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:41:25.902310 1554519 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:41:25.912714 1554519 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:41:25.923682 1554519 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:41:25.932589 1554519 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:41:25.932658 1554519 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:41:25.945020 1554519 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:41:25.953752 1554519 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:41:26.061967 1554519 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:41:26.242743 1554519 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:41:26.242828 1554519 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:41:26.251327 1554519 start.go:562] Will wait 60s for crictl version
I0214 04:41:26.251389 1554519 ssh_runner.go:195] Run: which crictl
I0214 04:41:26.255211 1554519 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:41:26.293048 1554519 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:41:26.293121 1554519 ssh_runner.go:195] Run: crio --version
I0214 04:41:26.332736 1554519 ssh_runner.go:195] Run: crio --version
I0214 04:41:26.386484 1554519 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on CRI-O 1.24.1 ...
I0214 04:41:26.387941 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:41:26.390787 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:26.391190 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:26.391215 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:26.391419 1554519 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:41:26.395675 1554519 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:41:26.409829 1554519 out.go:177] - kubeadm.pod-network-cidr=10.42.0.0/16
I0214 04:41:26.410949 1554519 kubeadm.go:877] updating cluster {Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHos
tTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:41:26.411089 1554519 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:41:26.411179 1554519 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:41:26.455709 1554519 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.29.0-rc.2". assuming images are not preloaded.
I0214 04:41:26.455781 1554519 ssh_runner.go:195] Run: which lz4
I0214 04:41:26.459922 1554519 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:41:26.464372 1554519 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:41:26.464406 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (401853962 bytes)
I0214 04:41:28.074081 1554519 crio.go:444] duration metric: took 1.614196224s to copy over tarball
I0214 04:41:28.074164 1554519 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:41:30.811744 1554519 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.737552193s)
I0214 04:41:30.811769 1554519 crio.go:451] duration metric: took 2.737659634s to extract the tarball
I0214 04:41:30.811779 1554519 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:41:30.849819 1554519 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:41:30.895598 1554519 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:41:30.895625 1554519 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:41:30.895637 1554519 kubeadm.go:928] updating node { 192.168.72.60 8443 v1.29.0-rc.2 crio true true} ...
I0214 04:41:30.895862 1554519 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --feature-gates=ServerSideApply=true --hostname-override=newest-cni-050621 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.72.60
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:41:30.895957 1554519 ssh_runner.go:195] Run: crio config
I0214 04:41:30.961346 1554519 cni.go:84] Creating CNI manager for ""
I0214 04:41:30.961373 1554519 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:41:30.961384 1554519 kubeadm.go:84] Using pod CIDR: 10.42.0.0/16
I0214 04:41:30.961406 1554519 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.72.60 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-050621 NodeName:newest-cni-050621 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota feature-gates:ServerSideApply=true] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.60"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true feature-gates:ServerSideApply=true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[feature-gates:ServerSideApply=true leader-elect:false] Pairs:map[]}] FeatureArgs
:map[] NodeIP:192.168.72.60 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:41:30.961556 1554519 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.60
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "newest-cni-050621"
kubeletExtraArgs:
node-ip: 192.168.72.60
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.60"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
feature-gates: "ServerSideApply=true"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
feature-gates: "ServerSideApply=true"
leader-elect: "false"
scheduler:
extraArgs:
feature-gates: "ServerSideApply=true"
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:41:30.961619 1554519 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0214 04:41:30.972497 1554519 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:41:30.972584 1554519 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:41:30.982896 1554519 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (358 bytes)
I0214 04:41:30.998352 1554519 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0214 04:41:31.015820 1554519 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2287 bytes)
I0214 04:41:31.033051 1554519 ssh_runner.go:195] Run: grep 192.168.72.60 control-plane.minikube.internal$ /etc/hosts
I0214 04:41:31.037340 1554519 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.60 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:41:31.050658 1554519 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:41:31.178437 1554519 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:41:31.196575 1554519 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621 for IP: 192.168.72.60
I0214 04:41:31.196602 1554519 certs.go:194] generating shared ca certs ...
I0214 04:41:31.196624 1554519 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:41:31.196813 1554519 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:41:31.196877 1554519 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:41:31.196893 1554519 certs.go:256] generating profile certs ...
I0214 04:41:31.197054 1554519 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/client.key
I0214 04:41:31.197142 1554519 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.key.3ed58110
I0214 04:41:31.197205 1554519 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.key
I0214 04:41:31.197461 1554519 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:41:31.197530 1554519 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:41:31.197551 1554519 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:41:31.197596 1554519 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:41:31.197630 1554519 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:41:31.197663 1554519 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:41:31.197718 1554519 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:41:31.198710 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:41:31.241393 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:41:31.274138 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:41:31.308205 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:41:31.333055 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 04:41:31.366956 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:41:31.389540 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:41:31.413765 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:41:31.436162 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:41:31.463782 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:41:31.490529 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:41:31.517901 1554519 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:41:31.537718 1554519 ssh_runner.go:195] Run: openssl version
I0214 04:41:31.545088 1554519 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:41:31.556542 1554519 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:41:31.562893 1554519 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:41:31.562989 1554519 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:41:31.568888 1554519 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:41:31.580545 1554519 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:41:31.591656 1554519 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:41:31.596685 1554519 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:41:31.596724 1554519 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:41:31.603156 1554519 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:41:31.613494 1554519 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:41:31.624138 1554519 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:41:31.628653 1554519 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:41:31.628718 1554519 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:41:31.634522 1554519 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:41:31.646343 1554519 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:41:31.651188 1554519 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:41:31.685944 1554519 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:41:31.692291 1554519 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:41:31.698232 1554519 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:41:31.704238 1554519 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:41:31.710125 1554519 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:41:31.715825 1554519 kubeadm.go:391] StartCluster: {Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29
.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTi
meout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:41:31.715920 1554519 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:41:31.715956 1554519 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:41:31.758221 1554519 cri.go:89] found id: ""
I0214 04:41:31.758302 1554519 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:41:31.769446 1554519 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:41:31.769471 1554519 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:41:31.769478 1554519 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:41:31.769529 1554519 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:41:31.779140 1554519 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:41:31.780157 1554519 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-050621" does not appear in /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:41:31.780733 1554519 kubeconfig.go:62] /home/jenkins/minikube-integration/17909-1487441/kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-050621" cluster setting kubeconfig missing "newest-cni-050621" context setting]
I0214 04:41:31.781649 1554519 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:41:31.888122 1554519 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:41:31.899685 1554519 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.72.60
I0214 04:41:31.899723 1554519 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:41:31.899739 1554519 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:41:31.899806 1554519 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:41:31.938820 1554519 cri.go:89] found id: ""
I0214 04:41:31.938923 1554519 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:41:31.954905 1554519 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:41:31.964746 1554519 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:41:31.964767 1554519 kubeadm.go:156] found existing configuration files:
I0214 04:41:31.964818 1554519 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:41:31.974139 1554519 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:41:31.974214 1554519 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:41:31.983878 1554519 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:41:31.992817 1554519 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:41:31.992880 1554519 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:41:32.002554 1554519 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:41:32.011165 1554519 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:41:32.011210 1554519 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:41:32.020260 1554519 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:41:32.028915 1554519 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:41:32.028976 1554519 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:41:32.038853 1554519 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:41:32.049955 1554519 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:41:32.204499 1554519 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:41:33.135443 1554519 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:41:33.354420 1554519 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:41:33.426621 1554519 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:41:33.554658 1554519 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:41:33.554760 1554519 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:41:34.055048 1554519 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:41:34.555552 1554519 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:41:35.055051 1554519 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:41:35.554862 1554519 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:41:36.055537 1554519 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:41:36.080232 1554519 api_server.go:72] duration metric: took 2.525573594s to wait for apiserver process to appear ...
I0214 04:41:36.080263 1554519 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:41:36.080288 1554519 api_server.go:253] Checking apiserver healthz at https://192.168.72.60:8443/healthz ...
I0214 04:41:39.144798 1554519 api_server.go:279] https://192.168.72.60:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:41:39.144827 1554519 api_server.go:103] status: https://192.168.72.60:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:41:39.144844 1554519 api_server.go:253] Checking apiserver healthz at https://192.168.72.60:8443/healthz ...
I0214 04:41:39.167713 1554519 api_server.go:279] https://192.168.72.60:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:41:39.167755 1554519 api_server.go:103] status: https://192.168.72.60:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:41:39.580638 1554519 api_server.go:253] Checking apiserver healthz at https://192.168.72.60:8443/healthz ...
I0214 04:41:39.600196 1554519 api_server.go:279] https://192.168.72.60:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:41:39.600240 1554519 api_server.go:103] status: https://192.168.72.60:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:41:40.080703 1554519 api_server.go:253] Checking apiserver healthz at https://192.168.72.60:8443/healthz ...
I0214 04:41:40.088876 1554519 api_server.go:279] https://192.168.72.60:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:41:40.088905 1554519 api_server.go:103] status: https://192.168.72.60:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:41:40.581211 1554519 api_server.go:253] Checking apiserver healthz at https://192.168.72.60:8443/healthz ...
I0214 04:41:40.587608 1554519 api_server.go:279] https://192.168.72.60:8443/healthz returned 200:
ok
I0214 04:41:40.595720 1554519 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:41:40.595755 1554519 api_server.go:131] duration metric: took 4.515483368s to wait for apiserver health ...
I0214 04:41:40.595769 1554519 cni.go:84] Creating CNI manager for ""
I0214 04:41:40.595779 1554519 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:41:40.597238 1554519 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:41:40.598608 1554519 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:41:40.611297 1554519 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:41:40.685354 1554519 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:41:40.700541 1554519 system_pods.go:59] 8 kube-system pods found
I0214 04:41:40.700584 1554519 system_pods.go:61] "coredns-76f75df574-nvk5q" [2af05ac6-541b-4153-a7e5-1dc62fd358ee] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:41:40.700595 1554519 system_pods.go:61] "etcd-newest-cni-050621" [41e1d425-de9c-4fcb-966e-0f8db51fb71c] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:41:40.700615 1554519 system_pods.go:61] "kube-apiserver-newest-cni-050621" [4e4d31cf-830b-45a0-bee8-2a65e6eb6f33] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:41:40.700633 1554519 system_pods.go:61] "kube-controller-manager-newest-cni-050621" [fcbc56bc-b26c-43db-9d18-15ccea63c614] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:41:40.700642 1554519 system_pods.go:61] "kube-proxy-n9mg9" [bcbb67a6-981e-4ec7-8549-53d30aa257ed] Pending / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:41:40.700656 1554519 system_pods.go:61] "kube-scheduler-newest-cni-050621" [e0a24d2e-7845-4ea1-91db-b58a22207428] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:41:40.700666 1554519 system_pods.go:61] "metrics-server-57f55c9bc5-qfrnj" [7e330e92-941c-45a7-b8be-2d4b3239ca61] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:41:40.700683 1554519 system_pods.go:61] "storage-provisioner" [d5e7031c-70a0-47ec-996e-b6a15694f74f] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:41:40.700695 1554519 system_pods.go:74] duration metric: took 15.314804ms to wait for pod list to return data ...
I0214 04:41:40.700708 1554519 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:41:40.707512 1554519 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:41:40.707551 1554519 node_conditions.go:123] node cpu capacity is 2
I0214 04:41:40.707566 1554519 node_conditions.go:105] duration metric: took 6.851049ms to run NodePressure ...
I0214 04:41:40.707589 1554519 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:41:41.086793 1554519 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:41:41.099402 1554519 ops.go:34] apiserver oom_adj: -16
I0214 04:41:41.099430 1554519 kubeadm.go:591] duration metric: took 9.329942174s to restartPrimaryControlPlane
I0214 04:41:41.099439 1554519 kubeadm.go:393] duration metric: took 9.383620687s to StartCluster
I0214 04:41:41.099457 1554519 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:41:41.099539 1554519 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:41:41.100515 1554519 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:41:41.100741 1554519 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:41:41.102159 1554519 out.go:177] * Verifying Kubernetes components...
I0214 04:41:41.100892 1554519 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:41:41.100965 1554519 config.go:182] Loaded profile config "newest-cni-050621": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:41:41.103425 1554519 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:41:41.102275 1554519 addons.go:69] Setting storage-provisioner=true in profile "newest-cni-050621"
I0214 04:41:41.103500 1554519 addons.go:234] Setting addon storage-provisioner=true in "newest-cni-050621"
W0214 04:41:41.103512 1554519 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:41:41.102279 1554519 addons.go:69] Setting default-storageclass=true in profile "newest-cni-050621"
I0214 04:41:41.103597 1554519 host.go:66] Checking if "newest-cni-050621" exists ...
I0214 04:41:41.103658 1554519 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-050621"
I0214 04:41:41.102293 1554519 addons.go:69] Setting dashboard=true in profile "newest-cni-050621"
I0214 04:41:41.103713 1554519 addons.go:234] Setting addon dashboard=true in "newest-cni-050621"
W0214 04:41:41.103728 1554519 addons.go:243] addon dashboard should already be in state true
I0214 04:41:41.103765 1554519 host.go:66] Checking if "newest-cni-050621" exists ...
I0214 04:41:41.102307 1554519 addons.go:69] Setting metrics-server=true in profile "newest-cni-050621"
I0214 04:41:41.103799 1554519 addons.go:234] Setting addon metrics-server=true in "newest-cni-050621"
W0214 04:41:41.103810 1554519 addons.go:243] addon metrics-server should already be in state true
I0214 04:41:41.103837 1554519 host.go:66] Checking if "newest-cni-050621" exists ...
I0214 04:41:41.103986 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.104041 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.104116 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.104171 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.104189 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.104225 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.104189 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.104517 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.124067 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38133
I0214 04:41:41.124102 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42523
I0214 04:41:41.124069 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36309
I0214 04:41:41.124560 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.124684 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.124724 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.125155 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.125177 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.125189 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.125206 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.125214 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.125236 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.125575 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.125632 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.125638 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.125816 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetState
I0214 04:41:41.126050 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37073
I0214 04:41:41.126135 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.126177 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.126262 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.126329 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.126537 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.127030 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.127050 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.127607 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.128171 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.128238 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.130277 1554519 addons.go:234] Setting addon default-storageclass=true in "newest-cni-050621"
W0214 04:41:41.130298 1554519 addons.go:243] addon default-storageclass should already be in state true
I0214 04:41:41.130338 1554519 host.go:66] Checking if "newest-cni-050621" exists ...
I0214 04:41:41.130675 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.130717 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.141285 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41333
I0214 04:41:41.141687 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.142150 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.142177 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.142523 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.142694 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetState
I0214 04:41:41.144783 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:41.146573 1554519 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:41:41.145219 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41865
I0214 04:41:41.146197 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36657
I0214 04:41:41.147796 1554519 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:41:41.147819 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:41:41.147842 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:41.148193 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.148301 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.148717 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.148740 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.148840 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.148864 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.149117 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.149184 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43589
I0214 04:41:41.149371 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.149481 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetState
I0214 04:41:41.149542 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.149608 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetState
I0214 04:41:41.150617 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.150643 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.151089 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.151648 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:41.153301 1554519 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:41:41.152146 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:41.152354 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:41.153834 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:41.154537 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:41.154455 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:41.154572 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:41.154690 1554519 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:41:41.154704 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:41.154708 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:41:41.154726 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:41.154735 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:41.154923 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:41.156188 1554519 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0214 04:41:41.155128 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:41.157087 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:41.157505 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:41.157530 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:41.158681 1554519 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0214 04:41:41.157678 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:41.159847 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0214 04:41:41.159864 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0214 04:41:41.159881 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:41.159955 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:41.160117 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:41.160278 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:41.162729 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:41.163152 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:41.163179 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:41.163415 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:41.163601 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:41.163735 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:41.163859 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:41.174302 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34267
I0214 04:41:41.174714 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:41.175090 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:41.175111 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:41.175478 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:41.175651 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetState
I0214 04:41:41.177074 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:41.177456 1554519 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:41:41.177478 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:41:41.177497 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:41.180021 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:41.180373 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:41.180397 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:41.180528 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:41.180709 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:41.180919 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:41.181117 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:41.339498 1554519 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:41:41.355051 1554519 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:41:41.355135 1554519 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:41:41.366217 1554519 api_server.go:72] duration metric: took 265.440378ms to wait for apiserver process to appear ...
I0214 04:41:41.366235 1554519 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:41:41.366263 1554519 api_server.go:253] Checking apiserver healthz at https://192.168.72.60:8443/healthz ...
I0214 04:41:41.373799 1554519 api_server.go:279] https://192.168.72.60:8443/healthz returned 200:
ok
I0214 04:41:41.375940 1554519 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:41:41.375965 1554519 api_server.go:131] duration metric: took 9.72226ms to wait for apiserver health ...
I0214 04:41:41.375975 1554519 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:41:41.387882 1554519 system_pods.go:59] 8 kube-system pods found
I0214 04:41:41.387913 1554519 system_pods.go:61] "coredns-76f75df574-nvk5q" [2af05ac6-541b-4153-a7e5-1dc62fd358ee] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:41:41.387928 1554519 system_pods.go:61] "etcd-newest-cni-050621" [41e1d425-de9c-4fcb-966e-0f8db51fb71c] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:41:41.387942 1554519 system_pods.go:61] "kube-apiserver-newest-cni-050621" [4e4d31cf-830b-45a0-bee8-2a65e6eb6f33] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:41:41.387952 1554519 system_pods.go:61] "kube-controller-manager-newest-cni-050621" [fcbc56bc-b26c-43db-9d18-15ccea63c614] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:41:41.387967 1554519 system_pods.go:61] "kube-proxy-n9mg9" [bcbb67a6-981e-4ec7-8549-53d30aa257ed] Pending / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:41:41.387979 1554519 system_pods.go:61] "kube-scheduler-newest-cni-050621" [e0a24d2e-7845-4ea1-91db-b58a22207428] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:41:41.387993 1554519 system_pods.go:61] "metrics-server-57f55c9bc5-qfrnj" [7e330e92-941c-45a7-b8be-2d4b3239ca61] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:41:41.388004 1554519 system_pods.go:61] "storage-provisioner" [d5e7031c-70a0-47ec-996e-b6a15694f74f] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:41:41.388014 1554519 system_pods.go:74] duration metric: took 12.030454ms to wait for pod list to return data ...
I0214 04:41:41.388021 1554519 default_sa.go:34] waiting for default service account to be created ...
I0214 04:41:41.390524 1554519 default_sa.go:45] found service account: "default"
I0214 04:41:41.390547 1554519 default_sa.go:55] duration metric: took 2.520123ms for default service account to be created ...
I0214 04:41:41.390555 1554519 kubeadm.go:576] duration metric: took 289.780865ms to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I0214 04:41:41.390570 1554519 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:41:41.393120 1554519 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:41:41.393145 1554519 node_conditions.go:123] node cpu capacity is 2
I0214 04:41:41.393159 1554519 node_conditions.go:105] duration metric: took 2.580681ms to run NodePressure ...
I0214 04:41:41.393169 1554519 start.go:240] waiting for startup goroutines ...
I0214 04:41:41.445803 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0214 04:41:41.445829 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0214 04:41:41.464971 1554519 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:41:41.481162 1554519 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:41:41.481187 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:41:41.483217 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0214 04:41:41.483238 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0214 04:41:41.504720 1554519 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:41:41.505169 1554519 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:41:41.505195 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:41:41.521199 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0214 04:41:41.521216 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0214 04:41:41.554823 1554519 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:41:41.554871 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:41:41.569394 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0214 04:41:41.569414 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0214 04:41:41.618423 1554519 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:41:41.637884 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0214 04:41:41.637923 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0214 04:41:41.751641 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0214 04:41:41.751667 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0214 04:41:41.812147 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0214 04:41:41.812174 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0214 04:41:41.872209 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0214 04:41:41.872245 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0214 04:41:41.935895 1554519 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0214 04:41:41.935921 1554519 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0214 04:41:41.986516 1554519 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0214 04:41:43.220696 1554519 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.755685124s)
I0214 04:41:43.220767 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.220782 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.220778 1554519 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.716020739s)
I0214 04:41:43.220855 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.220877 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.221161 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Closing plugin on server side
I0214 04:41:43.221212 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.221220 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.221229 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.221238 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.221267 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Closing plugin on server side
I0214 04:41:43.221278 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.221293 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.221302 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.221312 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.221497 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.221513 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.221903 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Closing plugin on server side
I0214 04:41:43.222046 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.222086 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.227415 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.227433 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.227646 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.227661 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.251636 1554519 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.63314903s)
I0214 04:41:43.251695 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.251710 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.252154 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.252182 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.252194 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.252206 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.252154 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Closing plugin on server side
I0214 04:41:43.252472 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.252491 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.252503 1554519 addons.go:470] Verifying addon metrics-server=true in "newest-cni-050621"
I0214 04:41:43.612547 1554519 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.625971558s)
I0214 04:41:43.612619 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.612639 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.612973 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.612996 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.613010 1554519 main.go:141] libmachine: Making call to close driver server
I0214 04:41:43.613025 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Close
I0214 04:41:43.613028 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Closing plugin on server side
I0214 04:41:43.613280 1554519 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:41:43.613296 1554519 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:41:43.615126 1554519 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p newest-cni-050621 addons enable metrics-server
I0214 04:41:43.616436 1554519 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0214 04:41:43.617799 1554519 addons.go:505] duration metric: took 2.516933078s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0214 04:41:43.617836 1554519 start.go:245] waiting for cluster config update ...
I0214 04:41:43.617852 1554519 start.go:254] writing updated cluster config ...
I0214 04:41:43.618084 1554519 ssh_runner.go:195] Run: rm -f paused
I0214 04:41:43.704200 1554519 start.go:599] kubectl: 1.29.1, cluster: 1.29.0-rc.2 (minor skew: 0)
I0214 04:41:43.705791 1554519 out.go:177] * Done! kubectl is now configured to use "newest-cni-050621" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:20:50 UTC, ends at Wed 2024-02-14 04:42:02 UTC. --
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.629801427Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=a85f1394-40d2-478b-8511-4724b1a54db2 name=/runtime.v1.RuntimeService/Version
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.631386260Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=ea4fae79-aa37-4c96-84e4-1d5ed57fbce1 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.631766248Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885722631752376,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=ea4fae79-aa37-4c96-84e4-1d5ed57fbce1 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.633421125Z" level=debug msg="Request: &ListPodSandboxRequest{Filter:&PodSandboxFilter{Id:,State:&PodSandboxStateValue{State:SANDBOX_READY,},LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=2715de31-52d1-4500-a675-c1d02d2e7e4b name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.633652762Z" level=debug msg="Response: &ListPodSandboxResponse{Items:[]*PodSandbox{&PodSandbox{Id:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&PodSandboxMetadata{Name:busybox,Uid:7a966e85-ff0d-4240-9a1e-0cd8931223ce,Namespace:default,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884483569965557,Labels:map[string]string{integration-test: busybox,io.kubernetes.container.name: POD,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T04:21:15.547266841Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&PodSandboxMetadata{Name:coredns-5dd5756b68-27jph,Uid:099e2538-7a01-4da3-b27c-490e408e8b76,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:170788
4483262488565,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,k8s-app: kube-dns,pod-template-hash: 5dd5756b68,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T04:21:15.547267980Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:32faf06b611a331925fec30c806504fa26ef1f6cf5796720a7ee63328822e0f2,Metadata:&PodSandboxMetadata{Name:metrics-server-57f55c9bc5-8bqch,Uid:95e64837-e855-49a4-adda-14b8dc40ec42,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884479661572366,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: metrics-server-57f55c9bc5-8bqch,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 95e64837-e855-49a4-adda-14b8dc40ec42,k8s-app: metrics-server,pod-template-hash: 57f55c9bc5,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14
T04:21:15.547272377Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&PodSandboxMetadata{Name:storage-provisioner,Uid:d1139208-fa62-4d5b-89c4-387eef62f726,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884475900627310,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,integration-test: storage-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"g
cr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n,kubernetes.io/config.seen: 2024-02-14T04:21:15.547273626Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&PodSandboxMetadata{Name:kube-proxy-dbkzv,Uid:79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884475879786443,Labels:map[string]string{controller-revision-hash: 8486c7d9cd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,k8s-app: kube-proxy,pod-template-generation: 1,},Annotations:map[string]string{ku
bernetes.io/config.seen: 2024-02-14T04:21:15.547265439Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&PodSandboxMetadata{Name:kube-apiserver-default-k8s-diff-port-224675,Uid:c202422c726957ceb6007b1d37008f86,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884469147113310,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c202422c726957ceb6007b1d37008f86,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.61.188:8444,kubernetes.io/config.hash: c202422c726957ceb6007b1d37008f86,kubernetes.io/config.seen: 2024-02-14T04:21:08.552400327Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16
f0,Metadata:&PodSandboxMetadata{Name:etcd-default-k8s-diff-port-224675,Uid:b5f725746bea6366325db394543548f8,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884469136418424,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/etcd.advertise-client-urls: https://192.168.61.188:2379,kubernetes.io/config.hash: b5f725746bea6366325db394543548f8,kubernetes.io/config.seen: 2024-02-14T04:21:08.618349836Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&PodSandboxMetadata{Name:kube-scheduler-default-k8s-diff-port-224675,Uid:e7a7f326a48baeecb655bbb0ffd6a2e7,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884469119022935,Labels:map[string]str
ing{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e7a7f326a48baeecb655bbb0ffd6a2e7,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: e7a7f326a48baeecb655bbb0ffd6a2e7,kubernetes.io/config.seen: 2024-02-14T04:21:08.552405096Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&PodSandboxMetadata{Name:kube-controller-manager-default-k8s-diff-port-224675,Uid:1edb723716f081e242a25cd747baa8c6,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884469109728800,Labels:map[string]string{component: kube-controller-manager,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1edb723716f081e242a25cd747baa8c6,tier: control-p
lane,},Annotations:map[string]string{kubernetes.io/config.hash: 1edb723716f081e242a25cd747baa8c6,kubernetes.io/config.seen: 2024-02-14T04:21:08.552404161Z,kubernetes.io/config.source: file,},RuntimeHandler:,},},}" file="go-grpc-middleware/chain.go:25" id=2715de31-52d1-4500-a675-c1d02d2e7e4b name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.634384437Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:&ContainerStateValue{State:CONTAINER_RUNNING,},PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=a4ee2f62-608a-433d-8dc3-cb9288260074 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.634455074Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=a4ee2f62-608a-433d-8dc3-cb9288260074 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.634621177Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:3,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884507870297006,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount
: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0016fc4c4674b56dbb7ab4eaae5f4c19f216c8ff0018b2c92b25d30eb8c27781,PodSandboxId:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,State:CONTAINER_RUNNING,CreatedAt:1707884485783675322,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{io.kubernetes.container.hash: e26927b8,io.kubernetes.container.restartCount: 1,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5,PodSandboxId:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884484151191349,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,},Annotations:map[string]string{io.kubernetes.container.hash: cefb2541,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\
":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540,PodSandboxId:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884476667656879,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:
79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,},Annotations:map[string]string{io.kubernetes.container.hash: 43b220a8,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90,PodSandboxId:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707884470424343548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.
uid: e7a7f326a48baeecb655bbb0ffd6a2e7,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b,PodSandboxId:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16f0,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884470045539790,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,},
Annotations:map[string]string{io.kubernetes.container.hash: 52c9cfac,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71,PodSandboxId:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884469879485276,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:
1edb723716f081e242a25cd747baa8c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2,PodSandboxId:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884469655345549,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:
c202422c726957ceb6007b1d37008f86,},Annotations:map[string]string{io.kubernetes.container.hash: 56bc3a18,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=a4ee2f62-608a-433d-8dc3-cb9288260074 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.635885482Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=41c9ff02-f320-4f07-b843-637196757253 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.636343528Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=41c9ff02-f320-4f07-b843-637196757253 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.636910168Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:3,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884507870297006,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount
: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0016fc4c4674b56dbb7ab4eaae5f4c19f216c8ff0018b2c92b25d30eb8c27781,PodSandboxId:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,State:CONTAINER_RUNNING,CreatedAt:1707884485783675322,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{io.kubernetes.container.hash: e26927b8,io.kubernetes.container.restartCount: 1,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5,PodSandboxId:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884484151191349,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,},Annotations:map[string]string{io.kubernetes.container.hash: cefb2541,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\
":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:2,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707884476788095612,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: k
ube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540,PodSandboxId:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884476667656879,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7
9b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,},Annotations:map[string]string{io.kubernetes.container.hash: 43b220a8,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90,PodSandboxId:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707884470424343548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.ui
d: e7a7f326a48baeecb655bbb0ffd6a2e7,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b,PodSandboxId:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16f0,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884470045539790,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,},An
notations:map[string]string{io.kubernetes.container.hash: 52c9cfac,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71,PodSandboxId:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884469879485276,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1
edb723716f081e242a25cd747baa8c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2,PodSandboxId:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884469655345549,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c
202422c726957ceb6007b1d37008f86,},Annotations:map[string]string{io.kubernetes.container.hash: 56bc3a18,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=41c9ff02-f320-4f07-b843-637196757253 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.675043016Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=2c190611-5159-4e9d-b499-9f1dd783ceba name=/runtime.v1.RuntimeService/Version
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.675123496Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=2c190611-5159-4e9d-b499-9f1dd783ceba name=/runtime.v1.RuntimeService/Version
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.676159213Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=c5982351-3da1-484e-992d-dcfab6cfbd2b name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.676637989Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885722676619249,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=c5982351-3da1-484e-992d-dcfab6cfbd2b name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.677173758Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=c9b388d5-4268-4613-8a86-64849aea79bc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.677325366Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=c9b388d5-4268-4613-8a86-64849aea79bc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.677512058Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:3,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884507870297006,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount
: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0016fc4c4674b56dbb7ab4eaae5f4c19f216c8ff0018b2c92b25d30eb8c27781,PodSandboxId:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,State:CONTAINER_RUNNING,CreatedAt:1707884485783675322,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{io.kubernetes.container.hash: e26927b8,io.kubernetes.container.restartCount: 1,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5,PodSandboxId:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884484151191349,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,},Annotations:map[string]string{io.kubernetes.container.hash: cefb2541,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\
":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:2,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707884476788095612,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: k
ube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540,PodSandboxId:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884476667656879,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7
9b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,},Annotations:map[string]string{io.kubernetes.container.hash: 43b220a8,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90,PodSandboxId:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707884470424343548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.ui
d: e7a7f326a48baeecb655bbb0ffd6a2e7,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b,PodSandboxId:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16f0,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884470045539790,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,},An
notations:map[string]string{io.kubernetes.container.hash: 52c9cfac,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71,PodSandboxId:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884469879485276,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1
edb723716f081e242a25cd747baa8c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2,PodSandboxId:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884469655345549,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c
202422c726957ceb6007b1d37008f86,},Annotations:map[string]string{io.kubernetes.container.hash: 56bc3a18,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=c9b388d5-4268-4613-8a86-64849aea79bc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.707925657Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=b6fc241c-6ed8-48c3-9b7c-1457d4bcdbff name=/runtime.v1.RuntimeService/Version
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.708003923Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=b6fc241c-6ed8-48c3-9b7c-1457d4bcdbff name=/runtime.v1.RuntimeService/Version
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.709100642Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=679fe66a-0b44-4020-8fa8-83bc2870efc1 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.709556427Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885722709544196,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=679fe66a-0b44-4020-8fa8-83bc2870efc1 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.710374418Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=3de4c3d8-2a95-4754-855a-730dc7e6075d name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.710444502Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=3de4c3d8-2a95-4754-855a-730dc7e6075d name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:42:02 default-k8s-diff-port-224675 crio[733]: time="2024-02-14 04:42:02.710635338Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:3,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884507870297006,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount
: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0016fc4c4674b56dbb7ab4eaae5f4c19f216c8ff0018b2c92b25d30eb8c27781,PodSandboxId:b6be0dda006721b7f7123116a5fe323aa41321ca78f5603f61f9af97ae387ff4,Metadata:&ContainerMetadata{Name:busybox,Attempt:1,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e,State:CONTAINER_RUNNING,CreatedAt:1707884485783675322,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7a966e85-ff0d-4240-9a1e-0cd8931223ce,},Annotations:map[string]string{io.kubernetes.container.hash: e26927b8,io.kubernetes.container.restartCount: 1,io.kubernetes.
container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5,PodSandboxId:3a925d22313765fa6a8bb54d0bcde681416b5b3c8e653cdd5c3f26dd30df39a4,Metadata:&ContainerMetadata{Name:coredns,Attempt:1,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884484151191349,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-27jph,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 099e2538-7a01-4da3-b27c-490e408e8b76,},Annotations:map[string]string{io.kubernetes.container.hash: cefb2541,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\
":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970,PodSandboxId:0aae40d59181d072b87954101de974379788619615c6fd446fec0ccac8b75584,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:2,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_EXITED,CreatedAt:1707884476788095612,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: k
ube-system,io.kubernetes.pod.uid: d1139208-fa62-4d5b-89c4-387eef62f726,},Annotations:map[string]string{io.kubernetes.container.hash: 853070ad,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540,PodSandboxId:e4a8cb9c32424a1819fb05e24000c844577c79c0a76b1a9d7a1b0587a5709a40,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:1,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884476667656879,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-dbkzv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7
9b9bb9e-6b4b-4883-ab61-f3b8d6c1040b,},Annotations:map[string]string{io.kubernetes.container.hash: 43b220a8,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90,PodSandboxId:9512e8ddc8b167bb430b2351d3b51d791e3651fcaac5002cca33a2af7cead5eb,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:1,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:1707884470424343548,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.ui
d: e7a7f326a48baeecb655bbb0ffd6a2e7,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b,PodSandboxId:6f26452c365aad7151b3a37cd6466f0f5642012118eb8ad81e42c34d0bfd16f0,Metadata:&ContainerMetadata{Name:etcd,Attempt:1,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884470045539790,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5f725746bea6366325db394543548f8,},An
notations:map[string]string{io.kubernetes.container.hash: 52c9cfac,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71,PodSandboxId:4915ecf464ee31c0f47f66390422f7a51b52b0bbd61510e4bb10dbb20ba81e7e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:1,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884469879485276,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1
edb723716f081e242a25cd747baa8c6,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2,PodSandboxId:3f947fc834cccebf05dfb4d59f8b2b32be0ce5dec2f2160493b07860019871eb,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884469655345549,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-default-k8s-diff-port-224675,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c
202422c726957ceb6007b1d37008f86,},Annotations:map[string]string{io.kubernetes.container.hash: 56bc3a18,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=3de4c3d8-2a95-4754-855a-730dc7e6075d name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
d096f7fcb2dc8 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 20 minutes ago Running storage-provisioner 3 0aae40d59181d storage-provisioner
0016fc4c4674b gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 20 minutes ago Running busybox 1 b6be0dda00672 busybox
e173981e71707 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 20 minutes ago Running coredns 1 3a925d2231376 coredns-5dd5756b68-27jph
71629517c493b 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 20 minutes ago Exited storage-provisioner 2 0aae40d59181d storage-provisioner
778678b7dbd2a 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 20 minutes ago Running kube-proxy 1 e4a8cb9c32424 kube-proxy-dbkzv
72296e4b9708d e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 20 minutes ago Running kube-scheduler 1 9512e8ddc8b16 kube-scheduler-default-k8s-diff-port-224675
501b83ee5fe01 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 20 minutes ago Running etcd 1 6f26452c365aa etcd-default-k8s-diff-port-224675
127e4a7f35e1f d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 20 minutes ago Running kube-controller-manager 1 4915ecf464ee3 kube-controller-manager-default-k8s-diff-port-224675
be8456a3075c9 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 20 minutes ago Running kube-apiserver 1 3f947fc834ccc kube-apiserver-default-k8s-diff-port-224675
==> coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 7996ca7cabdb2fd3e37b0463c78d5a492f8d30690ee66a90ae7ff24c50d9d936a24d239b3a5946771521ff70c09a796ffaf6ef8abe5753fd1ad5af38b6cdbb7f
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
[INFO] 127.0.0.1:34134 - 22903 "HINFO IN 1330231995776351025.9001170261616069943. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.034097316s
==> describe nodes <==
Name: default-k8s-diff-port-224675
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=default-k8s-diff-port-224675
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=default-k8s-diff-port-224675
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_12_52_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:12:49 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: default-k8s-diff-port-224675
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 04:42:00 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:37:04 +0000 Wed, 14 Feb 2024 04:12:46 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:37:04 +0000 Wed, 14 Feb 2024 04:12:46 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:37:04 +0000 Wed, 14 Feb 2024 04:12:46 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:37:04 +0000 Wed, 14 Feb 2024 04:21:25 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.61.188
Hostname: default-k8s-diff-port-224675
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: ec335b0ba57942ada23c54d0ebac91cf
System UUID: ec335b0b-a579-42ad-a23c-54d0ebac91cf
Boot ID: e90d263e-ea87-460a-9b3c-6fb2dc30dc5f
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 28m
kube-system coredns-5dd5756b68-27jph 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 28m
kube-system etcd-default-k8s-diff-port-224675 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 29m
kube-system kube-apiserver-default-k8s-diff-port-224675 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 29m
kube-system kube-controller-manager-default-k8s-diff-port-224675 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 29m
kube-system kube-proxy-dbkzv 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 28m
kube-system kube-scheduler-default-k8s-diff-port-224675 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 29m
kube-system metrics-server-57f55c9bc5-8bqch 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (9%!)(MISSING) 0 (0%!)(MISSING) 28m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 28m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 370Mi (17%!)(MISSING) 170Mi (8%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 28m kube-proxy
Normal Starting 20m kube-proxy
Normal NodeAllocatableEnforced 29m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 29m kubelet Node default-k8s-diff-port-224675 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 29m kubelet Node default-k8s-diff-port-224675 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 29m kubelet Node default-k8s-diff-port-224675 status is now: NodeHasSufficientPID
Normal NodeReady 29m kubelet Node default-k8s-diff-port-224675 status is now: NodeReady
Normal Starting 29m kubelet Starting kubelet.
Normal RegisteredNode 28m node-controller Node default-k8s-diff-port-224675 event: Registered Node default-k8s-diff-port-224675 in Controller
Normal Starting 20m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 20m (x8 over 20m) kubelet Node default-k8s-diff-port-224675 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 20m (x8 over 20m) kubelet Node default-k8s-diff-port-224675 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 20m (x7 over 20m) kubelet Node default-k8s-diff-port-224675 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 20m kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 20m node-controller Node default-k8s-diff-port-224675 event: Registered Node default-k8s-diff-port-224675 in Controller
==> dmesg <==
[Feb14 04:20] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.073387] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.573401] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.483834] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.150941] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000001] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.677564] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000005] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)
[ +5.542499] systemd-fstab-generator[659]: Ignoring "noauto" for root device
[ +0.125463] systemd-fstab-generator[670]: Ignoring "noauto" for root device
[ +0.148507] systemd-fstab-generator[683]: Ignoring "noauto" for root device
[ +0.110703] systemd-fstab-generator[694]: Ignoring "noauto" for root device
[ +0.253903] systemd-fstab-generator[718]: Ignoring "noauto" for root device
[Feb14 04:21] systemd-fstab-generator[819]: Ignoring "noauto" for root device
[ +2.936179] systemd-fstab-generator[951]: Ignoring "noauto" for root device
[ +9.599284] systemd-fstab-generator[1571]: Ignoring "noauto" for root device
[ +5.356032] kauditd_printk_skb: 19 callbacks suppressed
==> etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] <==
{"level":"warn","ts":"2024-02-14T04:21:30.140154Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T04:21:29.365977Z","time spent":"773.725226ms","remote":"127.0.0.1:46774","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4139,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" mod_revision:500 > success:<request_put:<key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" value_size:4061 >> failure:<request_range:<key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" > >"}
{"level":"warn","ts":"2024-02-14T04:21:30.443057Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"227.50923ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8200647714936397173 > lease_revoke:<id:71ce8da5d131498d>","response":"size:28"}
{"level":"info","ts":"2024-02-14T04:21:30.443321Z","caller":"traceutil/trace.go:171","msg":"trace[1249764214] linearizableReadLoop","detail":"{readStateIndex:601; appliedIndex:600; }","duration":"926.801191ms","start":"2024-02-14T04:21:29.516504Z","end":"2024-02-14T04:21:30.443306Z","steps":["trace[1249764214] 'read index received' (duration: 623.238461ms)","trace[1249764214] 'applied index is now lower than readState.Index' (duration: 303.560624ms)"],"step_count":2}
{"level":"warn","ts":"2024-02-14T04:21:30.443509Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"927.015963ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" ","response":"range_response_count:1 size:4154"}
{"level":"info","ts":"2024-02-14T04:21:30.443571Z","caller":"traceutil/trace.go:171","msg":"trace[1615742973] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675; range_end:; response_count:1; response_revision:562; }","duration":"927.092324ms","start":"2024-02-14T04:21:29.516471Z","end":"2024-02-14T04:21:30.443563Z","steps":["trace[1615742973] 'agreement among raft nodes before linearized reading' (duration: 926.983126ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T04:21:30.443648Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T04:21:29.516453Z","time spent":"927.183183ms","remote":"127.0.0.1:46774","response type":"/etcdserverpb.KV/Range","request count":0,"request size":72,"response count":1,"response size":4177,"request content":"key:\"/registry/pods/kube-system/kube-scheduler-default-k8s-diff-port-224675\" "}
{"level":"warn","ts":"2024-02-14T04:21:30.443694Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"178.933713ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-02-14T04:21:30.443769Z","caller":"traceutil/trace.go:171","msg":"trace[1629340585] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:562; }","duration":"179.015453ms","start":"2024-02-14T04:21:30.264743Z","end":"2024-02-14T04:21:30.443759Z","steps":["trace[1629340585] 'agreement among raft nodes before linearized reading' (duration: 178.909369ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T04:31:13.241723Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":806}
{"level":"info","ts":"2024-02-14T04:31:13.24508Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":806,"took":"2.764583ms","hash":1520445850}
{"level":"info","ts":"2024-02-14T04:31:13.245179Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1520445850,"revision":806,"compact-revision":-1}
{"level":"info","ts":"2024-02-14T04:36:13.249784Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1048}
{"level":"info","ts":"2024-02-14T04:36:13.252114Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1048,"took":"1.380423ms","hash":2917473244}
{"level":"info","ts":"2024-02-14T04:36:13.25227Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2917473244,"revision":1048,"compact-revision":806}
{"level":"info","ts":"2024-02-14T04:40:23.66688Z","caller":"traceutil/trace.go:171","msg":"trace[1794726536] transaction","detail":"{read_only:false; response_revision:1494; number_of_response:1; }","duration":"156.977314ms","start":"2024-02-14T04:40:23.509855Z","end":"2024-02-14T04:40:23.666832Z","steps":["trace[1794726536] 'process raft request' (duration: 156.800547ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T04:41:13.259536Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1291}
{"level":"info","ts":"2024-02-14T04:41:13.261726Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1291,"took":"1.704356ms","hash":2706378822}
{"level":"info","ts":"2024-02-14T04:41:13.261835Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2706378822,"revision":1291,"compact-revision":1048}
{"level":"warn","ts":"2024-02-14T04:41:32.744536Z","caller":"etcdserver/v3_server.go:897","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8200647714936403785,"retry-timeout":"500ms"}
{"level":"info","ts":"2024-02-14T04:41:32.778866Z","caller":"traceutil/trace.go:171","msg":"trace[1703470425] linearizableReadLoop","detail":"{readStateIndex:1839; appliedIndex:1838; }","duration":"534.328841ms","start":"2024-02-14T04:41:32.244497Z","end":"2024-02-14T04:41:32.778826Z","steps":["trace[1703470425] 'read index received' (duration: 534.1656ms)","trace[1703470425] 'applied index is now lower than readState.Index' (duration: 162.722µs)"],"step_count":2}
{"level":"warn","ts":"2024-02-14T04:41:32.779284Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"534.621054ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kubernetes-dashboard/\" range_end:\"/registry/pods/kubernetes-dashboard0\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-02-14T04:41:32.779374Z","caller":"traceutil/trace.go:171","msg":"trace[716082671] range","detail":"{range_begin:/registry/pods/kubernetes-dashboard/; range_end:/registry/pods/kubernetes-dashboard0; response_count:0; response_revision:1551; }","duration":"534.889264ms","start":"2024-02-14T04:41:32.244465Z","end":"2024-02-14T04:41:32.779355Z","steps":["trace[716082671] 'agreement among raft nodes before linearized reading' (duration: 534.536894ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T04:41:32.779425Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T04:41:32.244446Z","time spent":"534.960344ms","remote":"127.0.0.1:46774","response type":"/etcdserverpb.KV/Range","request count":0,"request size":76,"response count":0,"response size":28,"request content":"key:\"/registry/pods/kubernetes-dashboard/\" range_end:\"/registry/pods/kubernetes-dashboard0\" "}
{"level":"info","ts":"2024-02-14T04:41:32.779632Z","caller":"traceutil/trace.go:171","msg":"trace[1001514122] transaction","detail":"{read_only:false; response_revision:1551; number_of_response:1; }","duration":"726.140139ms","start":"2024-02-14T04:41:32.053482Z","end":"2024-02-14T04:41:32.779622Z","steps":["trace[1001514122] 'process raft request' (duration: 725.227259ms)"],"step_count":1}
{"level":"warn","ts":"2024-02-14T04:41:32.77983Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-02-14T04:41:32.05339Z","time spent":"726.302405ms","remote":"127.0.0.1:46770","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1113,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:1549 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1040 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}
==> kernel <==
04:42:03 up 21 min, 0 users, load average: 0.27, 0.23, 0.18
Linux default-k8s-diff-port-224675 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] <==
I0214 04:39:15.969518 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:39:15.970765 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:39:15.970940 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:39:15.971050 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:40:14.779657 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I0214 04:41:14.779955 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:41:14.972548 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:41:14.972682 1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:41:14.973182 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:41:15.973616 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:41:15.973666 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:41:15.973674 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:41:15.973706 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:41:15.973744 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:41:15.974948 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:41:32.780531 1 trace.go:236] Trace[78105713]: "Update" accept:application/json, */*,audit-id:af78b332-1630-4c49-a174-ebfd6b42a464,client:192.168.61.188,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (14-Feb-2024 04:41:32.050) (total time: 729ms):
Trace[78105713]: ["GuaranteedUpdate etcd3" audit-id:af78b332-1630-4c49-a174-ebfd6b42a464,key:/services/endpoints/kube-system/k8s.io-minikube-hostpath,type:*core.Endpoints,resource:endpoints 728ms (04:41:32.051)
Trace[78105713]: ---"Txn call completed" 727ms (04:41:32.780)]
Trace[78105713]: [729.638339ms] [729.638339ms] END
I0214 04:41:32.780736 1 trace.go:236] Trace[567095902]: "List" accept:application/json, */*,audit-id:cbf3ad70-f7d0-4cba-8661-a1a1a33b426b,client:192.168.61.1,protocol:HTTP/2.0,resource:pods,scope:namespace,url:/api/v1/namespaces/kubernetes-dashboard/pods,user-agent:e2e-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (14-Feb-2024 04:41:32.243) (total time: 536ms):
Trace[567095902]: ["List(recursive=true) etcd3" audit-id:cbf3ad70-f7d0-4cba-8661-a1a1a33b426b,key:/pods/kubernetes-dashboard,resourceVersion:,resourceVersionMatch:,limit:0,continue: 536ms (04:41:32.243)]
Trace[567095902]: [536.966877ms] [536.966877ms] END
==> kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] <==
I0214 04:36:28.520779 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:36:57.962841 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:36:58.529731 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:37:27.969770 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:37:28.542930 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
I0214 04:37:37.652883 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="345.535µs"
I0214 04:37:48.656589 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="194.71µs"
E0214 04:37:57.975043 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:37:58.550981 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:38:27.981892 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:38:28.559653 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:38:57.987684 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:38:58.572484 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:39:27.995483 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:39:28.581511 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:39:58.001034 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:39:58.592503 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:40:28.008059 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:40:28.606031 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:40:58.013120 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:40:58.615419 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:41:28.022439 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:41:28.626734 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:41:58.027659 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:41:58.642568 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
==> kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] <==
I0214 04:21:16.914794 1 server_others.go:69] "Using iptables proxy"
I0214 04:21:16.944463 1 node.go:141] Successfully retrieved node IP: 192.168.61.188
I0214 04:21:17.102932 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 04:21:17.102987 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:21:17.107037 1 server_others.go:152] "Using iptables Proxier"
I0214 04:21:17.107319 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:21:17.107744 1 server.go:846] "Version info" version="v1.28.4"
I0214 04:21:17.108371 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:21:17.111668 1 config.go:188] "Starting service config controller"
I0214 04:21:17.111944 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:21:17.112093 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:21:17.112362 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:21:17.114966 1 config.go:315] "Starting node config controller"
I0214 04:21:17.115001 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:21:17.212670 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 04:21:17.212798 1 shared_informer.go:318] Caches are synced for service config
I0214 04:21:17.215067 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] <==
I0214 04:21:12.569509 1 serving.go:348] Generated self-signed cert in-memory
W0214 04:21:14.922317 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0214 04:21:14.922560 1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0214 04:21:14.922670 1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
W0214 04:21:14.922697 1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0214 04:21:14.963310 1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"
I0214 04:21:14.963463 1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:21:14.968179 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0214 04:21:14.968295 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0214 04:21:14.970055 1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
I0214 04:21:14.970161 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0214 04:21:15.069437 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:20:50 UTC, ends at Wed 2024-02-14 04:42:03 UTC. --
Feb 14 04:39:08 default-k8s-diff-port-224675 kubelet[957]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:39:08 default-k8s-diff-port-224675 kubelet[957]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:39:10 default-k8s-diff-port-224675 kubelet[957]: E0214 04:39:10.634861 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:39:23 default-k8s-diff-port-224675 kubelet[957]: E0214 04:39:23.633676 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:39:35 default-k8s-diff-port-224675 kubelet[957]: E0214 04:39:35.634520 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:39:49 default-k8s-diff-port-224675 kubelet[957]: E0214 04:39:49.633918 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:40:00 default-k8s-diff-port-224675 kubelet[957]: E0214 04:40:00.634016 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:40:08 default-k8s-diff-port-224675 kubelet[957]: E0214 04:40:08.661638 957 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:40:08 default-k8s-diff-port-224675 kubelet[957]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:40:08 default-k8s-diff-port-224675 kubelet[957]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:40:08 default-k8s-diff-port-224675 kubelet[957]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:40:14 default-k8s-diff-port-224675 kubelet[957]: E0214 04:40:14.634605 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:40:29 default-k8s-diff-port-224675 kubelet[957]: E0214 04:40:29.634766 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:40:40 default-k8s-diff-port-224675 kubelet[957]: E0214 04:40:40.633654 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:40:52 default-k8s-diff-port-224675 kubelet[957]: E0214 04:40:52.634500 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:41:07 default-k8s-diff-port-224675 kubelet[957]: E0214 04:41:07.634045 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:41:08 default-k8s-diff-port-224675 kubelet[957]: E0214 04:41:08.650315 957 container_manager_linux.go:514] "Failed to find cgroups of kubelet" err="cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service"
Feb 14 04:41:08 default-k8s-diff-port-224675 kubelet[957]: E0214 04:41:08.664846 957 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:41:08 default-k8s-diff-port-224675 kubelet[957]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:41:08 default-k8s-diff-port-224675 kubelet[957]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:41:08 default-k8s-diff-port-224675 kubelet[957]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:41:22 default-k8s-diff-port-224675 kubelet[957]: E0214 04:41:22.633888 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:41:36 default-k8s-diff-port-224675 kubelet[957]: E0214 04:41:36.633946 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:41:47 default-k8s-diff-port-224675 kubelet[957]: E0214 04:41:47.633355 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
Feb 14 04:41:58 default-k8s-diff-port-224675 kubelet[957]: E0214 04:41:58.635004 957 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-8bqch" podUID="95e64837-e855-49a4-adda-14b8dc40ec42"
==> storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] <==
I0214 04:21:16.974697 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0214 04:21:46.978939 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] <==
I0214 04:21:48.032583 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 04:21:48.049897 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 04:21:48.050034 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 04:22:05.453900 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 04:22:05.454385 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"48c46afb-1e5a-4580-8ece-4394793c40de", APIVersion:"v1", ResourceVersion:"589", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' default-k8s-diff-port-224675_d6befcf5-7647-499a-b7a1-9cc07fba0125 became leader
I0214 04:22:05.454461 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-224675_d6befcf5-7647-499a-b7a1-9cc07fba0125!
I0214 04:22:05.555524 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_default-k8s-diff-port-224675_d6befcf5-7647-499a-b7a1-9cc07fba0125!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
helpers_test.go:261: (dbg) Run: kubectl --context default-k8s-diff-port-224675 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-57f55c9bc5-8bqch
helpers_test.go:274: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context default-k8s-diff-port-224675 describe pod metrics-server-57f55c9bc5-8bqch
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-224675 describe pod metrics-server-57f55c9bc5-8bqch: exit status 1 (60.642005ms)
** stderr **
Error from server (NotFound): pods "metrics-server-57f55c9bc5-8bqch" not found
** /stderr **
helpers_test.go:279: kubectl --context default-k8s-diff-port-224675 describe pod metrics-server-57f55c9bc5-8bqch: exit status 1
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (437.57s)
=== RUN TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
E0214 04:34:58.298707 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 04:35:05.113612 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
start_stop_delete_test.go:287: ***** TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:287: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-722906 -n embed-certs-722906
start_stop_delete_test.go:287: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: showing logs for failed pods as of 2024-02-14 04:41:29.940985915 +0000 UTC m=+6806.905603519
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
start_stop_delete_test.go:291: (dbg) Run: kubectl --context embed-certs-722906 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-722906 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: context deadline exceeded (1.725µs)
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-722906 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": context deadline exceeded
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906
helpers_test.go:244: <<< TestStartStop/group/embed-certs/serial/AddonExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/embed-certs/serial/AddonExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p embed-certs-722906 logs -n 25
E0214 04:41:31.957272 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p embed-certs-722906 logs -n 25: (1.805039658s)
helpers_test.go:252: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| delete | -p | disable-driver-mounts-648156 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | disable-driver-mounts-648156 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:13 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable metrics-server -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | default-k8s-diff-port-224675 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable dashboard -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:26 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable dashboard -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| delete | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:39 UTC | 14 Feb 24 04:39 UTC |
| start | -p newest-cni-050621 --memory=2200 --alsologtostderr | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:39 UTC | 14 Feb 24 04:40 UTC |
| | --wait=apiserver,system_pods,default_sa | | | | | |
| | --feature-gates ServerSideApply=true | | | | | |
| | --network-plugin=cni | | | | | |
| | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 | | | | | |
| | --driver=kvm2 --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| delete | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:40 UTC | 14 Feb 24 04:40 UTC |
| addons | enable metrics-server -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:40 UTC | 14 Feb 24 04:40 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:40 UTC | 14 Feb 24 04:41 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p newest-cni-050621 | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | 14 Feb 24 04:41 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p newest-cni-050621 --memory=2200 --alsologtostderr | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:41 UTC | |
| | --wait=apiserver,system_pods,default_sa | | | | | |
| | --feature-gates ServerSideApply=true | | | | | |
| | --network-plugin=cni | | | | | |
| | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 | | | | | |
| | --driver=kvm2 --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:41:04
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:41:04.098372 1554519 out.go:291] Setting OutFile to fd 1 ...
I0214 04:41:04.098629 1554519 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:41:04.098638 1554519 out.go:304] Setting ErrFile to fd 2...
I0214 04:41:04.098642 1554519 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:41:04.098811 1554519 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:41:04.099360 1554519 out.go:298] Setting JSON to false
I0214 04:41:04.100354 1554519 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":26611,"bootTime":1707859053,"procs":194,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:41:04.100413 1554519 start.go:138] virtualization: kvm guest
I0214 04:41:04.102615 1554519 out.go:177] * [newest-cni-050621] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:41:04.104114 1554519 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:41:04.105356 1554519 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:41:04.104143 1554519 notify.go:220] Checking for updates...
I0214 04:41:04.106718 1554519 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:41:04.108026 1554519 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:41:04.109336 1554519 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:41:04.110626 1554519 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:41:04.112363 1554519 config.go:182] Loaded profile config "newest-cni-050621": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:41:04.112783 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:04.112858 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:04.128497 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45561
I0214 04:41:04.128985 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:04.129564 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:04.129588 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:04.129930 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:04.130120 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:04.130353 1554519 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:41:04.130646 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:04.130685 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:04.144332 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39197
I0214 04:41:04.144751 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:04.145214 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:04.145235 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:04.145554 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:04.145744 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:04.179463 1554519 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:41:04.180907 1554519 start.go:296] selected driver: kvm2
I0214 04:41:04.180920 1554519 start.go:900] validating driver "kvm2" against &{Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods
:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:41:04.181371 1554519 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:41:04.182667 1554519 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:41:04.183071 1554519 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:41:04.198210 1554519 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:41:04.198573 1554519 start_flags.go:962] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I0214 04:41:04.198633 1554519 cni.go:84] Creating CNI manager for ""
I0214 04:41:04.198648 1554519 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:41:04.198707 1554519 start.go:339] cluster config:
{Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIS
erverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress
: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:41:04.198819 1554519 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:41:04.201531 1554519 out.go:177] * Starting "newest-cni-050621" primary control-plane node in "newest-cni-050621" cluster
I0214 04:41:04.202754 1554519 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:41:04.202789 1554519 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4
I0214 04:41:04.202796 1554519 cache.go:56] Caching tarball of preloaded images
I0214 04:41:04.202891 1554519 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:41:04.202902 1554519 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on crio
I0214 04:41:04.203025 1554519 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/config.json ...
I0214 04:41:04.203267 1554519 start.go:360] acquireMachinesLock for newest-cni-050621: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:41:04.203325 1554519 start.go:364] duration metric: took 31.498µs to acquireMachinesLock for "newest-cni-050621"
I0214 04:41:04.203345 1554519 start.go:96] Skipping create...Using existing machine configuration
I0214 04:41:04.203351 1554519 fix.go:54] fixHost starting:
I0214 04:41:04.203605 1554519 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:41:04.203646 1554519 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:41:04.217027 1554519 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46645
I0214 04:41:04.217469 1554519 main.go:141] libmachine: () Calling .GetVersion
I0214 04:41:04.217904 1554519 main.go:141] libmachine: Using API Version 1
I0214 04:41:04.217925 1554519 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:41:04.218260 1554519 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:41:04.218471 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:04.218648 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetState
I0214 04:41:04.220106 1554519 fix.go:112] recreateIfNeeded on newest-cni-050621: state=Stopped err=<nil>
I0214 04:41:04.220127 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
W0214 04:41:04.220286 1554519 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:41:04.222084 1554519 out.go:177] * Restarting existing kvm2 VM for "newest-cni-050621" ...
I0214 04:41:04.223251 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .Start
I0214 04:41:04.223438 1554519 main.go:141] libmachine: (newest-cni-050621) Ensuring networks are active...
I0214 04:41:04.224151 1554519 main.go:141] libmachine: (newest-cni-050621) Ensuring network default is active
I0214 04:41:04.224504 1554519 main.go:141] libmachine: (newest-cni-050621) Ensuring network mk-newest-cni-050621 is active
I0214 04:41:04.224868 1554519 main.go:141] libmachine: (newest-cni-050621) Getting domain xml...
I0214 04:41:04.225554 1554519 main.go:141] libmachine: (newest-cni-050621) Creating domain...
I0214 04:41:05.444810 1554519 main.go:141] libmachine: (newest-cni-050621) Waiting to get IP...
I0214 04:41:05.445812 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:05.446311 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:05.446417 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:05.446263 1554565 retry.go:31] will retry after 274.164851ms: waiting for machine to come up
I0214 04:41:05.721915 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:05.722461 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:05.722489 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:05.722418 1554565 retry.go:31] will retry after 234.835429ms: waiting for machine to come up
I0214 04:41:05.959142 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:05.959651 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:05.959683 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:05.959610 1554565 retry.go:31] will retry after 456.61086ms: waiting for machine to come up
I0214 04:41:06.418254 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:06.418795 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:06.418831 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:06.418766 1554565 retry.go:31] will retry after 502.651405ms: waiting for machine to come up
I0214 04:41:06.923421 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:06.923955 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:06.923979 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:06.923907 1554565 retry.go:31] will retry after 729.605217ms: waiting for machine to come up
I0214 04:41:07.655092 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:07.655617 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:07.655649 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:07.655544 1554565 retry.go:31] will retry after 878.805127ms: waiting for machine to come up
I0214 04:41:08.535568 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:08.536032 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:08.536058 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:08.535973 1554565 retry.go:31] will retry after 1.0568123s: waiting for machine to come up
I0214 04:41:09.594852 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:09.595222 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:09.595253 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:09.595165 1554565 retry.go:31] will retry after 1.15725394s: waiting for machine to come up
I0214 04:41:10.754512 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:10.754984 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:10.755012 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:10.754941 1554565 retry.go:31] will retry after 1.517605887s: waiting for machine to come up
I0214 04:41:12.274645 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:12.275079 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:12.275108 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:12.275041 1554565 retry.go:31] will retry after 2.095258553s: waiting for machine to come up
I0214 04:41:14.371455 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:14.371913 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:14.371976 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:14.371848 1554565 retry.go:31] will retry after 2.292762691s: waiting for machine to come up
I0214 04:41:16.666488 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:16.666969 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:16.667002 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:16.666910 1554565 retry.go:31] will retry after 2.610696918s: waiting for machine to come up
I0214 04:41:19.279565 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:19.279964 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:41:19.279994 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:41:19.279905 1554565 retry.go:31] will retry after 4.432494629s: waiting for machine to come up
I0214 04:41:23.716017 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.716519 1554519 main.go:141] libmachine: (newest-cni-050621) Found IP for machine: 192.168.72.60
I0214 04:41:23.716553 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has current primary IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.716564 1554519 main.go:141] libmachine: (newest-cni-050621) Reserving static IP address...
I0214 04:41:23.717051 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "newest-cni-050621", mac: "52:54:00:e6:10:2e", ip: "192.168.72.60"} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.717083 1554519 main.go:141] libmachine: (newest-cni-050621) Reserved static IP address: 192.168.72.60
I0214 04:41:23.717103 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | skip adding static IP to network mk-newest-cni-050621 - found existing host DHCP lease matching {name: "newest-cni-050621", mac: "52:54:00:e6:10:2e", ip: "192.168.72.60"}
I0214 04:41:23.717120 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Getting to WaitForSSH function...
I0214 04:41:23.717132 1554519 main.go:141] libmachine: (newest-cni-050621) Waiting for SSH to be available...
I0214 04:41:23.719435 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.719831 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.719866 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.719982 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Using SSH client type: external
I0214 04:41:23.720016 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa (-rw-------)
I0214 04:41:23.720055 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.60 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:41:23.720069 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | About to run SSH command:
I0214 04:41:23.720083 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | exit 0
I0214 04:41:23.804663 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | SSH cmd err, output: <nil>:
I0214 04:41:23.805020 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetConfigRaw
I0214 04:41:23.805683 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:41:23.808293 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.808776 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.808807 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.809024 1554519 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/config.json ...
I0214 04:41:23.809306 1554519 machine.go:94] provisionDockerMachine start ...
I0214 04:41:23.809331 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:23.809547 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:23.811897 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.812279 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.812309 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.812433 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:23.812615 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:23.812751 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:23.812894 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:23.813032 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:23.813408 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:23.813423 1554519 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:41:23.921565 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:41:23.921601 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:41:23.921891 1554519 buildroot.go:166] provisioning hostname "newest-cni-050621"
I0214 04:41:23.921921 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:41:23.922126 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:23.924819 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.925291 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:23.925332 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:23.925496 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:23.925689 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:23.925855 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:23.926008 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:23.926185 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:23.926671 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:23.926693 1554519 main.go:141] libmachine: About to run SSH command:
sudo hostname newest-cni-050621 && echo "newest-cni-050621" | sudo tee /etc/hostname
I0214 04:41:24.051649 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>: newest-cni-050621
I0214 04:41:24.051697 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.054839 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.055266 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.055289 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.055518 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.055728 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.055902 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.056040 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.056279 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:24.056624 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:24.056642 1554519 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-050621' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-050621/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-050621' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:41:24.173210 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:41:24.173246 1554519 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:41:24.173297 1554519 buildroot.go:174] setting up certificates
I0214 04:41:24.173306 1554519 provision.go:84] configureAuth start
I0214 04:41:24.173316 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:41:24.173600 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:41:24.176263 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.176672 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.176702 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.176853 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.179276 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.179646 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.179678 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.179776 1554519 provision.go:143] copyHostCerts
I0214 04:41:24.179841 1554519 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:41:24.179851 1554519 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:41:24.179916 1554519 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:41:24.180033 1554519 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:41:24.180044 1554519 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:41:24.180078 1554519 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:41:24.180173 1554519 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:41:24.180185 1554519 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:41:24.180220 1554519 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:41:24.180302 1554519 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.newest-cni-050621 san=[127.0.0.1 192.168.72.60 localhost minikube newest-cni-050621]
I0214 04:41:24.330977 1554519 provision.go:177] copyRemoteCerts
I0214 04:41:24.331045 1554519 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:41:24.331070 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.333716 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.334092 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.334124 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.334323 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.334533 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.334699 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.334849 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:24.417890 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0214 04:41:24.442438 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:41:24.464948 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:41:24.486797 1554519 provision.go:87] duration metric: took 313.477889ms to configureAuth
I0214 04:41:24.486825 1554519 buildroot.go:189] setting minikube options for container-runtime
I0214 04:41:24.487034 1554519 config.go:182] Loaded profile config "newest-cni-050621": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:41:24.487161 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.490089 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.490469 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.490499 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.490730 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.490946 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.491095 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.491249 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.491480 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:24.491799 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:24.491816 1554519 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:41:24.805327 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:41:24.805366 1554519 machine.go:97] duration metric: took 996.04399ms to provisionDockerMachine
I0214 04:41:24.805381 1554519 start.go:293] postStartSetup for "newest-cni-050621" (driver="kvm2")
I0214 04:41:24.805401 1554519 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:41:24.805430 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:24.805823 1554519 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:41:24.805860 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.808612 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.809000 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.809032 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.809203 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.809449 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.809631 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.809779 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:24.894785 1554519 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:41:24.898794 1554519 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:41:24.898822 1554519 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:41:24.898946 1554519 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:41:24.899023 1554519 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:41:24.899109 1554519 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:41:24.907239 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:41:24.932045 1554519 start.go:296] duration metric: took 126.650274ms for postStartSetup
I0214 04:41:24.932078 1554519 fix.go:56] duration metric: took 20.728727825s for fixHost
I0214 04:41:24.932103 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:24.934922 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.935362 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:24.935398 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:24.935600 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:24.935806 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.935979 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:24.936119 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:24.936303 1554519 main.go:141] libmachine: Using SSH client type: native
I0214 04:41:24.936635 1554519 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:41:24.936647 1554519 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:41:25.045719 1554519 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707885684.995868752
I0214 04:41:25.045745 1554519 fix.go:216] guest clock: 1707885684.995868752
I0214 04:41:25.045755 1554519 fix.go:229] Guest: 2024-02-14 04:41:24.995868752 +0000 UTC Remote: 2024-02-14 04:41:24.932082117 +0000 UTC m=+20.882921273 (delta=63.786635ms)
I0214 04:41:25.045779 1554519 fix.go:200] guest clock delta is within tolerance: 63.786635ms
I0214 04:41:25.045787 1554519 start.go:83] releasing machines lock for "newest-cni-050621", held for 20.842449438s
I0214 04:41:25.045815 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:25.046080 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:41:25.048676 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.049069 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:25.049119 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.049306 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:25.049755 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:25.049943 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:41:25.050034 1554519 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:41:25.050094 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:25.050172 1554519 ssh_runner.go:195] Run: cat /version.json
I0214 04:41:25.050200 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:41:25.053170 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.053358 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.053529 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:25.053561 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.053689 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:25.053826 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:25.053849 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:25.053882 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:25.053979 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:41:25.054066 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:25.054144 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:41:25.054240 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:25.054334 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:41:25.054473 1554519 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:41:25.156305 1554519 ssh_runner.go:195] Run: systemctl --version
I0214 04:41:25.162012 1554519 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:41:25.307172 1554519 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:41:25.313108 1554519 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:41:25.313168 1554519 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:41:25.328857 1554519 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:41:25.328875 1554519 start.go:494] detecting cgroup driver to use...
I0214 04:41:25.328943 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:41:25.346327 1554519 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:41:25.361040 1554519 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:41:25.361102 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:41:25.376029 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:41:25.390979 1554519 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:41:25.492540 1554519 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:41:25.607973 1554519 docker.go:233] disabling docker service ...
I0214 04:41:25.608076 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:41:25.624727 1554519 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:41:25.636350 1554519 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:41:25.742743 1554519 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:41:25.843447 1554519 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:41:25.856268 1554519 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:41:25.873703 1554519 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:41:25.873762 1554519 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:41:25.883342 1554519 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:41:25.883394 1554519 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:41:25.892956 1554519 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:41:25.902310 1554519 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:41:25.912714 1554519 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:41:25.923682 1554519 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:41:25.932589 1554519 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:41:25.932658 1554519 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:41:25.945020 1554519 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:41:25.953752 1554519 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:41:26.061967 1554519 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:41:26.242743 1554519 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:41:26.242828 1554519 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:41:26.251327 1554519 start.go:562] Will wait 60s for crictl version
I0214 04:41:26.251389 1554519 ssh_runner.go:195] Run: which crictl
I0214 04:41:26.255211 1554519 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:41:26.293048 1554519 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:41:26.293121 1554519 ssh_runner.go:195] Run: crio --version
I0214 04:41:26.332736 1554519 ssh_runner.go:195] Run: crio --version
I0214 04:41:26.386484 1554519 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on CRI-O 1.24.1 ...
I0214 04:41:26.387941 1554519 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:41:26.390787 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:26.391190 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:41:16 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:41:26.391215 1554519 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:41:26.391419 1554519 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:41:26.395675 1554519 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:41:26.409829 1554519 out.go:177] - kubeadm.pod-network-cidr=10.42.0.0/16
I0214 04:41:26.410949 1554519 kubeadm.go:877] updating cluster {Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHos
tTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:41:26.411089 1554519 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:41:26.411179 1554519 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:41:26.455709 1554519 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.29.0-rc.2". assuming images are not preloaded.
I0214 04:41:26.455781 1554519 ssh_runner.go:195] Run: which lz4
I0214 04:41:26.459922 1554519 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:41:26.464372 1554519 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:41:26.464406 1554519 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (401853962 bytes)
I0214 04:41:28.074081 1554519 crio.go:444] duration metric: took 1.614196224s to copy over tarball
I0214 04:41:28.074164 1554519 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:20:30 UTC, ends at Wed 2024-02-14 04:41:30 UTC. --
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.724787994Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885690724765924,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=eefacf76-a1ab-48d6-912a-75a1b4e0a4bd name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.727751947Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=5393ba57-7929-43ba-9820-0917a6ea43a7 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.727844828Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=5393ba57-7929-43ba-9820-0917a6ea43a7 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.728633193Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2,PodSandboxId:399ed54004aeead89c09a00b22eb8866e6c441a46a6f60954af60ec8bb8867fe,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884750938784831,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 91a5aa8f-0a2e-4bf3-995f-24013154be0f,},Annotations:map[string]string{io.kubernetes.container.hash: 842ab4e7,io.kubernetes.container.restartCount: 0,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4,PodSandboxId:a655ac5930f6682eb53130dfa58c97527ee9089cdce2842f9863bf5dd5302f42,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884750795178420,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tzpr9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4251f9f9-12fc-4189-8bb2-2570aa4b4109,},Annotations:map[string]string{io.kubernetes.container.hash: 67c1ccd6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessag
ePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0,PodSandboxId:18a890b28165e78fe539998cd7819b7b395fcb67fbb14964ace2aac61c089416,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749980537510,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-kh9dr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 426598eb-a63c-4572-ac6a-d912bfee04d1,},Annotations:map[string]string{io.kubernetes.container.hash: 83c3a98e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-
tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff,PodSandboxId:3e893b5990020e41c1dc7201e2626e85325c3a6ee48d0c0a13b6a2b466c953e2,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749406792627,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-62wp6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6b69aa94-f092-4150-
81a8-7e8cdfdfd8e0,},Annotations:map[string]string{io.kubernetes.container.hash: 2db85508,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5,PodSandboxId:01ce811744dcd0debf64c88ff0f1786213fcea7e63594eec9bc0973512b608f0,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:17078847271
66411811,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c0407601f78837f837672474ea583b9f,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae,PodSandboxId:96fca915be3ebc647ac55f4fdcdc0a5532e343d0a64675c8070e60ac902be239,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884727031523466,Labels:map[string]str
ing{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: be6b5fbcbe63546b7efc20f181b9b68f,},Annotations:map[string]string{io.kubernetes.container.hash: bc67f715,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7,PodSandboxId:ee92d020059d5af8af986d66d3232cd3a8348ff68054155f9e16dea31ac55a38,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884726803884664,Labels:map[string]string{io.kuber
netes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224b77a740d55a2900d2e7dffbb562cf,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e,PodSandboxId:a610329aa84eb6a2ea9c178149b22c3b6a3d674416dcfa7be09831325eb2049f,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884726696981254,Labels:map[string]string{
io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a8d2c0cdb4658917c261ee1a915a360,},Annotations:map[string]string{io.kubernetes.container.hash: d7a8df02,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=5393ba57-7929-43ba-9820-0917a6ea43a7 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.782646478Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=7b7b90c1-72ea-44bd-8b69-48b884a1f82f name=/runtime.v1.RuntimeService/Version
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.782798648Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=7b7b90c1-72ea-44bd-8b69-48b884a1f82f name=/runtime.v1.RuntimeService/Version
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.784436153Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=d719d5b9-54cb-402c-bab0-029c15f9cd1c name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.784930300Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885690784916418,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=d719d5b9-54cb-402c-bab0-029c15f9cd1c name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.785864334Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=cff5b533-84a3-4c6e-aeac-c99cb62e2fce name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.785910665Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=cff5b533-84a3-4c6e-aeac-c99cb62e2fce name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.786099550Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2,PodSandboxId:399ed54004aeead89c09a00b22eb8866e6c441a46a6f60954af60ec8bb8867fe,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884750938784831,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 91a5aa8f-0a2e-4bf3-995f-24013154be0f,},Annotations:map[string]string{io.kubernetes.container.hash: 842ab4e7,io.kubernetes.container.restartCount: 0,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4,PodSandboxId:a655ac5930f6682eb53130dfa58c97527ee9089cdce2842f9863bf5dd5302f42,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884750795178420,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tzpr9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4251f9f9-12fc-4189-8bb2-2570aa4b4109,},Annotations:map[string]string{io.kubernetes.container.hash: 67c1ccd6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessag
ePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0,PodSandboxId:18a890b28165e78fe539998cd7819b7b395fcb67fbb14964ace2aac61c089416,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749980537510,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-kh9dr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 426598eb-a63c-4572-ac6a-d912bfee04d1,},Annotations:map[string]string{io.kubernetes.container.hash: 83c3a98e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-
tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff,PodSandboxId:3e893b5990020e41c1dc7201e2626e85325c3a6ee48d0c0a13b6a2b466c953e2,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749406792627,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-62wp6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6b69aa94-f092-4150-
81a8-7e8cdfdfd8e0,},Annotations:map[string]string{io.kubernetes.container.hash: 2db85508,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5,PodSandboxId:01ce811744dcd0debf64c88ff0f1786213fcea7e63594eec9bc0973512b608f0,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:17078847271
66411811,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c0407601f78837f837672474ea583b9f,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae,PodSandboxId:96fca915be3ebc647ac55f4fdcdc0a5532e343d0a64675c8070e60ac902be239,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884727031523466,Labels:map[string]str
ing{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: be6b5fbcbe63546b7efc20f181b9b68f,},Annotations:map[string]string{io.kubernetes.container.hash: bc67f715,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7,PodSandboxId:ee92d020059d5af8af986d66d3232cd3a8348ff68054155f9e16dea31ac55a38,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884726803884664,Labels:map[string]string{io.kuber
netes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224b77a740d55a2900d2e7dffbb562cf,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e,PodSandboxId:a610329aa84eb6a2ea9c178149b22c3b6a3d674416dcfa7be09831325eb2049f,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884726696981254,Labels:map[string]string{
io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a8d2c0cdb4658917c261ee1a915a360,},Annotations:map[string]string{io.kubernetes.container.hash: d7a8df02,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=cff5b533-84a3-4c6e-aeac-c99cb62e2fce name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.827055107Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=73b003fe-d453-4279-a67c-8b8164e93d8e name=/runtime.v1.RuntimeService/Version
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.827129353Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=73b003fe-d453-4279-a67c-8b8164e93d8e name=/runtime.v1.RuntimeService/Version
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.828617709Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=2d947f90-96c4-471d-8243-502d5500f9fc name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.829074418Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885690829058739,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=2d947f90-96c4-471d-8243-502d5500f9fc name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.829648098Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=4b8c5ce0-e5f3-4c0d-b1ed-a969c2f6ed21 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.829801770Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=4b8c5ce0-e5f3-4c0d-b1ed-a969c2f6ed21 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.830028727Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2,PodSandboxId:399ed54004aeead89c09a00b22eb8866e6c441a46a6f60954af60ec8bb8867fe,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884750938784831,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 91a5aa8f-0a2e-4bf3-995f-24013154be0f,},Annotations:map[string]string{io.kubernetes.container.hash: 842ab4e7,io.kubernetes.container.restartCount: 0,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4,PodSandboxId:a655ac5930f6682eb53130dfa58c97527ee9089cdce2842f9863bf5dd5302f42,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884750795178420,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tzpr9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4251f9f9-12fc-4189-8bb2-2570aa4b4109,},Annotations:map[string]string{io.kubernetes.container.hash: 67c1ccd6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessag
ePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0,PodSandboxId:18a890b28165e78fe539998cd7819b7b395fcb67fbb14964ace2aac61c089416,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749980537510,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-kh9dr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 426598eb-a63c-4572-ac6a-d912bfee04d1,},Annotations:map[string]string{io.kubernetes.container.hash: 83c3a98e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-
tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff,PodSandboxId:3e893b5990020e41c1dc7201e2626e85325c3a6ee48d0c0a13b6a2b466c953e2,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749406792627,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-62wp6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6b69aa94-f092-4150-
81a8-7e8cdfdfd8e0,},Annotations:map[string]string{io.kubernetes.container.hash: 2db85508,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5,PodSandboxId:01ce811744dcd0debf64c88ff0f1786213fcea7e63594eec9bc0973512b608f0,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:17078847271
66411811,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c0407601f78837f837672474ea583b9f,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae,PodSandboxId:96fca915be3ebc647ac55f4fdcdc0a5532e343d0a64675c8070e60ac902be239,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884727031523466,Labels:map[string]str
ing{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: be6b5fbcbe63546b7efc20f181b9b68f,},Annotations:map[string]string{io.kubernetes.container.hash: bc67f715,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7,PodSandboxId:ee92d020059d5af8af986d66d3232cd3a8348ff68054155f9e16dea31ac55a38,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884726803884664,Labels:map[string]string{io.kuber
netes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224b77a740d55a2900d2e7dffbb562cf,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e,PodSandboxId:a610329aa84eb6a2ea9c178149b22c3b6a3d674416dcfa7be09831325eb2049f,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884726696981254,Labels:map[string]string{
io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a8d2c0cdb4658917c261ee1a915a360,},Annotations:map[string]string{io.kubernetes.container.hash: d7a8df02,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=4b8c5ce0-e5f3-4c0d-b1ed-a969c2f6ed21 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.871368045Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=615667ec-80c0-4007-84ce-241c2425027c name=/runtime.v1.RuntimeService/Version
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.871430484Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=615667ec-80c0-4007-84ce-241c2425027c name=/runtime.v1.RuntimeService/Version
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.873098718Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=1cbf3999-b87e-425b-80c9-d792679b7d8f name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.873489588Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885690873476314,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:125561,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=1cbf3999-b87e-425b-80c9-d792679b7d8f name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.874077735Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=aeae3759-d5eb-4eb4-8b01-bc59a1b2b279 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.874139195Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=aeae3759-d5eb-4eb4-8b01-bc59a1b2b279 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:41:30 embed-certs-722906 crio[739]: time="2024-02-14 04:41:30.874359686Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2,PodSandboxId:399ed54004aeead89c09a00b22eb8866e6c441a46a6f60954af60ec8bb8867fe,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884750938784831,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 91a5aa8f-0a2e-4bf3-995f-24013154be0f,},Annotations:map[string]string{io.kubernetes.container.hash: 842ab4e7,io.kubernetes.container.restartCount: 0,io.kub
ernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4,PodSandboxId:a655ac5930f6682eb53130dfa58c97527ee9089cdce2842f9863bf5dd5302f42,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e,State:CONTAINER_RUNNING,CreatedAt:1707884750795178420,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-tzpr9,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4251f9f9-12fc-4189-8bb2-2570aa4b4109,},Annotations:map[string]string{io.kubernetes.container.hash: 67c1ccd6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessag
ePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0,PodSandboxId:18a890b28165e78fe539998cd7819b7b395fcb67fbb14964ace2aac61c089416,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749980537510,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-kh9dr,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 426598eb-a63c-4572-ac6a-d912bfee04d1,},Annotations:map[string]string{io.kubernetes.container.hash: 83c3a98e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-
tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff,PodSandboxId:3e893b5990020e41c1dc7201e2626e85325c3a6ee48d0c0a13b6a2b466c953e2,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e,State:CONTAINER_RUNNING,CreatedAt:1707884749406792627,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5dd5756b68-62wp6,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 6b69aa94-f092-4150-
81a8-7e8cdfdfd8e0,},Annotations:map[string]string{io.kubernetes.container.hash: 2db85508,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5,PodSandboxId:01ce811744dcd0debf64c88ff0f1786213fcea7e63594eec9bc0973512b608f0,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba,State:CONTAINER_RUNNING,CreatedAt:17078847271
66411811,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c0407601f78837f837672474ea583b9f,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae,PodSandboxId:96fca915be3ebc647ac55f4fdcdc0a5532e343d0a64675c8070e60ac902be239,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15,State:CONTAINER_RUNNING,CreatedAt:1707884727031523466,Labels:map[string]str
ing{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: be6b5fbcbe63546b7efc20f181b9b68f,},Annotations:map[string]string{io.kubernetes.container.hash: bc67f715,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7,PodSandboxId:ee92d020059d5af8af986d66d3232cd3a8348ff68054155f9e16dea31ac55a38,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:2,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c,State:CONTAINER_RUNNING,CreatedAt:1707884726803884664,Labels:map[string]string{io.kuber
netes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 224b77a740d55a2900d2e7dffbb562cf,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e,PodSandboxId:a610329aa84eb6a2ea9c178149b22c3b6a3d674416dcfa7be09831325eb2049f,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:2,},Image:&ImageSpec{Image:7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499,State:CONTAINER_RUNNING,CreatedAt:1707884726696981254,Labels:map[string]string{
io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-embed-certs-722906,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9a8d2c0cdb4658917c261ee1a915a360,},Annotations:map[string]string{io.kubernetes.container.hash: d7a8df02,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=aeae3759-d5eb-4eb4-8b01-bc59a1b2b279 name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
416652fe94935 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 15 minutes ago Running storage-provisioner 0 399ed54004aee storage-provisioner
dc38b5e773abf 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e 15 minutes ago Running kube-proxy 0 a655ac5930f66 kube-proxy-tzpr9
3ab2cb83dc155 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 15 minutes ago Running coredns 0 18a890b28165e coredns-5dd5756b68-kh9dr
674c44e33c068 ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc 15 minutes ago Running coredns 0 3e893b5990020 coredns-5dd5756b68-62wp6
7b8bf11381bce e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 16 minutes ago Running kube-scheduler 2 01ce811744dcd kube-scheduler-embed-certs-722906
d928e364c3628 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9 16 minutes ago Running etcd 2 96fca915be3eb etcd-embed-certs-722906
0bd903937bcd9 d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 16 minutes ago Running kube-controller-manager 2 ee92d020059d5 kube-controller-manager-embed-certs-722906
97c20a995e70a 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257 16 minutes ago Running kube-apiserver 2 a610329aa84eb kube-apiserver-embed-certs-722906
==> coredns [3ab2cb83dc15521a064ee9439efc8738d9bb55e7804bd86dfbf065a39d45cbc0] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
==> coredns [674c44e33c068f1f15cb452ae498b5d2bb6b1b3fede6306179f0494308a18aff] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.10.1
linux/amd64, go1.20, 055b2c3
==> describe nodes <==
Name: embed-certs-722906
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=embed-certs-722906
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=embed-certs-722906
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_25_34_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:25:31 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: embed-certs-722906
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 04:41:26 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:41:12 +0000 Wed, 14 Feb 2024 04:25:28 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:41:12 +0000 Wed, 14 Feb 2024 04:25:28 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:41:12 +0000 Wed, 14 Feb 2024 04:25:28 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:41:12 +0000 Wed, 14 Feb 2024 04:25:45 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.50.108
Hostname: embed-certs-722906
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: e20bf1c60aca4355bf54cc2398d9da4e
System UUID: e20bf1c6-0aca-4355-bf54-cc2398d9da4e
Boot ID: db9fd014-c4c3-46e8-b0b1-a23303bb6538
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.28.4
Kube-Proxy Version: v1.28.4
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-5dd5756b68-62wp6 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 15m
kube-system coredns-5dd5756b68-kh9dr 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 15m
kube-system etcd-embed-certs-722906 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kube-apiserver-embed-certs-722906 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kube-controller-manager-embed-certs-722906 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kube-proxy-tzpr9 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system kube-scheduler-embed-certs-722906 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system metrics-server-57f55c9bc5-hzsfq 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (9%!)(MISSING) 0 (0%!)(MISSING) 15m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 0 (0%!)(MISSING)
memory 440Mi (20%!)(MISSING) 340Mi (16%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 15m kube-proxy
Normal Starting 15m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 15m kubelet Node embed-certs-722906 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 15m kubelet Node embed-certs-722906 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 15m kubelet Node embed-certs-722906 status is now: NodeHasSufficientPID
Normal NodeNotReady 15m kubelet Node embed-certs-722906 status is now: NodeNotReady
Normal NodeAllocatableEnforced 15m kubelet Updated Node Allocatable limit across pods
Normal NodeReady 15m kubelet Node embed-certs-722906 status is now: NodeReady
Normal RegisteredNode 15m node-controller Node embed-certs-722906 event: Registered Node embed-certs-722906 in Controller
==> dmesg <==
[Feb14 04:20] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.075493] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.508254] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.500410] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.144345] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.538811] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +6.035394] systemd-fstab-generator[665]: Ignoring "noauto" for root device
[ +0.129285] systemd-fstab-generator[676]: Ignoring "noauto" for root device
[ +0.179341] systemd-fstab-generator[689]: Ignoring "noauto" for root device
[ +0.110945] systemd-fstab-generator[700]: Ignoring "noauto" for root device
[ +0.269143] systemd-fstab-generator[724]: Ignoring "noauto" for root device
[ +6.091692] systemd-fstab-generator[824]: Ignoring "noauto" for root device
[ +2.443539] systemd-fstab-generator[946]: Ignoring "noauto" for root device
[Feb14 04:21] kauditd_printk_skb: 29 callbacks suppressed
[Feb14 04:25] systemd-fstab-generator[3575]: Ignoring "noauto" for root device
[ +9.291565] systemd-fstab-generator[3902]: Ignoring "noauto" for root device
[ +12.514974] systemd-fstab-generator[4107]: Ignoring "noauto" for root device
[ +0.577674] kauditd_printk_skb: 2 callbacks suppressed
==> etcd [d928e364c362812516657fc2c859025168bc3d17015a1aaa756f65900590e9ae] <==
{"level":"info","ts":"2024-02-14T04:25:29.286997Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"d5ce96a8bfe0f5c1 became leader at term 2"}
{"level":"info","ts":"2024-02-14T04:25:29.287022Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: d5ce96a8bfe0f5c1 elected leader d5ce96a8bfe0f5c1 at term 2"}
{"level":"info","ts":"2024-02-14T04:25:29.28987Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:25:29.294824Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"d5ce96a8bfe0f5c1","local-member-attributes":"{Name:embed-certs-722906 ClientURLs:[https://192.168.50.108:2379]}","request-path":"/0/members/d5ce96a8bfe0f5c1/attributes","cluster-id":"38e677d7bff02ecf","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T04:25:29.295136Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"38e677d7bff02ecf","local-member-id":"d5ce96a8bfe0f5c1","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:25:29.295386Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:25:29.295427Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:25:29.295153Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:25:29.296549Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T04:25:29.295163Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:25:29.300573Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.50.108:2379"}
{"level":"info","ts":"2024-02-14T04:25:29.300796Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T04:25:29.300889Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-02-14T04:35:29.370892Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":670}
{"level":"info","ts":"2024-02-14T04:35:29.374368Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":670,"took":"2.89124ms","hash":3963795833}
{"level":"info","ts":"2024-02-14T04:35:29.374456Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3963795833,"revision":670,"compact-revision":-1}
{"level":"warn","ts":"2024-02-14T04:40:23.210872Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"131.257979ms","expected-duration":"100ms","prefix":"","request":"header:<ID:17708590953311364498 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.50.108\" mod_revision:1143 > success:<request_put:<key:\"/registry/masterleases/192.168.50.108\" value_size:67 lease:8485218916456588688 >> failure:<request_range:<key:\"/registry/masterleases/192.168.50.108\" > >>","response":"size:16"}
{"level":"info","ts":"2024-02-14T04:40:23.21141Z","caller":"traceutil/trace.go:171","msg":"trace[2024765641] linearizableReadLoop","detail":"{readStateIndex:1343; appliedIndex:1342; }","duration":"171.216686ms","start":"2024-02-14T04:40:23.040143Z","end":"2024-02-14T04:40:23.211359Z","steps":["trace[2024765641] 'read index received' (duration: 37.921575ms)","trace[2024765641] 'applied index is now lower than readState.Index' (duration: 133.293883ms)"],"step_count":2}
{"level":"info","ts":"2024-02-14T04:40:23.211486Z","caller":"traceutil/trace.go:171","msg":"trace[460120797] transaction","detail":"{read_only:false; response_revision:1151; number_of_response:1; }","duration":"193.149466ms","start":"2024-02-14T04:40:23.018306Z","end":"2024-02-14T04:40:23.211456Z","steps":["trace[460120797] 'process raft request' (duration: 59.81308ms)","trace[460120797] 'compare' (duration: 131.133137ms)"],"step_count":2}
{"level":"warn","ts":"2024-02-14T04:40:23.21173Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"171.524794ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kubernetes-dashboard/\" range_end:\"/registry/pods/kubernetes-dashboard0\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-02-14T04:40:23.211803Z","caller":"traceutil/trace.go:171","msg":"trace[1483613172] range","detail":"{range_begin:/registry/pods/kubernetes-dashboard/; range_end:/registry/pods/kubernetes-dashboard0; response_count:0; response_revision:1151; }","duration":"171.660948ms","start":"2024-02-14T04:40:23.04012Z","end":"2024-02-14T04:40:23.211781Z","steps":["trace[1483613172] 'agreement among raft nodes before linearized reading' (duration: 171.368429ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T04:40:24.341934Z","caller":"traceutil/trace.go:171","msg":"trace[1722810956] transaction","detail":"{read_only:false; response_revision:1152; number_of_response:1; }","duration":"135.137829ms","start":"2024-02-14T04:40:24.206776Z","end":"2024-02-14T04:40:24.341913Z","steps":["trace[1722810956] 'process raft request' (duration: 134.974522ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T04:40:29.378849Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":913}
{"level":"info","ts":"2024-02-14T04:40:29.380545Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":913,"took":"1.336886ms","hash":23332504}
{"level":"info","ts":"2024-02-14T04:40:29.380802Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":23332504,"revision":913,"compact-revision":670}
==> kernel <==
04:41:31 up 21 min, 0 users, load average: 0.34, 0.28, 0.21
Linux embed-certs-722906 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [97c20a995e70a2abb18b53d65810b225fab5ba924393c2059a53128ea76b2d4e] <==
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:36:32.243407 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:37:31.091990 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I0214 04:38:31.092436 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:38:32.241249 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:38:32.241394 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:38:32.241456 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:38:32.244421 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:38:32.244552 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:38:32.244824 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:39:31.092874 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
I0214 04:40:31.092115 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:40:31.245971 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:40:31.246111 1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:40:31.246581 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
W0214 04:40:32.246882 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:40:32.246955 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:40:32.246967 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:40:32.247022 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:40:32.247104 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:40:32.248181 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:41:31.092484 1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
==> kube-controller-manager [0bd903937bcd9f9dbfe80f786c5b1cee5f8041fd9acc74fa4935eea1698b6cd7] <==
I0214 04:35:46.878204 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:36:16.470846 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:36:16.892778 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:36:46.477021 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:36:46.901619 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
I0214 04:36:48.930608 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="354.608µs"
I0214 04:37:00.931337 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="1.078397ms"
E0214 04:37:16.487087 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:37:16.913396 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:37:46.494946 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:37:46.922789 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:38:16.500571 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:38:16.932506 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:38:46.506998 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:38:46.941493 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:39:16.512602 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:39:16.958218 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:39:46.520743 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:39:46.967323 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:40:16.526443 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:40:16.976769 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:40:46.532942 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:40:46.985440 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:41:16.539790 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:41:16.998545 1 garbagecollector.go:816] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
==> kube-proxy [dc38b5e773abf3be34f29c8f57726fdb6f378ed462125cc35a86ee36f8853ac4] <==
I0214 04:25:51.336245 1 server_others.go:69] "Using iptables proxy"
I0214 04:25:51.355010 1 node.go:141] Successfully retrieved node IP: 192.168.50.108
I0214 04:25:51.403056 1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
I0214 04:25:51.403105 1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:25:51.406323 1 server_others.go:152] "Using iptables Proxier"
I0214 04:25:51.406394 1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:25:51.406577 1 server.go:846] "Version info" version="v1.28.4"
I0214 04:25:51.406610 1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:25:51.408522 1 config.go:188] "Starting service config controller"
I0214 04:25:51.408975 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:25:51.409061 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:25:51.409095 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:25:51.409929 1 config.go:315] "Starting node config controller"
I0214 04:25:51.409966 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:25:51.510024 1 shared_informer.go:318] Caches are synced for node config
I0214 04:25:51.510062 1 shared_informer.go:318] Caches are synced for service config
I0214 04:25:51.510088 1 shared_informer.go:318] Caches are synced for endpoint slice config
==> kube-scheduler [7b8bf11381bce0003f3fdd07b1849a6961c9c2c6a4d8badbe64128f813cafdf5] <==
W0214 04:25:31.269762 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:31.269770 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:31.269830 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:25:31.269839 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 04:25:31.269873 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:31.269881 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:31.274890 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:31.276259 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:32.156076 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 04:25:32.156200 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
W0214 04:25:32.157224 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:25:32.157305 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0214 04:25:32.252839 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:32.252914 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:32.328418 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 04:25:32.328481 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0214 04:25:32.370184 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:25:32.370207 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 04:25:32.422796 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 04:25:32.422881 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
W0214 04:25:32.455111 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:32.455223 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 04:25:32.533827 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:25:32.533917 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
I0214 04:25:35.260428 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:20:30 UTC, ends at Wed 2024-02-14 04:41:31 UTC. --
Feb 14 04:38:35 embed-certs-722906 kubelet[3909]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:38:35 embed-certs-722906 kubelet[3909]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:38:35 embed-certs-722906 kubelet[3909]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:38:45 embed-certs-722906 kubelet[3909]: E0214 04:38:45.911212 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:39:00 embed-certs-722906 kubelet[3909]: E0214 04:39:00.911638 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:39:12 embed-certs-722906 kubelet[3909]: E0214 04:39:12.911180 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:39:25 embed-certs-722906 kubelet[3909]: E0214 04:39:25.910856 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:39:35 embed-certs-722906 kubelet[3909]: E0214 04:39:35.035927 3909 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:39:35 embed-certs-722906 kubelet[3909]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:39:35 embed-certs-722906 kubelet[3909]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:39:35 embed-certs-722906 kubelet[3909]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:39:37 embed-certs-722906 kubelet[3909]: E0214 04:39:37.910711 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:39:49 embed-certs-722906 kubelet[3909]: E0214 04:39:49.911092 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:40:04 embed-certs-722906 kubelet[3909]: E0214 04:40:04.911347 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:40:17 embed-certs-722906 kubelet[3909]: E0214 04:40:17.910970 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:40:31 embed-certs-722906 kubelet[3909]: E0214 04:40:31.910973 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:40:35 embed-certs-722906 kubelet[3909]: E0214 04:40:35.035588 3909 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:40:35 embed-certs-722906 kubelet[3909]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:40:35 embed-certs-722906 kubelet[3909]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:40:35 embed-certs-722906 kubelet[3909]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:40:35 embed-certs-722906 kubelet[3909]: E0214 04:40:35.042804 3909 container_manager_linux.go:514] "Failed to find cgroups of kubelet" err="cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service"
Feb 14 04:40:44 embed-certs-722906 kubelet[3909]: E0214 04:40:44.911880 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:40:56 embed-certs-722906 kubelet[3909]: E0214 04:40:56.911399 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:41:09 embed-certs-722906 kubelet[3909]: E0214 04:41:09.909910 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
Feb 14 04:41:24 embed-certs-722906 kubelet[3909]: E0214 04:41:24.911345 3909 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-hzsfq" podUID="82d19d9d-ee11-4ae7-be7e-1efbc027606f"
==> storage-provisioner [416652fe94935f1d5acaf4ce2bf97f3476ea3543233bf0e5926fb7ac01535db2] <==
I0214 04:25:51.164956 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 04:25:51.191601 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 04:25:51.191763 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 04:25:51.211843 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 04:25:51.213585 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_embed-certs-722906_b25bb42b-cf04-4978-97a4-063b91d23571!
I0214 04:25:51.216320 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"c0d738d0-011a-442a-bd54-71dc11fd7931", APIVersion:"v1", ResourceVersion:"413", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' embed-certs-722906_b25bb42b-cf04-4978-97a4-063b91d23571 became leader
I0214 04:25:51.314222 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_embed-certs-722906_b25bb42b-cf04-4978-97a4-063b91d23571!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-722906 -n embed-certs-722906
helpers_test.go:261: (dbg) Run: kubectl --context embed-certs-722906 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-57f55c9bc5-hzsfq
helpers_test.go:274: ======> post-mortem[TestStartStop/group/embed-certs/serial/AddonExistsAfterStop]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context embed-certs-722906 describe pod metrics-server-57f55c9bc5-hzsfq
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context embed-certs-722906 describe pod metrics-server-57f55c9bc5-hzsfq: exit status 1 (65.747798ms)
** stderr **
Error from server (NotFound): pods "metrics-server-57f55c9bc5-hzsfq" not found
** /stderr **
helpers_test.go:279: kubectl --context embed-certs-722906 describe pod metrics-server-57f55c9bc5-hzsfq: exit status 1
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (395.45s)
=== RUN TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
E0214 04:35:50.025212 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:35:56.222427 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 04:36:13.611579 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 04:36:31.958104 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:37:09.289189 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:37:17.490264 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
start_stop_delete_test.go:287: ***** TestStartStop/group/no-preload/serial/AddonExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:287: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-527067 -n no-preload-527067
start_stop_delete_test.go:287: TestStartStop/group/no-preload/serial/AddonExistsAfterStop: showing logs for failed pods as of 2024-02-14 04:40:35.935922035 +0000 UTC m=+6752.900539638
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
start_stop_delete_test.go:291: (dbg) Run: kubectl --context no-preload-527067 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-527067 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: context deadline exceeded (2.14µs)
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-527067 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": context deadline exceeded
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067
helpers_test.go:244: <<< TestStartStop/group/no-preload/serial/AddonExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/no-preload/serial/AddonExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p no-preload-527067 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p no-preload-527067 logs -n 25: (1.412962169s)
helpers_test.go:252: TestStartStop/group/no-preload/serial/AddonExistsAfterStop logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p bridge-528898 sudo find | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p bridge-528898 sudo crio | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:12 UTC |
| | config | | | | | |
| delete | -p bridge-528898 | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| delete | -p | disable-driver-mounts-648156 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | disable-driver-mounts-648156 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:13 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable metrics-server -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | default-k8s-diff-port-224675 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable dashboard -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:26 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable dashboard -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| delete | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:39 UTC | 14 Feb 24 04:39 UTC |
| start | -p newest-cni-050621 --memory=2200 --alsologtostderr | newest-cni-050621 | jenkins | v1.32.0 | 14 Feb 24 04:39 UTC | |
| | --wait=apiserver,system_pods,default_sa | | | | | |
| | --feature-gates ServerSideApply=true | | | | | |
| | --network-plugin=cni | | | | | |
| | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 | | | | | |
| | --driver=kvm2 --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:39:52
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:39:52.138397 1553797 out.go:291] Setting OutFile to fd 1 ...
I0214 04:39:52.138566 1553797 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:39:52.138580 1553797 out.go:304] Setting ErrFile to fd 2...
I0214 04:39:52.138589 1553797 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:39:52.138799 1553797 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:39:52.139430 1553797 out.go:298] Setting JSON to false
I0214 04:39:52.140432 1553797 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":26539,"bootTime":1707859053,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:39:52.140503 1553797 start.go:138] virtualization: kvm guest
I0214 04:39:52.142782 1553797 out.go:177] * [newest-cni-050621] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:39:52.144191 1553797 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:39:52.144220 1553797 notify.go:220] Checking for updates...
I0214 04:39:52.145368 1553797 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:39:52.146528 1553797 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:39:52.147578 1553797 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:39:52.148616 1553797 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:39:52.149621 1553797 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:39:52.151209 1553797 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:39:52.151316 1553797 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:39:52.151424 1553797 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:39:52.151521 1553797 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:39:52.188587 1553797 out.go:177] * Using the kvm2 driver based on user configuration
I0214 04:39:52.189681 1553797 start.go:296] selected driver: kvm2
I0214 04:39:52.189696 1553797 start.go:900] validating driver "kvm2" against <nil>
I0214 04:39:52.189739 1553797 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:39:52.190648 1553797 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:39:52.190740 1553797 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:39:52.205660 1553797 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:39:52.205696 1553797 start_flags.go:308] no existing cluster config was found, will generate one from the flags
W0214 04:39:52.205717 1553797 out.go:239] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
I0214 04:39:52.206380 1553797 start_flags.go:962] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I0214 04:39:52.206472 1553797 cni.go:84] Creating CNI manager for ""
I0214 04:39:52.206493 1553797 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:39:52.206516 1553797 start_flags.go:317] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0214 04:39:52.206661 1553797 start.go:339] cluster config:
{Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Conta
inerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri
cs:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:39:52.206858 1553797 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:39:52.208695 1553797 out.go:177] * Starting "newest-cni-050621" primary control-plane node in "newest-cni-050621" cluster
I0214 04:39:52.209679 1553797 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:39:52.209714 1553797 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4
I0214 04:39:52.209722 1553797 cache.go:56] Caching tarball of preloaded images
I0214 04:39:52.209793 1553797 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:39:52.209807 1553797 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on crio
I0214 04:39:52.209893 1553797 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/config.json ...
I0214 04:39:52.209911 1553797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/config.json: {Name:mk09377bdca696ea06471f71b23acb06e738dd86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:39:52.210056 1553797 start.go:360] acquireMachinesLock for newest-cni-050621: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:39:52.210091 1553797 start.go:364] duration metric: took 17.359µs to acquireMachinesLock for "newest-cni-050621"
I0214 04:39:52.210114 1553797 start.go:93] Provisioning new machine with config: &{Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:39:52.210188 1553797 start.go:125] createHost starting for "" (driver="kvm2")
I0214 04:39:52.211651 1553797 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0214 04:39:52.211769 1553797 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:39:52.211804 1553797 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:39:52.225474 1553797 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44917
I0214 04:39:52.225860 1553797 main.go:141] libmachine: () Calling .GetVersion
I0214 04:39:52.226437 1553797 main.go:141] libmachine: Using API Version 1
I0214 04:39:52.226458 1553797 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:39:52.226776 1553797 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:39:52.226975 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:39:52.227167 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:39:52.227328 1553797 start.go:159] libmachine.API.Create for "newest-cni-050621" (driver="kvm2")
I0214 04:39:52.227366 1553797 client.go:168] LocalClient.Create starting
I0214 04:39:52.227427 1553797 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem
I0214 04:39:52.227455 1553797 main.go:141] libmachine: Decoding PEM data...
I0214 04:39:52.227470 1553797 main.go:141] libmachine: Parsing certificate...
I0214 04:39:52.227549 1553797 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem
I0214 04:39:52.227571 1553797 main.go:141] libmachine: Decoding PEM data...
I0214 04:39:52.227579 1553797 main.go:141] libmachine: Parsing certificate...
I0214 04:39:52.227593 1553797 main.go:141] libmachine: Running pre-create checks...
I0214 04:39:52.227600 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .PreCreateCheck
I0214 04:39:52.227967 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetConfigRaw
I0214 04:39:52.228523 1553797 main.go:141] libmachine: Creating machine...
I0214 04:39:52.228538 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .Create
I0214 04:39:52.228710 1553797 main.go:141] libmachine: (newest-cni-050621) Creating KVM machine...
I0214 04:39:52.229863 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found existing default KVM network
I0214 04:39:52.231441 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:52.231250 1553820 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:57:6c:1d} reservation:<nil>}
I0214 04:39:52.232336 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:52.232240 1553820 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:53:91:7e} reservation:<nil>}
I0214 04:39:52.233298 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:52.233187 1553820 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:5e:ad:aa} reservation:<nil>}
I0214 04:39:52.234366 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:52.234265 1553820 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002c36e0}
I0214 04:39:52.234450 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | created network xml:
I0214 04:39:52.234476 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | <network>
I0214 04:39:52.234488 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | <name>mk-newest-cni-050621</name>
I0214 04:39:52.234505 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | <dns enable='no'/>
I0214 04:39:52.234518 1553797 main.go:141] libmachine: (newest-cni-050621) DBG |
I0214 04:39:52.234532 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0214 04:39:52.234545 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | <dhcp>
I0214 04:39:52.234554 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0214 04:39:52.234562 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | </dhcp>
I0214 04:39:52.234576 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | </ip>
I0214 04:39:52.234582 1553797 main.go:141] libmachine: (newest-cni-050621) DBG |
I0214 04:39:52.234591 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | </network>
I0214 04:39:52.234601 1553797 main.go:141] libmachine: (newest-cni-050621) DBG |
I0214 04:39:52.239645 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | trying to create private KVM network mk-newest-cni-050621 192.168.72.0/24...
I0214 04:39:52.315423 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | private KVM network mk-newest-cni-050621 192.168.72.0/24 created
I0214 04:39:52.315470 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:52.315400 1553820 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:39:52.315484 1553797 main.go:141] libmachine: (newest-cni-050621) Setting up store path in /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621 ...
I0214 04:39:52.315503 1553797 main.go:141] libmachine: (newest-cni-050621) Building disk image from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 04:39:52.315629 1553797 main.go:141] libmachine: (newest-cni-050621) Downloading /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso...
I0214 04:39:52.563935 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:52.563796 1553820 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa...
I0214 04:39:52.652574 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:52.652445 1553820 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/newest-cni-050621.rawdisk...
I0214 04:39:52.652605 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Writing magic tar header
I0214 04:39:52.652631 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Writing SSH key tar header
I0214 04:39:52.652651 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:52.652608 1553820 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621 ...
I0214 04:39:52.652800 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621
I0214 04:39:52.652842 1553797 main.go:141] libmachine: (newest-cni-050621) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621 (perms=drwx------)
I0214 04:39:52.652855 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines
I0214 04:39:52.652878 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:39:52.652893 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17909-1487441
I0214 04:39:52.652909 1553797 main.go:141] libmachine: (newest-cni-050621) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube/machines (perms=drwxr-xr-x)
I0214 04:39:52.652924 1553797 main.go:141] libmachine: (newest-cni-050621) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441/.minikube (perms=drwxr-xr-x)
I0214 04:39:52.652943 1553797 main.go:141] libmachine: (newest-cni-050621) Setting executable bit set on /home/jenkins/minikube-integration/17909-1487441 (perms=drwxrwxr-x)
I0214 04:39:52.652954 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0214 04:39:52.652973 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Checking permissions on dir: /home/jenkins
I0214 04:39:52.652988 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Checking permissions on dir: /home
I0214 04:39:52.652999 1553797 main.go:141] libmachine: (newest-cni-050621) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0214 04:39:52.653013 1553797 main.go:141] libmachine: (newest-cni-050621) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0214 04:39:52.653029 1553797 main.go:141] libmachine: (newest-cni-050621) Creating domain...
I0214 04:39:52.653047 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Skipping /home - not owner
I0214 04:39:52.654167 1553797 main.go:141] libmachine: (newest-cni-050621) define libvirt domain using xml:
I0214 04:39:52.654197 1553797 main.go:141] libmachine: (newest-cni-050621) <domain type='kvm'>
I0214 04:39:52.654211 1553797 main.go:141] libmachine: (newest-cni-050621) <name>newest-cni-050621</name>
I0214 04:39:52.654226 1553797 main.go:141] libmachine: (newest-cni-050621) <memory unit='MiB'>2200</memory>
I0214 04:39:52.654239 1553797 main.go:141] libmachine: (newest-cni-050621) <vcpu>2</vcpu>
I0214 04:39:52.654251 1553797 main.go:141] libmachine: (newest-cni-050621) <features>
I0214 04:39:52.654266 1553797 main.go:141] libmachine: (newest-cni-050621) <acpi/>
I0214 04:39:52.654279 1553797 main.go:141] libmachine: (newest-cni-050621) <apic/>
I0214 04:39:52.654294 1553797 main.go:141] libmachine: (newest-cni-050621) <pae/>
I0214 04:39:52.654309 1553797 main.go:141] libmachine: (newest-cni-050621)
I0214 04:39:52.654321 1553797 main.go:141] libmachine: (newest-cni-050621) </features>
I0214 04:39:52.654335 1553797 main.go:141] libmachine: (newest-cni-050621) <cpu mode='host-passthrough'>
I0214 04:39:52.654349 1553797 main.go:141] libmachine: (newest-cni-050621)
I0214 04:39:52.654361 1553797 main.go:141] libmachine: (newest-cni-050621) </cpu>
I0214 04:39:52.654375 1553797 main.go:141] libmachine: (newest-cni-050621) <os>
I0214 04:39:52.654392 1553797 main.go:141] libmachine: (newest-cni-050621) <type>hvm</type>
I0214 04:39:52.654406 1553797 main.go:141] libmachine: (newest-cni-050621) <boot dev='cdrom'/>
I0214 04:39:52.654419 1553797 main.go:141] libmachine: (newest-cni-050621) <boot dev='hd'/>
I0214 04:39:52.654434 1553797 main.go:141] libmachine: (newest-cni-050621) <bootmenu enable='no'/>
I0214 04:39:52.654446 1553797 main.go:141] libmachine: (newest-cni-050621) </os>
I0214 04:39:52.654474 1553797 main.go:141] libmachine: (newest-cni-050621) <devices>
I0214 04:39:52.654500 1553797 main.go:141] libmachine: (newest-cni-050621) <disk type='file' device='cdrom'>
I0214 04:39:52.654523 1553797 main.go:141] libmachine: (newest-cni-050621) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/boot2docker.iso'/>
I0214 04:39:52.654542 1553797 main.go:141] libmachine: (newest-cni-050621) <target dev='hdc' bus='scsi'/>
I0214 04:39:52.654552 1553797 main.go:141] libmachine: (newest-cni-050621) <readonly/>
I0214 04:39:52.654561 1553797 main.go:141] libmachine: (newest-cni-050621) </disk>
I0214 04:39:52.654650 1553797 main.go:141] libmachine: (newest-cni-050621) <disk type='file' device='disk'>
I0214 04:39:52.654687 1553797 main.go:141] libmachine: (newest-cni-050621) <driver name='qemu' type='raw' cache='default' io='threads' />
I0214 04:39:52.654710 1553797 main.go:141] libmachine: (newest-cni-050621) <source file='/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/newest-cni-050621.rawdisk'/>
I0214 04:39:52.654725 1553797 main.go:141] libmachine: (newest-cni-050621) <target dev='hda' bus='virtio'/>
I0214 04:39:52.654739 1553797 main.go:141] libmachine: (newest-cni-050621) </disk>
I0214 04:39:52.654752 1553797 main.go:141] libmachine: (newest-cni-050621) <interface type='network'>
I0214 04:39:52.654766 1553797 main.go:141] libmachine: (newest-cni-050621) <source network='mk-newest-cni-050621'/>
I0214 04:39:52.654780 1553797 main.go:141] libmachine: (newest-cni-050621) <model type='virtio'/>
I0214 04:39:52.654805 1553797 main.go:141] libmachine: (newest-cni-050621) </interface>
I0214 04:39:52.654841 1553797 main.go:141] libmachine: (newest-cni-050621) <interface type='network'>
I0214 04:39:52.654877 1553797 main.go:141] libmachine: (newest-cni-050621) <source network='default'/>
I0214 04:39:52.654902 1553797 main.go:141] libmachine: (newest-cni-050621) <model type='virtio'/>
I0214 04:39:52.654930 1553797 main.go:141] libmachine: (newest-cni-050621) </interface>
I0214 04:39:52.654944 1553797 main.go:141] libmachine: (newest-cni-050621) <serial type='pty'>
I0214 04:39:52.654957 1553797 main.go:141] libmachine: (newest-cni-050621) <target port='0'/>
I0214 04:39:52.654968 1553797 main.go:141] libmachine: (newest-cni-050621) </serial>
I0214 04:39:52.654981 1553797 main.go:141] libmachine: (newest-cni-050621) <console type='pty'>
I0214 04:39:52.654993 1553797 main.go:141] libmachine: (newest-cni-050621) <target type='serial' port='0'/>
I0214 04:39:52.655007 1553797 main.go:141] libmachine: (newest-cni-050621) </console>
I0214 04:39:52.655019 1553797 main.go:141] libmachine: (newest-cni-050621) <rng model='virtio'>
I0214 04:39:52.655044 1553797 main.go:141] libmachine: (newest-cni-050621) <backend model='random'>/dev/random</backend>
I0214 04:39:52.655062 1553797 main.go:141] libmachine: (newest-cni-050621) </rng>
I0214 04:39:52.655077 1553797 main.go:141] libmachine: (newest-cni-050621)
I0214 04:39:52.655089 1553797 main.go:141] libmachine: (newest-cni-050621)
I0214 04:39:52.655098 1553797 main.go:141] libmachine: (newest-cni-050621) </devices>
I0214 04:39:52.655109 1553797 main.go:141] libmachine: (newest-cni-050621) </domain>
I0214 04:39:52.655125 1553797 main.go:141] libmachine: (newest-cni-050621)
I0214 04:39:52.658877 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:d9:a3:4a in network default
I0214 04:39:52.659583 1553797 main.go:141] libmachine: (newest-cni-050621) Ensuring networks are active...
I0214 04:39:52.659613 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:52.660344 1553797 main.go:141] libmachine: (newest-cni-050621) Ensuring network default is active
I0214 04:39:52.660785 1553797 main.go:141] libmachine: (newest-cni-050621) Ensuring network mk-newest-cni-050621 is active
I0214 04:39:52.661507 1553797 main.go:141] libmachine: (newest-cni-050621) Getting domain xml...
I0214 04:39:52.662350 1553797 main.go:141] libmachine: (newest-cni-050621) Creating domain...
I0214 04:39:53.912336 1553797 main.go:141] libmachine: (newest-cni-050621) Waiting to get IP...
I0214 04:39:53.913213 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:53.913736 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:53.913846 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:53.913754 1553820 retry.go:31] will retry after 275.11568ms: waiting for machine to come up
I0214 04:39:54.190275 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:54.190783 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:54.190811 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:54.190739 1553820 retry.go:31] will retry after 372.940663ms: waiting for machine to come up
I0214 04:39:54.565312 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:54.565854 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:54.565915 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:54.565796 1553820 retry.go:31] will retry after 398.965236ms: waiting for machine to come up
I0214 04:39:54.966602 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:54.967149 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:54.967188 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:54.967081 1553820 retry.go:31] will retry after 384.153774ms: waiting for machine to come up
I0214 04:39:55.352465 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:55.352958 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:55.352990 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:55.352902 1553820 retry.go:31] will retry after 470.865927ms: waiting for machine to come up
I0214 04:39:55.825775 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:55.826271 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:55.826311 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:55.826221 1553820 retry.go:31] will retry after 815.922953ms: waiting for machine to come up
I0214 04:39:56.644434 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:56.644960 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:56.645000 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:56.644912 1553820 retry.go:31] will retry after 1.046512707s: waiting for machine to come up
I0214 04:39:57.693588 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:57.694063 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:57.694098 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:57.694004 1553820 retry.go:31] will retry after 921.069303ms: waiting for machine to come up
I0214 04:39:58.617153 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:39:58.617702 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:39:58.617736 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:39:58.617640 1553820 retry.go:31] will retry after 1.572554401s: waiting for machine to come up
I0214 04:40:00.192319 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:00.192798 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:40:00.192830 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:40:00.192751 1553820 retry.go:31] will retry after 1.790262963s: waiting for machine to come up
I0214 04:40:01.985898 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:01.986358 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:40:01.986396 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:40:01.986314 1553820 retry.go:31] will retry after 2.175728485s: waiting for machine to come up
I0214 04:40:04.164564 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:04.165106 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:40:04.165141 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:40:04.165052 1553820 retry.go:31] will retry after 2.816603548s: waiting for machine to come up
I0214 04:40:06.985211 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:06.985817 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:40:06.985854 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:40:06.985736 1553820 retry.go:31] will retry after 3.706814935s: waiting for machine to come up
I0214 04:40:10.694408 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:10.694897 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find current IP address of domain newest-cni-050621 in network mk-newest-cni-050621
I0214 04:40:10.694925 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | I0214 04:40:10.694855 1553820 retry.go:31] will retry after 4.609435424s: waiting for machine to come up
I0214 04:40:15.306364 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.306779 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has current primary IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.306811 1553797 main.go:141] libmachine: (newest-cni-050621) Found IP for machine: 192.168.72.60
I0214 04:40:15.306827 1553797 main.go:141] libmachine: (newest-cni-050621) Reserving static IP address...
I0214 04:40:15.307214 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | unable to find host DHCP lease matching {name: "newest-cni-050621", mac: "52:54:00:e6:10:2e", ip: "192.168.72.60"} in network mk-newest-cni-050621
I0214 04:40:15.385771 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Getting to WaitForSSH function...
I0214 04:40:15.385812 1553797 main.go:141] libmachine: (newest-cni-050621) Reserved static IP address: 192.168.72.60
I0214 04:40:15.385846 1553797 main.go:141] libmachine: (newest-cni-050621) Waiting for SSH to be available...
I0214 04:40:15.388600 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.388992 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:minikube Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:15.389027 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.389204 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Using SSH client type: external
I0214 04:40:15.389229 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa (-rw-------)
I0214 04:40:15.389282 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.60 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:40:15.389304 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | About to run SSH command:
I0214 04:40:15.389322 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | exit 0
I0214 04:40:15.481378 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | SSH cmd err, output: <nil>:
I0214 04:40:15.481703 1553797 main.go:141] libmachine: (newest-cni-050621) KVM machine creation complete!
I0214 04:40:15.482054 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetConfigRaw
I0214 04:40:15.482617 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:40:15.482831 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:40:15.483056 1553797 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0214 04:40:15.483076 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetState
I0214 04:40:15.484537 1553797 main.go:141] libmachine: Detecting operating system of created instance...
I0214 04:40:15.484551 1553797 main.go:141] libmachine: Waiting for SSH to be available...
I0214 04:40:15.484558 1553797 main.go:141] libmachine: Getting to WaitForSSH function...
I0214 04:40:15.484585 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:15.487004 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.487434 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:15.487468 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.487629 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:15.487795 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:15.487940 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:15.488111 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:15.488294 1553797 main.go:141] libmachine: Using SSH client type: native
I0214 04:40:15.488656 1553797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:40:15.488671 1553797 main.go:141] libmachine: About to run SSH command:
exit 0
I0214 04:40:15.612549 1553797 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:40:15.612575 1553797 main.go:141] libmachine: Detecting the provisioner...
I0214 04:40:15.612584 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:15.615484 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.615927 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:15.615948 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.616170 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:15.616413 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:15.616626 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:15.616816 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:15.616997 1553797 main.go:141] libmachine: Using SSH client type: native
I0214 04:40:15.617468 1553797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:40:15.617486 1553797 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0214 04:40:15.741895 1553797 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g19d536a-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0214 04:40:15.742027 1553797 main.go:141] libmachine: found compatible host: buildroot
I0214 04:40:15.742044 1553797 main.go:141] libmachine: Provisioning with buildroot...
I0214 04:40:15.742057 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:40:15.742330 1553797 buildroot.go:166] provisioning hostname "newest-cni-050621"
I0214 04:40:15.742363 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:40:15.742561 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:15.745024 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.745328 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:15.745361 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.745545 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:15.745721 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:15.745927 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:15.746103 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:15.746255 1553797 main.go:141] libmachine: Using SSH client type: native
I0214 04:40:15.746707 1553797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:40:15.746729 1553797 main.go:141] libmachine: About to run SSH command:
sudo hostname newest-cni-050621 && echo "newest-cni-050621" | sudo tee /etc/hostname
I0214 04:40:15.882623 1553797 main.go:141] libmachine: SSH cmd err, output: <nil>: newest-cni-050621
I0214 04:40:15.882659 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:15.885630 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.886003 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:15.886037 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:15.886208 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:15.886414 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:15.886551 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:15.886682 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:15.886916 1553797 main.go:141] libmachine: Using SSH client type: native
I0214 04:40:15.887385 1553797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:40:15.887427 1553797 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-050621' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-050621/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-050621' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:40:16.017134 1553797 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:40:16.017162 1553797 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:40:16.017186 1553797 buildroot.go:174] setting up certificates
I0214 04:40:16.017199 1553797 provision.go:84] configureAuth start
I0214 04:40:16.017212 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetMachineName
I0214 04:40:16.017561 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:40:16.020276 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.020734 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.020768 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.020946 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:16.023412 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.023758 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.023790 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.023943 1553797 provision.go:143] copyHostCerts
I0214 04:40:16.024006 1553797 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:40:16.024016 1553797 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:40:16.024082 1553797 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:40:16.024204 1553797 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:40:16.024214 1553797 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:40:16.024239 1553797 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:40:16.024291 1553797 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:40:16.024298 1553797 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:40:16.024317 1553797 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:40:16.024383 1553797 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.newest-cni-050621 san=[127.0.0.1 192.168.72.60 localhost minikube newest-cni-050621]
I0214 04:40:16.187911 1553797 provision.go:177] copyRemoteCerts
I0214 04:40:16.187973 1553797 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:40:16.188001 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:16.190986 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.191311 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.191339 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.191527 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:16.191764 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:16.191952 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:16.192119 1553797 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:40:16.283729 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:40:16.307542 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0214 04:40:16.331354 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:40:16.357429 1553797 provision.go:87] duration metric: took 340.214778ms to configureAuth
I0214 04:40:16.357457 1553797 buildroot.go:189] setting minikube options for container-runtime
I0214 04:40:16.357650 1553797 config.go:182] Loaded profile config "newest-cni-050621": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:40:16.357780 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:16.361221 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.361586 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.361610 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.361770 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:16.362011 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:16.362205 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:16.362407 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:16.362602 1553797 main.go:141] libmachine: Using SSH client type: native
I0214 04:40:16.362907 1553797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:40:16.362924 1553797 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:40:16.679954 1553797 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:40:16.679999 1553797 main.go:141] libmachine: Checking connection to Docker...
I0214 04:40:16.680009 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetURL
I0214 04:40:16.681538 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | Using libvirt version 6000000
I0214 04:40:16.683757 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.684064 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.684095 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.684228 1553797 main.go:141] libmachine: Docker is up and running!
I0214 04:40:16.684243 1553797 main.go:141] libmachine: Reticulating splines...
I0214 04:40:16.684251 1553797 client.go:171] duration metric: took 24.456873548s to LocalClient.Create
I0214 04:40:16.684275 1553797 start.go:167] duration metric: took 24.456946035s to libmachine.API.Create "newest-cni-050621"
I0214 04:40:16.684284 1553797 start.go:293] postStartSetup for "newest-cni-050621" (driver="kvm2")
I0214 04:40:16.684301 1553797 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:40:16.684320 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:40:16.684612 1553797 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:40:16.684648 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:16.686868 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.687267 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.687290 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.687499 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:16.687688 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:16.687877 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:16.688081 1553797 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:40:16.778265 1553797 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:40:16.782309 1553797 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:40:16.782332 1553797 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:40:16.782391 1553797 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:40:16.782476 1553797 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:40:16.782568 1553797 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:40:16.791145 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:40:16.813879 1553797 start.go:296] duration metric: took 129.581794ms for postStartSetup
I0214 04:40:16.813927 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetConfigRaw
I0214 04:40:16.814546 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:40:16.817344 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.817758 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.817793 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.818056 1553797 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/config.json ...
I0214 04:40:16.818225 1553797 start.go:128] duration metric: took 24.608026051s to createHost
I0214 04:40:16.818246 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:16.820611 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.820970 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.821001 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.821117 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:16.821321 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:16.821495 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:16.821667 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:16.821848 1553797 main.go:141] libmachine: Using SSH client type: native
I0214 04:40:16.822165 1553797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.60 22 <nil> <nil>}
I0214 04:40:16.822176 1553797 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:40:16.946112 1553797 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707885616.926014711
I0214 04:40:16.946142 1553797 fix.go:216] guest clock: 1707885616.926014711
I0214 04:40:16.946152 1553797 fix.go:229] Guest: 2024-02-14 04:40:16.926014711 +0000 UTC Remote: 2024-02-14 04:40:16.818235838 +0000 UTC m=+24.732214529 (delta=107.778873ms)
I0214 04:40:16.946184 1553797 fix.go:200] guest clock delta is within tolerance: 107.778873ms
I0214 04:40:16.946192 1553797 start.go:83] releasing machines lock for "newest-cni-050621", held for 24.736088755s
I0214 04:40:16.946221 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:40:16.946509 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:40:16.949108 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.949527 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.949558 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.949773 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:40:16.950373 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:40:16.950583 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .DriverName
I0214 04:40:16.950672 1553797 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:40:16.950730 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:16.950792 1553797 ssh_runner.go:195] Run: cat /version.json
I0214 04:40:16.950818 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHHostname
I0214 04:40:16.953405 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.953593 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.953746 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.953772 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.953977 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:16.953984 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:16.954013 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:16.954186 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHPort
I0214 04:40:16.954218 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:16.954390 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:16.954392 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHKeyPath
I0214 04:40:16.954578 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetSSHUsername
I0214 04:40:16.954582 1553797 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:40:16.954718 1553797 sshutil.go:53] new ssh client: &{IP:192.168.72.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/newest-cni-050621/id_rsa Username:docker}
I0214 04:40:17.066135 1553797 ssh_runner.go:195] Run: systemctl --version
I0214 04:40:17.072189 1553797 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:40:17.228275 1553797 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:40:17.234947 1553797 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:40:17.235012 1553797 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:40:17.252455 1553797 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:40:17.252482 1553797 start.go:494] detecting cgroup driver to use...
I0214 04:40:17.252557 1553797 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:40:17.268839 1553797 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:40:17.283771 1553797 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:40:17.283836 1553797 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:40:17.297721 1553797 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:40:17.311726 1553797 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:40:17.432812 1553797 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:40:17.551200 1553797 docker.go:233] disabling docker service ...
I0214 04:40:17.551285 1553797 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:40:17.567276 1553797 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:40:17.580227 1553797 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:40:17.693825 1553797 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:40:17.820963 1553797 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:40:17.834272 1553797 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:40:17.851968 1553797 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:40:17.852031 1553797 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:40:17.862386 1553797 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:40:17.862441 1553797 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:40:17.871491 1553797 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:40:17.880510 1553797 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:40:17.889606 1553797 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:40:17.899848 1553797 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:40:17.907864 1553797 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:40:17.907906 1553797 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:40:17.921144 1553797 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:40:17.929723 1553797 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:40:18.051116 1553797 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:40:18.227545 1553797 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:40:18.227641 1553797 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:40:18.233747 1553797 start.go:562] Will wait 60s for crictl version
I0214 04:40:18.233796 1553797 ssh_runner.go:195] Run: which crictl
I0214 04:40:18.238192 1553797 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:40:18.280937 1553797 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:40:18.281030 1553797 ssh_runner.go:195] Run: crio --version
I0214 04:40:18.338453 1553797 ssh_runner.go:195] Run: crio --version
I0214 04:40:18.393605 1553797 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on CRI-O 1.24.1 ...
I0214 04:40:18.394661 1553797 main.go:141] libmachine: (newest-cni-050621) Calling .GetIP
I0214 04:40:18.397498 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:18.398023 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e6:10:2e", ip: ""} in network mk-newest-cni-050621: {Iface:virbr4 ExpiryTime:2024-02-14 05:40:08 +0000 UTC Type:0 Mac:52:54:00:e6:10:2e Iaid: IPaddr:192.168.72.60 Prefix:24 Hostname:newest-cni-050621 Clientid:01:52:54:00:e6:10:2e}
I0214 04:40:18.398054 1553797 main.go:141] libmachine: (newest-cni-050621) DBG | domain newest-cni-050621 has defined IP address 192.168.72.60 and MAC address 52:54:00:e6:10:2e in network mk-newest-cni-050621
I0214 04:40:18.398270 1553797 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:40:18.402798 1553797 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:40:18.417181 1553797 out.go:177] - kubeadm.pod-network-cidr=10.42.0.0/16
I0214 04:40:18.418322 1553797 kubeadm.go:877] updating cluster {Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host M
ount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:40:18.418452 1553797 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:40:18.418508 1553797 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:40:18.454803 1553797 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.29.0-rc.2". assuming images are not preloaded.
I0214 04:40:18.454885 1553797 ssh_runner.go:195] Run: which lz4
I0214 04:40:18.459164 1553797 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:40:18.463615 1553797 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:40:18.463639 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (401853962 bytes)
I0214 04:40:20.031576 1553797 crio.go:444] duration metric: took 1.572452499s to copy over tarball
I0214 04:40:20.031655 1553797 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:40:22.738472 1553797 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.706777927s)
I0214 04:40:22.738503 1553797 crio.go:451] duration metric: took 2.706901135s to extract the tarball
I0214 04:40:22.738511 1553797 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:40:22.776076 1553797 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:40:22.860499 1553797 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:40:22.860529 1553797 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:40:22.860540 1553797 kubeadm.go:928] updating node { 192.168.72.60 8443 v1.29.0-rc.2 crio true true} ...
I0214 04:40:22.860702 1553797 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --feature-gates=ServerSideApply=true --hostname-override=newest-cni-050621 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.72.60
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:40:22.860798 1553797 ssh_runner.go:195] Run: crio config
I0214 04:40:22.925158 1553797 cni.go:84] Creating CNI manager for ""
I0214 04:40:22.925185 1553797 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:40:22.925197 1553797 kubeadm.go:84] Using pod CIDR: 10.42.0.0/16
I0214 04:40:22.925236 1553797 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.72.60 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-050621 NodeName:newest-cni-050621 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota feature-gates:ServerSideApply=true] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.60"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true feature-gates:ServerSideApply=true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[feature-gates:ServerSideApply=true leader-elect:false] Pairs:map[]}] FeatureArgs
:map[] NodeIP:192.168.72.60 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:40:22.925457 1553797 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.60
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "newest-cni-050621"
kubeletExtraArgs:
node-ip: 192.168.72.60
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.60"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
feature-gates: "ServerSideApply=true"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
feature-gates: "ServerSideApply=true"
leader-elect: "false"
scheduler:
extraArgs:
feature-gates: "ServerSideApply=true"
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:40:22.925531 1553797 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0214 04:40:22.934984 1553797 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:40:22.935063 1553797 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:40:22.943609 1553797 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (358 bytes)
I0214 04:40:22.960948 1553797 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0214 04:40:22.976304 1553797 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2287 bytes)
I0214 04:40:22.992528 1553797 ssh_runner.go:195] Run: grep 192.168.72.60 control-plane.minikube.internal$ /etc/hosts
I0214 04:40:22.996383 1553797 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.60 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:40:23.009278 1553797 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:40:23.126041 1553797 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:40:23.142803 1553797 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621 for IP: 192.168.72.60
I0214 04:40:23.142829 1553797 certs.go:194] generating shared ca certs ...
I0214 04:40:23.142850 1553797 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:40:23.143033 1553797 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:40:23.143101 1553797 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:40:23.143117 1553797 certs.go:256] generating profile certs ...
I0214 04:40:23.143202 1553797 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/client.key
I0214 04:40:23.143252 1553797 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/client.crt with IP's: []
I0214 04:40:23.260219 1553797 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/client.crt ...
I0214 04:40:23.260251 1553797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/client.crt: {Name:mk3efa7fa7c254e4dc09f36a4be5fcc5df6bc7be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:40:23.260461 1553797 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/client.key ...
I0214 04:40:23.260478 1553797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/client.key: {Name:mk97c9ac3c385dc15409fbbac482563993097137 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:40:23.260603 1553797 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.key.3ed58110
I0214 04:40:23.260625 1553797 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.crt.3ed58110 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.60]
I0214 04:40:23.633211 1553797 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.crt.3ed58110 ...
I0214 04:40:23.633246 1553797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.crt.3ed58110: {Name:mk01c4c2c965601e596c9f5299a5af7df7039758 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:40:23.633462 1553797 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.key.3ed58110 ...
I0214 04:40:23.633482 1553797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.key.3ed58110: {Name:mk1f2d48a20d37f63332976af0afeacf86d7dfcb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:40:23.676505 1553797 certs.go:381] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.crt.3ed58110 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.crt
I0214 04:40:23.676788 1553797 certs.go:385] copying /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.key.3ed58110 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.key
I0214 04:40:23.676911 1553797 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.key
I0214 04:40:23.676939 1553797 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.crt with IP's: []
I0214 04:40:23.872742 1553797 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.crt ...
I0214 04:40:23.872788 1553797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.crt: {Name:mkf4c26d3186f56bd6b6b788ba56954afeadac4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:40:23.873017 1553797 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.key ...
I0214 04:40:23.873042 1553797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.key: {Name:mk10b25077a4f0533a8293d2419eb1f642180657 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:40:23.873330 1553797 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:40:23.873379 1553797 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:40:23.873390 1553797 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:40:23.873411 1553797 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:40:23.873432 1553797 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:40:23.873453 1553797 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:40:23.873511 1553797 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:40:23.874394 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:40:23.905225 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:40:23.930345 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:40:23.958005 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:40:23.989953 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 04:40:24.024140 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:40:24.051203 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:40:24.073206 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/newest-cni-050621/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:40:24.095284 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:40:24.118400 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:40:24.140369 1553797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:40:24.162620 1553797 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:40:24.179916 1553797 ssh_runner.go:195] Run: openssl version
I0214 04:40:24.185687 1553797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:40:24.196929 1553797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:40:24.201354 1553797 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:40:24.201415 1553797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:40:24.207203 1553797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:40:24.217811 1553797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:40:24.227946 1553797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:40:24.232616 1553797 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:40:24.232665 1553797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:40:24.238081 1553797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:40:24.248178 1553797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:40:24.258625 1553797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:40:24.262856 1553797 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:40:24.262907 1553797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:40:24.268565 1553797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:40:24.279812 1553797 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:40:24.283927 1553797 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0214 04:40:24.283995 1553797 kubeadm.go:391] StartCluster: {Name:newest-cni-050621 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29
.0-rc.2 ClusterName:newest-cni-050621 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.60 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Moun
t9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:40:24.284084 1553797 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:40:24.284140 1553797 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:40:24.327868 1553797 cri.go:89] found id: ""
I0214 04:40:24.327933 1553797 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0214 04:40:24.338152 1553797 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:40:24.347793 1553797 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:40:24.357384 1553797 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:40:24.357404 1553797 kubeadm.go:156] found existing configuration files:
I0214 04:40:24.357450 1553797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:40:24.366819 1553797 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:40:24.366877 1553797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:40:24.376820 1553797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:40:24.385989 1553797 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:40:24.386037 1553797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:40:24.395617 1553797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:40:24.404447 1553797 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:40:24.404508 1553797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:40:24.414701 1553797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:40:24.423827 1553797 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:40:24.423885 1553797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:40:24.433809 1553797 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:40:24.555014 1553797 kubeadm.go:309] [init] Using Kubernetes version: v1.29.0-rc.2
I0214 04:40:24.555095 1553797 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:40:24.708909 1553797 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:40:24.709073 1553797 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:40:24.709219 1553797 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:40:24.978184 1553797 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:40:25.074325 1553797 out.go:204] - Generating certificates and keys ...
I0214 04:40:25.074451 1553797 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:40:25.074577 1553797 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:40:25.083664 1553797 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0214 04:40:25.283973 1553797 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0214 04:40:25.430148 1553797 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0214 04:40:25.520142 1553797 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0214 04:40:25.608393 1553797 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0214 04:40:25.608785 1553797 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost newest-cni-050621] and IPs [192.168.72.60 127.0.0.1 ::1]
I0214 04:40:25.724240 1553797 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0214 04:40:25.724780 1553797 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost newest-cni-050621] and IPs [192.168.72.60 127.0.0.1 ::1]
I0214 04:40:25.796550 1553797 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0214 04:40:25.936511 1553797 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0214 04:40:26.255026 1553797 kubeadm.go:309] [certs] Generating "sa" key and public key
I0214 04:40:26.255310 1553797 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:40:26.567175 1553797 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:40:26.677133 1553797 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0214 04:40:26.778316 1553797 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:40:27.014955 1553797 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:40:27.208227 1553797 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:40:27.209058 1553797 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:40:27.211901 1553797 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:40:27.213513 1553797 out.go:204] - Booting up control plane ...
I0214 04:40:27.213650 1553797 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:40:27.213759 1553797 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:40:27.214346 1553797 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:40:27.230249 1553797 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:40:27.231245 1553797 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:40:27.231345 1553797 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:40:27.354352 1553797 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:20:08 UTC, ends at Wed 2024-02-14 04:40:36 UTC. --
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.722769374Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=470ee237-4f4c-4146-adac-74cdd25202d4 name=/runtime.v1.RuntimeService/Version
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.724481875Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=14a513c9-645d-40bf-abf7-94c11e78d6a4 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.724824717Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885636724811953,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:97830,},InodesUsed:&UInt64Value{Value:49,},},},}" file="go-grpc-middleware/chain.go:25" id=14a513c9-645d-40bf-abf7-94c11e78d6a4 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.725832136Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=23ac7709-ab38-41a9-bfb3-802b76415f30 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.725939910Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=23ac7709-ab38-41a9-bfb3-802b76415f30 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.726123486Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684,PodSandboxId:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:eaba9cb00c07766583bd527cc3d4dbf002c2587dcee4952d2ee56e8562346651,State:CONTAINER_RUNNING,CreatedAt:1707884798096609424,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{io.kubernetes.container.hash: 661b70a3,io.kubernetes.container.restartCount: 0,io.kube
rnetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331,PodSandboxId:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:eba727be6ca4938cb3deec2eb6b7767e33995b2083144b23a8bbd138515b0dac,State:CONTAINER_RUNNING,CreatedAt:1707884797678437642,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,},Annotations:map[string]string{io.kubernetes.container.hash: 44829cc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09,PodSandboxId:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884797041968111,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,},Annotations:map[string]string{io.kubernetes.container.hash: ee12eb91,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-t
cp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4,PodSandboxId:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884796912060673,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8
d8d-35e0ab14f8de,},Annotations:map[string]string{io.kubernetes.container.hash: 7e31045f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b,PodSandboxId:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:a9aa934e24e72ecc1829948966f500cf16b2faa6b63de15f1b6de03cc074812f,State:CONTAINER_RUNNING,CreatedAt:170788477305
5775275,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,},Annotations:map[string]string{io.kubernetes.container.hash: 7d8a0274,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426,PodSandboxId:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:3,},Image:&ImageSpec{Image:d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:a5352bf791d1f99a5175e68039fe9bf100ca3dfd2400901a3a5e9bf0c8b03203,State:CONTAINER_RUNNING,CreatedAt:17078
84772932735101,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,},Annotations:map[string]string{io.kubernetes.container.hash: f18bb92e,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280,PodSandboxId:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:1d6d10016794014c57a966c3c40b351e068202efa97e3fec2d3387198e0cbad0,State:CONTAINER_RUNNING,CreatedA
t:1707884772738087522,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,},Annotations:map[string]string{io.kubernetes.container.hash: 67b5ed48,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26,PodSandboxId:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:061a72677dc6dc85cdb47cf61f4453c9be173c19c3d48e04b1d7a25f9b405fe7,State:CONTAINER_RUNNING,CreatedAt:1707884772608071364,Labels:ma
p[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,},Annotations:map[string]string{io.kubernetes.container.hash: 2d1fedde,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=23ac7709-ab38-41a9-bfb3-802b76415f30 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.780010584Z" level=debug msg="Request: &ListPodSandboxRequest{Filter:nil,}" file="go-grpc-middleware/chain.go:25" id=8fc9840a-7e18-4b8b-ba03-3b2af0bbee8d name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.780384416Z" level=debug msg="Response: &ListPodSandboxResponse{Items:[]*PodSandbox{&PodSandbox{Id:985701fa39a371cbb8dc19414edd3d256b07edb11659da86b3f02774770ccf6c,Metadata:&PodSandboxMetadata{Name:metrics-server-57f55c9bc5-rkc5k,Uid:a40d07fe-4d4e-4492-b885-56e374360de1,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884796556976543,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: metrics-server-57f55c9bc5-rkc5k,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a40d07fe-4d4e-4492-b885-56e374360de1,k8s-app: metrics-server,pod-template-hash: 57f55c9bc5,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T04:26:36.204061221Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&PodSandboxMetadata{Name:storage-provisioner,Uid:5233420f-4207-41fb-86dc-1fa430d52add,Na
mespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884796532147062,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,integration-test: storage-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volu
mes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n,kubernetes.io/config.seen: 2024-02-14T04:26:36.190232570Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&PodSandboxMetadata{Name:coredns-76f75df574-4zm9s,Uid:729cf388-b804-4317-bea5-03628f7f8421,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884795119540837,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,k8s-app: kube-dns,pod-template-hash: 76f75df574,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T04:26:34.784540421Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&PodSandboxMetadata{Name:coredns-76f75df574-m2q5f,Uid:a9dbacf5-755b-4ccd-
8d8d-35e0ab14f8de,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884795083571160,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de,k8s-app: kube-dns,pod-template-hash: 76f75df574,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T04:26:34.747212069Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&PodSandboxMetadata{Name:kube-proxy-66w6n,Uid:56d3be00-ea72-4583-860c-4649713362d6,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884794692199175,Labels:map[string]string{controller-revision-hash: 79c5f556d9,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,k8s-app: kube-proxy,pod-temp
late-generation: 1,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-02-14T04:26:34.342167048Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&PodSandboxMetadata{Name:etcd-no-preload-527067,Uid:8227638d79e3db5a9df339d5be757d2a,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884772014349083,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/etcd.advertise-client-urls: https://192.168.39.167:2379,kubernetes.io/config.hash: 8227638d79e3db5a9df339d5be757d2a,kubernetes.io/config.seen: 2024-02-14T04:26:11.471821488Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Met
adata:&PodSandboxMetadata{Name:kube-scheduler-no-preload-527067,Uid:d3faac842405bf4a37380c2a6cf39110,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884772008817669,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: d3faac842405bf4a37380c2a6cf39110,kubernetes.io/config.seen: 2024-02-14T04:26:11.471827389Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&PodSandboxMetadata{Name:kube-controller-manager-no-preload-527067,Uid:2576efbbd4a198b9d947922614db88d2,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884771988246645,Labels:map[string]string{component: kube-controller-manager,io.kubernetes.container.name: POD,io.ku
bernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 2576efbbd4a198b9d947922614db88d2,kubernetes.io/config.seen: 2024-02-14T04:26:11.471826457Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&PodSandboxMetadata{Name:kube-apiserver-no-preload-527067,Uid:403972ae81cbd2b974a8d63b02cf288e,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1707884771942316556,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.39.167:844
3,kubernetes.io/config.hash: 403972ae81cbd2b974a8d63b02cf288e,kubernetes.io/config.seen: 2024-02-14T04:26:11.471825385Z,kubernetes.io/config.source: file,},RuntimeHandler:,},},}" file="go-grpc-middleware/chain.go:25" id=8fc9840a-7e18-4b8b-ba03-3b2af0bbee8d name=/runtime.v1.RuntimeService/ListPodSandbox
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.781586416Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=398c3b03-18e5-47fc-b35b-1db62c242fcc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.781655351Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=398c3b03-18e5-47fc-b35b-1db62c242fcc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.781967229Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684,PodSandboxId:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:eaba9cb00c07766583bd527cc3d4dbf002c2587dcee4952d2ee56e8562346651,State:CONTAINER_RUNNING,CreatedAt:1707884798096609424,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{io.kubernetes.container.hash: 661b70a3,io.kubernetes.container.restartCount: 0,io.kube
rnetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331,PodSandboxId:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:eba727be6ca4938cb3deec2eb6b7767e33995b2083144b23a8bbd138515b0dac,State:CONTAINER_RUNNING,CreatedAt:1707884797678437642,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,},Annotations:map[string]string{io.kubernetes.container.hash: 44829cc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09,PodSandboxId:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884797041968111,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,},Annotations:map[string]string{io.kubernetes.container.hash: ee12eb91,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-t
cp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4,PodSandboxId:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884796912060673,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8
d8d-35e0ab14f8de,},Annotations:map[string]string{io.kubernetes.container.hash: 7e31045f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b,PodSandboxId:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:a9aa934e24e72ecc1829948966f500cf16b2faa6b63de15f1b6de03cc074812f,State:CONTAINER_RUNNING,CreatedAt:170788477305
5775275,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,},Annotations:map[string]string{io.kubernetes.container.hash: 7d8a0274,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426,PodSandboxId:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:3,},Image:&ImageSpec{Image:d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:a5352bf791d1f99a5175e68039fe9bf100ca3dfd2400901a3a5e9bf0c8b03203,State:CONTAINER_RUNNING,CreatedAt:17078
84772932735101,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,},Annotations:map[string]string{io.kubernetes.container.hash: f18bb92e,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280,PodSandboxId:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:1d6d10016794014c57a966c3c40b351e068202efa97e3fec2d3387198e0cbad0,State:CONTAINER_RUNNING,CreatedA
t:1707884772738087522,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,},Annotations:map[string]string{io.kubernetes.container.hash: 67b5ed48,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26,PodSandboxId:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:061a72677dc6dc85cdb47cf61f4453c9be173c19c3d48e04b1d7a25f9b405fe7,State:CONTAINER_RUNNING,CreatedAt:1707884772608071364,Labels:ma
p[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,},Annotations:map[string]string{io.kubernetes.container.hash: 2d1fedde,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=398c3b03-18e5-47fc-b35b-1db62c242fcc name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.783627710Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=dbf4230e-4a9c-42b7-a51b-2674cf231bfc name=/runtime.v1.RuntimeService/Version
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.783695286Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=dbf4230e-4a9c-42b7-a51b-2674cf231bfc name=/runtime.v1.RuntimeService/Version
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.786538463Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=e529f903-2005-432b-9b65-6137179912cb name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.786975757Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885636786869466,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:97830,},InodesUsed:&UInt64Value{Value:49,},},},}" file="go-grpc-middleware/chain.go:25" id=e529f903-2005-432b-9b65-6137179912cb name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.787671944Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=940d7b7b-0efb-4fc6-8608-d51202974247 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.787714683Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=940d7b7b-0efb-4fc6-8608-d51202974247 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.790260738Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684,PodSandboxId:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:eaba9cb00c07766583bd527cc3d4dbf002c2587dcee4952d2ee56e8562346651,State:CONTAINER_RUNNING,CreatedAt:1707884798096609424,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{io.kubernetes.container.hash: 661b70a3,io.kubernetes.container.restartCount: 0,io.kube
rnetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331,PodSandboxId:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:eba727be6ca4938cb3deec2eb6b7767e33995b2083144b23a8bbd138515b0dac,State:CONTAINER_RUNNING,CreatedAt:1707884797678437642,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,},Annotations:map[string]string{io.kubernetes.container.hash: 44829cc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09,PodSandboxId:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884797041968111,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,},Annotations:map[string]string{io.kubernetes.container.hash: ee12eb91,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-t
cp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4,PodSandboxId:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884796912060673,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8
d8d-35e0ab14f8de,},Annotations:map[string]string{io.kubernetes.container.hash: 7e31045f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b,PodSandboxId:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:a9aa934e24e72ecc1829948966f500cf16b2faa6b63de15f1b6de03cc074812f,State:CONTAINER_RUNNING,CreatedAt:170788477305
5775275,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,},Annotations:map[string]string{io.kubernetes.container.hash: 7d8a0274,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426,PodSandboxId:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:3,},Image:&ImageSpec{Image:d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:a5352bf791d1f99a5175e68039fe9bf100ca3dfd2400901a3a5e9bf0c8b03203,State:CONTAINER_RUNNING,CreatedAt:17078
84772932735101,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,},Annotations:map[string]string{io.kubernetes.container.hash: f18bb92e,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280,PodSandboxId:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:1d6d10016794014c57a966c3c40b351e068202efa97e3fec2d3387198e0cbad0,State:CONTAINER_RUNNING,CreatedA
t:1707884772738087522,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,},Annotations:map[string]string{io.kubernetes.container.hash: 67b5ed48,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26,PodSandboxId:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:061a72677dc6dc85cdb47cf61f4453c9be173c19c3d48e04b1d7a25f9b405fe7,State:CONTAINER_RUNNING,CreatedAt:1707884772608071364,Labels:ma
p[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,},Annotations:map[string]string{io.kubernetes.container.hash: 2d1fedde,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=940d7b7b-0efb-4fc6-8608-d51202974247 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.841581623Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=bf2b4989-6882-48eb-bb1a-29e7e5b28127 name=/runtime.v1.RuntimeService/Version
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.841678949Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=bf2b4989-6882-48eb-bb1a-29e7e5b28127 name=/runtime.v1.RuntimeService/Version
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.843515828Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=4a98cde9-9b7a-4a7c-8945-4f9b610fa9d9 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.843854109Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885636843840730,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:97830,},InodesUsed:&UInt64Value{Value:49,},},},}" file="go-grpc-middleware/chain.go:25" id=4a98cde9-9b7a-4a7c-8945-4f9b610fa9d9 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.844730427Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=b742006b-1293-4b67-aa0e-febc97d892aa name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.844772567Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=b742006b-1293-4b67-aa0e-febc97d892aa name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:40:36 no-preload-527067 crio[731]: time="2024-02-14 04:40:36.844995745Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684,PodSandboxId:1d04d5e343d851c5345a04baf0dbe009aed7127cad6cbb18abe5549afc757a89,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:eaba9cb00c07766583bd527cc3d4dbf002c2587dcee4952d2ee56e8562346651,State:CONTAINER_RUNNING,CreatedAt:1707884798096609424,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5233420f-4207-41fb-86dc-1fa430d52add,},Annotations:map[string]string{io.kubernetes.container.hash: 661b70a3,io.kubernetes.container.restartCount: 0,io.kube
rnetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331,PodSandboxId:08bc41dabd07eae9ec622987932bf12148131fa554376de9f0236ee34df23e46,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-proxy@sha256:eba727be6ca4938cb3deec2eb6b7767e33995b2083144b23a8bbd138515b0dac,State:CONTAINER_RUNNING,CreatedAt:1707884797678437642,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-66w6n,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 56d3be00-ea72-4583-860c-4649713362d6,},Annotations:map[string]string{io.kubernetes.container.hash: 44829cc5,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09,PodSandboxId:7730f1fd8b5a1e5e258406e1357d3e38c732a86c4fc34a8b3bb996a9badaab77,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884797041968111,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-4zm9s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 729cf388-b804-4317-bea5-03628f7f8421,},Annotations:map[string]string{io.kubernetes.container.hash: ee12eb91,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-t
cp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4,PodSandboxId:ceb975adcbfba635eb493c1b2239d1bc78c371a8e670001bfe6e55ffbd79abdf,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},},ImageRef:registry.k8s.io/coredns/coredns@sha256:5a532505a3ed89827ff6d357b23a8eb2e7b6ad25e4cfd2d46bcedbf22b812e58,State:CONTAINER_RUNNING,CreatedAt:1707884796912060673,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-76f75df574-m2q5f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: a9dbacf5-755b-4ccd-8
d8d-35e0ab14f8de,},Annotations:map[string]string{io.kubernetes.container.hash: 7e31045f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b,PodSandboxId:577d2f2f4c947a21bdac9d51f74e33ce4695533df011685157cd27dd8da43906,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:2,},Image:&ImageSpec{Image:4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-scheduler@sha256:a9aa934e24e72ecc1829948966f500cf16b2faa6b63de15f1b6de03cc074812f,State:CONTAINER_RUNNING,CreatedAt:170788477305
5775275,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d3faac842405bf4a37380c2a6cf39110,},Annotations:map[string]string{io.kubernetes.container.hash: 7d8a0274,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426,PodSandboxId:14b3f04a24ffba59177d2c31ed896f7cdd0ec344d3242f56c0d1e043b17c6f3e,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:3,},Image:&ImageSpec{Image:d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-controller-manager@sha256:a5352bf791d1f99a5175e68039fe9bf100ca3dfd2400901a3a5e9bf0c8b03203,State:CONTAINER_RUNNING,CreatedAt:17078
84772932735101,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2576efbbd4a198b9d947922614db88d2,},Annotations:map[string]string{io.kubernetes.container.hash: f18bb92e,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280,PodSandboxId:e35ac772147d26c4c640dd22dadcb01c722a70fd4f8da0637740188735bd28f2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:3,},Image:&ImageSpec{Image:bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f,Annotations:map[string]string{},},ImageRef:registry.k8s.io/kube-apiserver@sha256:1d6d10016794014c57a966c3c40b351e068202efa97e3fec2d3387198e0cbad0,State:CONTAINER_RUNNING,CreatedA
t:1707884772738087522,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 403972ae81cbd2b974a8d63b02cf288e,},Annotations:map[string]string{io.kubernetes.container.hash: 67b5ed48,io.kubernetes.container.restartCount: 3,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26,PodSandboxId:13e9eb5c5984a6c0d845d4fca937aa1c3aede562f8b7e7049127335bf6c88fa6,Metadata:&ContainerMetadata{Name:etcd,Attempt:2,},Image:&ImageSpec{Image:a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7,Annotations:map[string]string{},},ImageRef:registry.k8s.io/etcd@sha256:061a72677dc6dc85cdb47cf61f4453c9be173c19c3d48e04b1d7a25f9b405fe7,State:CONTAINER_RUNNING,CreatedAt:1707884772608071364,Labels:ma
p[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-no-preload-527067,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8227638d79e3db5a9df339d5be757d2a,},Annotations:map[string]string{io.kubernetes.container.hash: 2d1fedde,io.kubernetes.container.restartCount: 2,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=b742006b-1293-4b67-aa0e-febc97d892aa name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
6b7794264a9e6 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 13 minutes ago Running storage-provisioner 0 1d04d5e343d85 storage-provisioner
e0981ccfd847c cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834 13 minutes ago Running kube-proxy 0 08bc41dabd07e kube-proxy-66w6n
92ac4be8b9956 cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 13 minutes ago Running coredns 0 7730f1fd8b5a1 coredns-76f75df574-4zm9s
806377c72df58 cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 14 minutes ago Running coredns 0 ceb975adcbfba coredns-76f75df574-m2q5f
924a828e19eeb 4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210 14 minutes ago Running kube-scheduler 2 577d2f2f4c947 kube-scheduler-no-preload-527067
9a84b74b19347 d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d 14 minutes ago Running kube-controller-manager 3 14b3f04a24ffb kube-controller-manager-no-preload-527067
bc8ea9ceb189e bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f 14 minutes ago Running kube-apiserver 3 e35ac772147d2 kube-apiserver-no-preload-527067
ec7eb461f00f4 a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7 14 minutes ago Running etcd 2 13e9eb5c5984a etcd-no-preload-527067
==> coredns [806377c72df582fdd9ce9b69fe51b17667c6c955d24b7ae74bd7ae7f04ed9aa4] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.11.1
linux/amd64, go1.20.7, ae2bbc2
==> coredns [92ac4be8b9956f4401855e20740d9eb11ec85c3fab500a83207cd88a2c656e09] <==
.:53
[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908
CoreDNS-1.11.1
linux/amd64, go1.20.7, ae2bbc2
==> describe nodes <==
Name: no-preload-527067
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=no-preload-527067
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=no-preload-527067
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_26_20_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:26:17 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: no-preload-527067
AcquireTime: <unset>
RenewTime: Wed, 14 Feb 2024 04:40:36 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:36:54 +0000 Wed, 14 Feb 2024 04:26:14 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:36:54 +0000 Wed, 14 Feb 2024 04:26:14 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:36:54 +0000 Wed, 14 Feb 2024 04:26:14 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:36:54 +0000 Wed, 14 Feb 2024 04:26:30 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.167
Hostname: no-preload-527067
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 147390bdcbe54d888a0f22cbecd5e708
System UUID: 147390bd-cbe5-4d88-8a0f-22cbecd5e708
Boot ID: 390007b1-055b-4493-b72f-4532d086c028
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.29.0-rc.2
Kube-Proxy Version: v1.29.0-rc.2
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-76f75df574-4zm9s 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 14m
kube-system coredns-76f75df574-m2q5f 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 14m
kube-system etcd-no-preload-527067 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 14m
kube-system kube-apiserver-no-preload-527067 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 14m
kube-system kube-controller-manager-no-preload-527067 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 14m
kube-system kube-proxy-66w6n 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 14m
kube-system kube-scheduler-no-preload-527067 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 14m
kube-system metrics-server-57f55c9bc5-rkc5k 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (9%!)(MISSING) 0 (0%!)(MISSING) 14m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 14m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 0 (0%!)(MISSING)
memory 440Mi (20%!)(MISSING) 340Mi (16%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 13m kube-proxy
Normal Starting 14m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 14m (x8 over 14m) kubelet Node no-preload-527067 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 14m (x8 over 14m) kubelet Node no-preload-527067 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 14m (x7 over 14m) kubelet Node no-preload-527067 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 14m kubelet Updated Node Allocatable limit across pods
Normal Starting 14m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 14m kubelet Node no-preload-527067 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 14m kubelet Node no-preload-527067 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 14m kubelet Node no-preload-527067 status is now: NodeHasSufficientPID
Normal NodeNotReady 14m kubelet Node no-preload-527067 status is now: NodeNotReady
Normal NodeAllocatableEnforced 14m kubelet Updated Node Allocatable limit across pods
Normal NodeReady 14m kubelet Node no-preload-527067 status is now: NodeReady
Normal RegisteredNode 14m node-controller Node no-preload-527067 event: Registered Node no-preload-527067 in Controller
==> dmesg <==
[Feb14 04:20] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.071797] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.413622] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.479112] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.151272] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.465715] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +7.198212] systemd-fstab-generator[656]: Ignoring "noauto" for root device
[ +0.096909] systemd-fstab-generator[667]: Ignoring "noauto" for root device
[ +0.131454] systemd-fstab-generator[680]: Ignoring "noauto" for root device
[ +0.126971] systemd-fstab-generator[691]: Ignoring "noauto" for root device
[ +0.230874] systemd-fstab-generator[715]: Ignoring "noauto" for root device
[ +17.021750] systemd-fstab-generator[1227]: Ignoring "noauto" for root device
[ +2.229578] systemd-fstab-generator[1351]: Ignoring "noauto" for root device
[Feb14 04:21] kauditd_printk_skb: 29 callbacks suppressed
[Feb14 04:26] systemd-fstab-generator[4067]: Ignoring "noauto" for root device
[ +9.265074] systemd-fstab-generator[4390]: Ignoring "noauto" for root device
[ +14.452403] systemd-fstab-generator[4609]: Ignoring "noauto" for root device
[ +0.418474] kauditd_printk_skb: 2 callbacks suppressed
==> etcd [ec7eb461f00f4fa4147e475687be1889085d1f79355afcc718bd0ffbfb102e26] <==
{"level":"info","ts":"2024-02-14T04:26:14.654817Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"20d5e93d92ee8fac","initial-advertise-peer-urls":["https://192.168.39.167:2380"],"listen-peer-urls":["https://192.168.39.167:2380"],"advertise-client-urls":["https://192.168.39.167:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.39.167:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-02-14T04:26:14.654972Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-02-14T04:26:15.549979Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac is starting a new election at term 1"}
{"level":"info","ts":"2024-02-14T04:26:15.55008Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac became pre-candidate at term 1"}
{"level":"info","ts":"2024-02-14T04:26:15.550194Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac received MsgPreVoteResp from 20d5e93d92ee8fac at term 1"}
{"level":"info","ts":"2024-02-14T04:26:15.550228Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac became candidate at term 2"}
{"level":"info","ts":"2024-02-14T04:26:15.550259Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac received MsgVoteResp from 20d5e93d92ee8fac at term 2"}
{"level":"info","ts":"2024-02-14T04:26:15.550295Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"20d5e93d92ee8fac became leader at term 2"}
{"level":"info","ts":"2024-02-14T04:26:15.550328Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 20d5e93d92ee8fac elected leader 20d5e93d92ee8fac at term 2"}
{"level":"info","ts":"2024-02-14T04:26:15.55736Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:26:15.558994Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"20d5e93d92ee8fac","local-member-attributes":"{Name:no-preload-527067 ClientURLs:[https://192.168.39.167:2379]}","request-path":"/0/members/20d5e93d92ee8fac/attributes","cluster-id":"31f708155da0e645","publish-timeout":"7s"}
{"level":"info","ts":"2024-02-14T04:26:15.559264Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:26:15.572444Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-02-14T04:26:15.575666Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"31f708155da0e645","local-member-id":"20d5e93d92ee8fac","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:26:15.575763Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:26:15.575793Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-02-14T04:26:15.577524Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-02-14T04:26:15.577583Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-02-14T04:26:15.581976Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-02-14T04:26:15.603303Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.167:2379"}
{"level":"info","ts":"2024-02-14T04:36:15.666784Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":715}
{"level":"info","ts":"2024-02-14T04:36:15.669266Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":715,"took":"2.062355ms","hash":1564096052}
{"level":"info","ts":"2024-02-14T04:36:15.669354Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1564096052,"revision":715,"compact-revision":-1}
{"level":"info","ts":"2024-02-14T04:40:23.275183Z","caller":"traceutil/trace.go:171","msg":"trace[1097371951] transaction","detail":"{read_only:false; response_revision:1160; number_of_response:1; }","duration":"114.259111ms","start":"2024-02-14T04:40:23.160873Z","end":"2024-02-14T04:40:23.275132Z","steps":["trace[1097371951] 'process raft request' (duration: 114.156423ms)"],"step_count":1}
{"level":"info","ts":"2024-02-14T04:40:25.464328Z","caller":"traceutil/trace.go:171","msg":"trace[81234463] transaction","detail":"{read_only:false; response_revision:1161; number_of_response:1; }","duration":"180.578747ms","start":"2024-02-14T04:40:25.283734Z","end":"2024-02-14T04:40:25.464313Z","steps":["trace[81234463] 'process raft request' (duration: 180.393388ms)"],"step_count":1}
==> kernel <==
04:40:37 up 20 min, 0 users, load average: 0.16, 0.23, 0.26
Linux no-preload-527067 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [bc8ea9ceb189ec7c538d54eb670fff43bc3c0a2880ef16bf1ea5f547817d2280] <==
I0214 04:34:18.255238 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:36:17.258264 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:36:17.258606 1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
W0214 04:36:18.258823 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:36:18.258999 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:36:18.259035 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:36:18.259096 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:36:18.259151 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:36:18.260229 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:37:18.260061 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:37:18.260175 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:37:18.260184 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:37:18.261371 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:37:18.261421 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:37:18.261430 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:39:18.260983 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:39:18.261216 1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:39:18.261228 1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
W0214 04:39:18.262269 1 handler_proxy.go:93] no RequestInfo found in the context
E0214 04:39:18.262376 1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
I0214 04:39:18.262413 1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
==> kube-controller-manager [9a84b74b19347bbb7967e06bf11cc2c465de017251d9e7d99dbc7928db86c426] <==
I0214 04:35:04.360704 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:35:33.841763 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:35:34.374116 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:36:03.847957 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:36:04.382281 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:36:33.854064 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:36:34.393581 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:37:03.859164 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:37:04.401640 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:37:33.865192 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:37:34.410551 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
I0214 04:37:49.699276 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="482.38µs"
I0214 04:38:03.695406 1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-57f55c9bc5" duration="94.388µs"
E0214 04:38:03.871800 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:38:04.419641 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:38:33.883471 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:38:34.429339 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:39:03.891404 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:39:04.443312 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:39:33.900414 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:39:34.453257 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:40:03.907507 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:40:04.463653 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
E0214 04:40:33.912853 1 resource_quota_controller.go:440] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1
I0214 04:40:34.472732 1 garbagecollector.go:835] "failed to discover some groups" groups="<internal error: json: unsupported type: map[schema.GroupVersion]error>"
==> kube-proxy [e0981ccfd847c44d9830317034f1a9a464da7f6a14f2d3b678116ff7d6c96331] <==
I0214 04:26:38.203652 1 server_others.go:72] "Using iptables proxy"
I0214 04:26:38.236160 1 server.go:1050] "Successfully retrieved node IP(s)" IPs=["192.168.39.167"]
I0214 04:26:38.300786 1 server_others.go:146] "No iptables support for family" ipFamily="IPv6"
I0214 04:26:38.300865 1 server.go:654] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I0214 04:26:38.300999 1 server_others.go:168] "Using iptables Proxier"
I0214 04:26:38.342214 1 proxier.go:246] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0214 04:26:38.342445 1 server.go:865] "Version info" version="v1.29.0-rc.2"
I0214 04:26:38.342458 1 server.go:867] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0214 04:26:38.344034 1 config.go:188] "Starting service config controller"
I0214 04:26:38.344125 1 shared_informer.go:311] Waiting for caches to sync for service config
I0214 04:26:38.344149 1 config.go:97] "Starting endpoint slice config controller"
I0214 04:26:38.344153 1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
I0214 04:26:38.344680 1 config.go:315] "Starting node config controller"
I0214 04:26:38.345708 1 shared_informer.go:311] Waiting for caches to sync for node config
I0214 04:26:38.445067 1 shared_informer.go:318] Caches are synced for endpoint slice config
I0214 04:26:38.445076 1 shared_informer.go:318] Caches are synced for service config
I0214 04:26:38.446697 1 shared_informer.go:318] Caches are synced for node config
==> kube-scheduler [924a828e19eebbc87fdedb4dc0d4d7200489f1a0f7fd7d6743236307e1aed00b] <==
W0214 04:26:17.296720 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:26:17.297548 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 04:26:17.296755 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:17.301294 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 04:26:17.296464 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 04:26:17.301318 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0214 04:26:18.122935 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0214 04:26:18.123037 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
W0214 04:26:18.187992 1 reflector.go:539] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0214 04:26:18.188097 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
W0214 04:26:18.304456 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 04:26:18.304540 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0214 04:26:18.330536 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:26:18.330622 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
W0214 04:26:18.355346 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 04:26:18.355442 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0214 04:26:18.389592 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:18.389701 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0214 04:26:18.439174 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:26:18.439268 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
W0214 04:26:18.467123 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:26:18.467245 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0214 04:26:18.501144 1 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 04:26:18.501250 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
I0214 04:26:20.780782 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:20:08 UTC, ends at Wed 2024-02-14 04:40:37 UTC. --
Feb 14 04:38:03 no-preload-527067 kubelet[4397]: E0214 04:38:03.679137 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:38:16 no-preload-527067 kubelet[4397]: E0214 04:38:16.679359 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:38:20 no-preload-527067 kubelet[4397]: E0214 04:38:20.813723 4397 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:38:20 no-preload-527067 kubelet[4397]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:38:20 no-preload-527067 kubelet[4397]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:38:20 no-preload-527067 kubelet[4397]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:38:30 no-preload-527067 kubelet[4397]: E0214 04:38:30.680234 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:38:44 no-preload-527067 kubelet[4397]: E0214 04:38:44.679818 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:38:56 no-preload-527067 kubelet[4397]: E0214 04:38:56.680223 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:39:07 no-preload-527067 kubelet[4397]: E0214 04:39:07.679369 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:39:19 no-preload-527067 kubelet[4397]: E0214 04:39:19.679717 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:39:20 no-preload-527067 kubelet[4397]: E0214 04:39:20.815955 4397 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:39:20 no-preload-527067 kubelet[4397]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:39:20 no-preload-527067 kubelet[4397]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:39:20 no-preload-527067 kubelet[4397]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:39:32 no-preload-527067 kubelet[4397]: E0214 04:39:32.680319 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:39:45 no-preload-527067 kubelet[4397]: E0214 04:39:45.679639 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:39:58 no-preload-527067 kubelet[4397]: E0214 04:39:58.681699 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:40:13 no-preload-527067 kubelet[4397]: E0214 04:40:13.680107 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:40:20 no-preload-527067 kubelet[4397]: E0214 04:40:20.815569 4397 iptables.go:575] "Could not set up iptables canary" err=<
Feb 14 04:40:20 no-preload-527067 kubelet[4397]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Feb 14 04:40:20 no-preload-527067 kubelet[4397]: Perhaps ip6tables or your kernel needs to be upgraded.
Feb 14 04:40:20 no-preload-527067 kubelet[4397]: > table="nat" chain="KUBE-KUBELET-CANARY"
Feb 14 04:40:25 no-preload-527067 kubelet[4397]: E0214 04:40:25.680570 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
Feb 14 04:40:36 no-preload-527067 kubelet[4397]: E0214 04:40:36.680836 4397 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/registry.k8s.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-57f55c9bc5-rkc5k" podUID="a40d07fe-4d4e-4492-b885-56e374360de1"
==> storage-provisioner [6b7794264a9e6e1d751d20f0aa1b0b67197fd25ec1aea1cadb04245705fe1684] <==
I0214 04:26:38.263939 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 04:26:38.358230 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 04:26:38.358369 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 04:26:38.369420 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 04:26:38.369606 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_no-preload-527067_86f31ec5-cfdc-4404-882d-99538e04eb25!
I0214 04:26:38.370539 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"c571cf7e-2e5e-492d-9bcf-cf2719d1a943", APIVersion:"v1", ResourceVersion:"456", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' no-preload-527067_86f31ec5-cfdc-4404-882d-99538e04eb25 became leader
I0214 04:26:38.470675 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_no-preload-527067_86f31ec5-cfdc-4404-882d-99538e04eb25!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-527067 -n no-preload-527067
helpers_test.go:261: (dbg) Run: kubectl --context no-preload-527067 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-57f55c9bc5-rkc5k
helpers_test.go:274: ======> post-mortem[TestStartStop/group/no-preload/serial/AddonExistsAfterStop]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context no-preload-527067 describe pod metrics-server-57f55c9bc5-rkc5k
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context no-preload-527067 describe pod metrics-server-57f55c9bc5-rkc5k: exit status 1 (66.693423ms)
** stderr **
Error from server (NotFound): pods "metrics-server-57f55c9bc5-rkc5k" not found
** /stderr **
helpers_test.go:279: kubectl --context no-preload-527067 describe pod metrics-server-57f55c9bc5-rkc5k: exit status 1
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (294.20s)
=== RUN TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
E0214 04:38:52.698524 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:39:18.020784 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
start_stop_delete_test.go:287: ***** TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: pod "k8s-app=kubernetes-dashboard" failed to start within 9m0s: context deadline exceeded ****
start_stop_delete_test.go:287: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-960884 -n old-k8s-version-960884
start_stop_delete_test.go:287: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: showing logs for failed pods as of 2024-02-14 04:39:48.044596904 +0000 UTC m=+6705.009214514
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: k8s-app=kubernetes-dashboard within 9m0s: context deadline exceeded
start_stop_delete_test.go:291: (dbg) Run: kubectl --context old-k8s-version-960884 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-960884 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: context deadline exceeded (1.51µs)
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-960884 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": context deadline exceeded
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-960884 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-960884 logs -n 25: (1.662392803s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p bridge-528898 sudo cat | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | containerd config dump | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p bridge-528898 sudo | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p bridge-528898 sudo find | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:11 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p bridge-528898 sudo crio | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:11 UTC | 14 Feb 24 04:12 UTC |
| | config | | | | | |
| delete | -p bridge-528898 | bridge-528898 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| delete | -p | disable-driver-mounts-648156 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | disable-driver-mounts-648156 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:13 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable metrics-server -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | 14 Feb 24 04:12 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:12 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | 14 Feb 24 04:13 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:13 UTC | |
| | default-k8s-diff-port-224675 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-960884 | old-k8s-version-960884 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:28 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| addons | enable dashboard -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-527067 | no-preload-527067 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | 14 Feb 24 04:26 UTC |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| addons | enable dashboard -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:15 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-722906 | embed-certs-722906 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-224675 | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-224675 | jenkins | v1.32.0 | 14 Feb 24 04:16 UTC | 14 Feb 24 04:25 UTC |
| | default-k8s-diff-port-224675 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 04:16:21
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 04:16:21.016222 1548589 out.go:291] Setting OutFile to fd 1 ...
I0214 04:16:21.016364 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016373 1548589 out.go:304] Setting ErrFile to fd 2...
I0214 04:16:21.016378 1548589 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:16:21.016548 1548589 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:16:21.017128 1548589 out.go:298] Setting JSON to false
I0214 04:16:21.018088 1548589 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":25128,"bootTime":1707859053,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:16:21.018154 1548589 start.go:138] virtualization: kvm guest
I0214 04:16:21.020869 1548589 out.go:177] * [default-k8s-diff-port-224675] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:16:21.022663 1548589 notify.go:220] Checking for updates...
I0214 04:16:21.022671 1548589 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:16:21.024231 1548589 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:16:21.025835 1548589 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:16:21.027384 1548589 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:16:21.028899 1548589 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:16:21.030391 1548589 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:16:21.032286 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:16:21.032695 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.032740 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.048006 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36251
I0214 04:16:21.048486 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.049074 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.049097 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.049529 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.049715 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.049979 1548589 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:16:21.050268 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:16:21.050306 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:16:21.064529 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34885
I0214 04:16:21.064932 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:16:21.065386 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:16:21.065417 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:16:21.065713 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:16:21.065881 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:16:21.102150 1548589 out.go:177] * Using the kvm2 driver based on existing profile
I0214 04:16:21.104036 1548589 start.go:296] selected driver: kvm2
I0214 04:16:21.104047 1548589 start.go:900] validating driver "kvm2" against &{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisk
s:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.104144 1548589 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:16:21.104799 1548589 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.104878 1548589 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 04:16:21.119570 1548589 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 04:16:21.119934 1548589 start_flags.go:943] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:16:21.120000 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:16:21.120015 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:16:21.120050 1548589 start.go:339] cluster config:
{Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Names
pace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:16:21.120145 1548589 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 04:16:21.122309 1548589 out.go:177] * Starting "default-k8s-diff-port-224675" primary control-plane node in "default-k8s-diff-port-224675" cluster
I0214 04:16:20.509543 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:23.581533 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:21.123776 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:16:21.123806 1548589 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 04:16:21.123816 1548589 cache.go:56] Caching tarball of preloaded images
I0214 04:16:21.123877 1548589 preload.go:173] Found /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0214 04:16:21.123887 1548589 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0214 04:16:21.123977 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:16:21.124153 1548589 start.go:360] acquireMachinesLock for default-k8s-diff-port-224675: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:16:29.661593 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:32.733584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:38.813574 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:41.885576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:47.965558 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:51.037514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:16:57.117639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:00.189564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:06.269549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:09.341644 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:15.421514 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:18.493573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:24.573561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:27.645587 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:33.725630 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:36.797500 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:42.877547 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:45.949563 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:52.029594 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:17:55.101598 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:01.181611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:04.253573 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:10.333576 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:13.405584 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:19.485564 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:22.557519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:28.637560 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:31.709570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:37.789577 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:40.861658 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:46.941582 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:50.013561 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:56.093507 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:18:59.165639 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:05.245643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:08.317643 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:14.397568 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:17.469610 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:23.549636 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:26.621578 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:32.701570 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:35.773525 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:41.853530 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:44.925611 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:51.005519 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:54.077549 1548015 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.72.206:22: connect: no route to host
I0214 04:19:57.080691 1548199 start.go:364] duration metric: took 4m20.251500972s to acquireMachinesLock for "no-preload-527067"
I0214 04:19:57.080766 1548199 start.go:96] Skipping create...Using existing machine configuration
I0214 04:19:57.080773 1548199 fix.go:54] fixHost starting:
I0214 04:19:57.081118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:19:57.081148 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:19:57.096555 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44277
I0214 04:19:57.097002 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:19:57.097550 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:19:57.097577 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:19:57.097855 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:19:57.098034 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:19:57.098149 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:19:57.099876 1548199 fix.go:112] recreateIfNeeded on no-preload-527067: state=Stopped err=<nil>
I0214 04:19:57.099914 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
W0214 04:19:57.100102 1548199 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:19:57.102069 1548199 out.go:177] * Restarting existing kvm2 VM for "no-preload-527067" ...
I0214 04:19:57.077816 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:19:57.077865 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078255 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:19:57.078287 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:19:57.078566 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:19:57.080537 1548015 machine.go:97] duration metric: took 4m37.408761431s to provisionDockerMachine
I0214 04:19:57.080584 1548015 fix.go:56] duration metric: took 4m37.431215989s for fixHost
I0214 04:19:57.080596 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 4m37.431242855s
W0214 04:19:57.080624 1548015 start.go:713] error starting host: provision: host is not running
W0214 04:19:57.080748 1548015 out.go:239] ! StartHost failed, but will try again: provision: host is not running
I0214 04:19:57.080758 1548015 start.go:728] Will try again in 5 seconds ...
I0214 04:19:57.103328 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Start
I0214 04:19:57.103512 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring networks are active...
I0214 04:19:57.104245 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network default is active
I0214 04:19:57.104698 1548199 main.go:141] libmachine: (no-preload-527067) Ensuring network mk-no-preload-527067 is active
I0214 04:19:57.105038 1548199 main.go:141] libmachine: (no-preload-527067) Getting domain xml...
I0214 04:19:57.105698 1548199 main.go:141] libmachine: (no-preload-527067) Creating domain...
I0214 04:19:58.292262 1548199 main.go:141] libmachine: (no-preload-527067) Waiting to get IP...
I0214 04:19:58.293277 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.293718 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.293762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.293632 1549610 retry.go:31] will retry after 307.836827ms: waiting for machine to come up
I0214 04:19:58.603354 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.603935 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.603965 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.603876 1549610 retry.go:31] will retry after 375.894078ms: waiting for machine to come up
I0214 04:19:58.981513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:58.981981 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:58.982015 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:58.981916 1549610 retry.go:31] will retry after 451.678342ms: waiting for machine to come up
I0214 04:19:59.435521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.435921 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.435961 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.435861 1549610 retry.go:31] will retry after 481.719322ms: waiting for machine to come up
I0214 04:19:59.919474 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:19:59.919914 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:19:59.919949 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:19:59.919839 1549610 retry.go:31] will retry after 586.359357ms: waiting for machine to come up
I0214 04:20:00.507667 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:00.508169 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:00.508197 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:00.508112 1549610 retry.go:31] will retry after 703.740251ms: waiting for machine to come up
I0214 04:20:01.213009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:01.213504 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:01.213531 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:01.213452 1549610 retry.go:31] will retry after 979.462057ms: waiting for machine to come up
I0214 04:20:02.082344 1548015 start.go:360] acquireMachinesLock for old-k8s-version-960884: {Name:mk0cc11da688c4032ea6cfd697a6ebf20e4b3c0e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0214 04:20:02.194117 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:02.194497 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:02.194521 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:02.194467 1549610 retry.go:31] will retry after 1.278763641s: waiting for machine to come up
I0214 04:20:03.474465 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:03.474892 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:03.474922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:03.474853 1549610 retry.go:31] will retry after 1.500263985s: waiting for machine to come up
I0214 04:20:04.977136 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:04.977601 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:04.977627 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:04.977565 1549610 retry.go:31] will retry after 2.055604163s: waiting for machine to come up
I0214 04:20:07.036030 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:07.036483 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:07.036527 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:07.036415 1549610 retry.go:31] will retry after 2.711272112s: waiting for machine to come up
I0214 04:20:09.750977 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:09.751371 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:09.751404 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:09.751317 1549610 retry.go:31] will retry after 2.924789693s: waiting for machine to come up
I0214 04:20:12.678157 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:12.678553 1548199 main.go:141] libmachine: (no-preload-527067) DBG | unable to find current IP address of domain no-preload-527067 in network mk-no-preload-527067
I0214 04:20:12.678615 1548199 main.go:141] libmachine: (no-preload-527067) DBG | I0214 04:20:12.678494 1549610 retry.go:31] will retry after 3.785040141s: waiting for machine to come up
I0214 04:20:16.468466 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468926 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has current primary IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.468949 1548199 main.go:141] libmachine: (no-preload-527067) Found IP for machine: 192.168.39.167
I0214 04:20:16.468966 1548199 main.go:141] libmachine: (no-preload-527067) Reserving static IP address...
I0214 04:20:16.469414 1548199 main.go:141] libmachine: (no-preload-527067) Reserved static IP address: 192.168.39.167
I0214 04:20:16.469449 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.469476 1548199 main.go:141] libmachine: (no-preload-527067) Waiting for SSH to be available...
I0214 04:20:16.469513 1548199 main.go:141] libmachine: (no-preload-527067) DBG | skip adding static IP to network mk-no-preload-527067 - found existing host DHCP lease matching {name: "no-preload-527067", mac: "52:54:00:fa:89:aa", ip: "192.168.39.167"}
I0214 04:20:16.469530 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Getting to WaitForSSH function...
I0214 04:20:16.471450 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471707 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.471728 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.471812 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH client type: external
I0214 04:20:16.471845 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa (-rw-------)
I0214 04:20:16.471925 1548199 main.go:141] libmachine: (no-preload-527067) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.167 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:16.471947 1548199 main.go:141] libmachine: (no-preload-527067) DBG | About to run SSH command:
I0214 04:20:16.471958 1548199 main.go:141] libmachine: (no-preload-527067) DBG | exit 0
I0214 04:20:16.557177 1548199 main.go:141] libmachine: (no-preload-527067) DBG | SSH cmd err, output: <nil>:
I0214 04:20:16.557638 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetConfigRaw
I0214 04:20:16.558256 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.560907 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561244 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.561290 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.561493 1548199 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/config.json ...
I0214 04:20:16.561699 1548199 machine.go:94] provisionDockerMachine start ...
I0214 04:20:16.561722 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:16.561930 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.564237 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564637 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.564664 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.564864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.565051 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.565394 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.565620 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.565992 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.566004 1548199 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:16.673468 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:16.673502 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.673763 1548199 buildroot.go:166] provisioning hostname "no-preload-527067"
I0214 04:20:16.673799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.674010 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.676849 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677243 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.677291 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.677404 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.677612 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677784 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.677899 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.678062 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.678523 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.678543 1548199 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-527067 && echo "no-preload-527067" | sudo tee /etc/hostname
I0214 04:20:17.989797 1548416 start.go:364] duration metric: took 4m17.605388932s to acquireMachinesLock for "embed-certs-722906"
I0214 04:20:17.989877 1548416 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:17.989886 1548416 fix.go:54] fixHost starting:
I0214 04:20:17.990389 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:17.990441 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:18.007849 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36303
I0214 04:20:18.008367 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:18.008941 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:20:18.008970 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:18.009367 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:18.009556 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:18.009721 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:20:18.011258 1548416 fix.go:112] recreateIfNeeded on embed-certs-722906: state=Stopped err=<nil>
I0214 04:20:18.011289 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
W0214 04:20:18.011467 1548416 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:18.013874 1548416 out.go:177] * Restarting existing kvm2 VM for "embed-certs-722906" ...
I0214 04:20:16.797274 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-527067
I0214 04:20:16.797308 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.800396 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800762 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.800792 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.800948 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:16.801172 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801409 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:16.801569 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:16.801716 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:16.802024 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:16.802041 1548199 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-527067' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-527067/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-527067' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:16.921808 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:16.921851 1548199 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:16.921907 1548199 buildroot.go:174] setting up certificates
I0214 04:20:16.921921 1548199 provision.go:84] configureAuth start
I0214 04:20:16.921942 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetMachineName
I0214 04:20:16.922243 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:16.924941 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925246 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.925294 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.925448 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:16.927542 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.927839 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:16.927881 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:16.928073 1548199 provision.go:143] copyHostCerts
I0214 04:20:16.928185 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:16.928201 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:16.928289 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:16.928403 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:16.928413 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:16.928442 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:16.928502 1548199 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:16.928509 1548199 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:16.928529 1548199 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:16.928578 1548199 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.no-preload-527067 san=[127.0.0.1 192.168.39.167 localhost minikube no-preload-527067]
I0214 04:20:17.305617 1548199 provision.go:177] copyRemoteCerts
I0214 04:20:17.305690 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:17.305716 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.308699 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309038 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.309061 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.309268 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.309485 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.309657 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.309802 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.394912 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:17.416301 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0214 04:20:17.437138 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:17.457797 1548199 provision.go:87] duration metric: took 535.857617ms to configureAuth
I0214 04:20:17.457828 1548199 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:17.458050 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:20:17.458158 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.460939 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461355 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.461402 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.461525 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.461750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.461928 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.462085 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.462252 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.462572 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.462588 1548199 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:17.755399 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:17.755434 1548199 machine.go:97] duration metric: took 1.19371818s to provisionDockerMachine
I0214 04:20:17.755449 1548199 start.go:293] postStartSetup for "no-preload-527067" (driver="kvm2")
I0214 04:20:17.755463 1548199 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:17.755479 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.755812 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:17.755844 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.758654 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.758940 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.758993 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.759135 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.759342 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.759503 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.759639 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.842683 1548199 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:17.847099 1548199 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:17.847127 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:17.847225 1548199 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:17.847324 1548199 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:17.847427 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:17.855667 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:17.878842 1548199 start.go:296] duration metric: took 123.375783ms for postStartSetup
I0214 04:20:17.878892 1548199 fix.go:56] duration metric: took 20.79811795s for fixHost
I0214 04:20:17.878923 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.881702 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882009 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.882041 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.882222 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.882464 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882624 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.882782 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.882993 1548199 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:17.883487 1548199 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.39.167 22 <nil> <nil>}
I0214 04:20:17.883502 1548199 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:17.989605 1548199 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884417.936736993
I0214 04:20:17.989641 1548199 fix.go:216] guest clock: 1707884417.936736993
I0214 04:20:17.989651 1548199 fix.go:229] Guest: 2024-02-14 04:20:17.936736993 +0000 UTC Remote: 2024-02-14 04:20:17.878897601 +0000 UTC m=+281.200605630 (delta=57.839392ms)
I0214 04:20:17.989679 1548199 fix.go:200] guest clock delta is within tolerance: 57.839392ms
I0214 04:20:17.989697 1548199 start.go:83] releasing machines lock for "no-preload-527067", held for 20.908940374s
I0214 04:20:17.989737 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.990017 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:17.993106 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993551 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.993583 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.993750 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994292 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994496 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:20:17.994549 1548199 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:17.994608 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.994767 1548199 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:17.994851 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:20:17.997321 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997570 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997602 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997622 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.997736 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:17.997943 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.997968 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:17.998111 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:20:17.998159 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998305 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:17.998422 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:20:17.998602 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:20:17.998747 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:20:18.106735 1548199 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:18.112352 1548199 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:18.256984 1548199 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:18.262909 1548199 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:18.262978 1548199 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:18.279371 1548199 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:18.279399 1548199 start.go:494] detecting cgroup driver to use...
I0214 04:20:18.279462 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:18.294016 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:18.307013 1548199 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:18.307077 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:18.320441 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:18.334729 1548199 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:18.435265 1548199 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:18.543248 1548199 docker.go:233] disabling docker service ...
I0214 04:20:18.543333 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:18.555985 1548199 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:18.566967 1548199 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:18.680096 1548199 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:18.798889 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:18.813158 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:18.831387 1548199 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:18.831446 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.841300 1548199 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:18.841352 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.851097 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.860948 1548199 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:18.870710 1548199 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:18.880195 1548199 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:18.889041 1548199 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:18.889111 1548199 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:18.902760 1548199 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:18.912155 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:19.032843 1548199 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:19.218049 1548199 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:19.218136 1548199 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:19.223483 1548199 start.go:562] Will wait 60s for crictl version
I0214 04:20:19.223562 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.227341 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:19.269198 1548199 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:19.269316 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.314795 1548199 ssh_runner.go:195] Run: crio --version
I0214 04:20:19.363241 1548199 out.go:177] * Preparing Kubernetes v1.29.0-rc.2 on CRI-O 1.24.1 ...
I0214 04:20:18.015330 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Start
I0214 04:20:18.015514 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring networks are active...
I0214 04:20:18.016153 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network default is active
I0214 04:20:18.016585 1548416 main.go:141] libmachine: (embed-certs-722906) Ensuring network mk-embed-certs-722906 is active
I0214 04:20:18.017058 1548416 main.go:141] libmachine: (embed-certs-722906) Getting domain xml...
I0214 04:20:18.017739 1548416 main.go:141] libmachine: (embed-certs-722906) Creating domain...
I0214 04:20:19.267998 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting to get IP...
I0214 04:20:19.269071 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.269626 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.269744 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.269612 1549739 retry.go:31] will retry after 206.534163ms: waiting for machine to come up
I0214 04:20:19.478352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.478984 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.479109 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.479039 1549739 retry.go:31] will retry after 329.891336ms: waiting for machine to come up
I0214 04:20:19.810738 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:19.811201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:19.811225 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:19.811148 1549739 retry.go:31] will retry after 297.899998ms: waiting for machine to come up
I0214 04:20:20.110861 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.111307 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.111340 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.111260 1549739 retry.go:31] will retry after 483.120653ms: waiting for machine to come up
I0214 04:20:19.364761 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetIP
I0214 04:20:19.367698 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368111 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:20:19.368141 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:20:19.368326 1548199 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0214 04:20:19.372316 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:19.384595 1548199 kubeadm.go:877] updating cluster {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m
0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:19.384737 1548199 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 04:20:19.384782 1548199 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:19.428992 1548199 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.29.0-rc.2". assuming images are not preloaded.
I0214 04:20:19.429025 1548199 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.29.0-rc.2 registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 registry.k8s.io/kube-scheduler:v1.29.0-rc.2 registry.k8s.io/kube-proxy:v1.29.0-rc.2 registry.k8s.io/pause:3.9 registry.k8s.io/etcd:3.5.10-0 registry.k8s.io/coredns/coredns:v1.11.1 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.429150 1548199 image.go:134] retrieving image: registry.k8s.io/pause:3.9
I0214 04:20:19.429159 1548199 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.429177 1548199 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.429328 1548199 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.429332 1548199 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.429351 1548199 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.429129 1548199 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.431104 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.431106 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.431123 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.431216 1548199 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.431226 1548199 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
I0214 04:20:19.431239 1548199 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.431291 1548199 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.431826 1548199 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.613887 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.614261 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.626641 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.9
I0214 04:20:19.630913 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.638603 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.652797 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.654940 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.656778 1548199 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.698298 1548199 cache_images.go:116] "registry.k8s.io/etcd:3.5.10-0" needs transfer: "registry.k8s.io/etcd:3.5.10-0" does not exist at hash "a0eed15eed4498c145ef2f1883fcd300d7adbb759df73c901abd5383dda668e7" in container runtime
I0214 04:20:19.698355 1548199 cri.go:218] Removing image: registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.698414 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.757753 1548199 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" does not exist at hash "bbb47a0f83324722f97533f4e7ed308c71fea14e14b2461a2091e1366b402a2f" in container runtime
I0214 04:20:19.757810 1548199 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.757870 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941144 1548199 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" does not exist at hash "4270645ed6b7a4160357898afaff490096bc6032724fb0bf786bf0077bd37210" in container runtime
I0214 04:20:19.941166 1548199 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.11.1" needs transfer: "registry.k8s.io/coredns/coredns:v1.11.1" does not exist at hash "cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4" in container runtime
I0214 04:20:19.941188 1548199 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime
I0214 04:20:19.941198 1548199 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.941201 1548199 cri.go:218] Removing image: registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:19.941205 1548199 cri.go:218] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941337 1548199 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" does not exist at hash "d4e01cdf639708bfec87fe34854ad206f444e1d58d34defcb56feedbf1d57d3d" in container runtime
I0214 04:20:19.941247 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941382 1548199 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.941415 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941482 1548199 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.29.0-rc.2" needs transfer: "registry.k8s.io/kube-proxy:v1.29.0-rc.2" does not exist at hash "cc0a4f00aad7b5c96d0761b71161ecfa36338d1e4203c038c0edfbc38ce7b834" in container runtime
I0214 04:20:19.941506 1548199 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.941537 1548199 ssh_runner.go:195] Run: which crictl
I0214 04:20:19.941549 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.5.10-0
I0214 04:20:19.941643 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.29.0-rc.2
I0214 04:20:19.955388 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.29.0-rc.2
I0214 04:20:19.955421 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:20:19.969125 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
I0214 04:20:19.969198 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.29.0-rc.2
I0214 04:20:19.969166 1548199 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns/coredns:v1.11.1
I0214 04:20:20.061499 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
I0214 04:20:20.061591 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.061633 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.061699 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:20.094179 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094180 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
I0214 04:20:20.094312 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:20.094395 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:20.124555 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
I0214 04:20:20.124585 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124670 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:20.124703 1548199 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124677 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:20.124746 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/etcd_3.5.10-0 (exists)
I0214 04:20:20.124760 1548199 crio.go:257] Loading image: /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124793 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0
I0214 04:20:20.124803 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2 (exists)
I0214 04:20:20.124829 1548199 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:20.124877 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2 (exists)
I0214 04:20:20.124902 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/storage-provisioner_v5 (exists)
I0214 04:20:20.136587 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/coredns_v1.11.1 (exists)
I0214 04:20:20.136626 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2 (exists)
I0214 04:20:20.595903 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:20.596479 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:20.596504 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:20.596431 1549739 retry.go:31] will retry after 541.170149ms: waiting for machine to come up
I0214 04:20:21.139128 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.139587 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.139619 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.139543 1549739 retry.go:31] will retry after 609.736734ms: waiting for machine to come up
I0214 04:20:21.750821 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:21.751430 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:21.751476 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:21.751373 1549739 retry.go:31] will retry after 889.762874ms: waiting for machine to come up
I0214 04:20:22.642380 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:22.642915 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:22.642966 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:22.642850 1549739 retry.go:31] will retry after 1.310308388s: waiting for machine to come up
I0214 04:20:23.954650 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:23.955082 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:23.955114 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:23.955032 1549739 retry.go:31] will retry after 1.186449176s: waiting for machine to come up
I0214 04:20:25.143888 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:25.144379 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:25.144409 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:25.144331 1549739 retry.go:31] will retry after 1.870374645s: waiting for machine to come up
I0214 04:20:24.103814 1548199 ssh_runner.go:235] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (3.97895084s)
I0214 04:20:24.103870 1548199 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2 (exists)
I0214 04:20:24.104023 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/etcd_3.5.10-0: (3.979201042s)
I0214 04:20:24.104052 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 from cache
I0214 04:20:24.104094 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:24.104197 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2
I0214 04:20:27.017422 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:27.017923 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:27.017949 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:27.017821 1549739 retry.go:31] will retry after 2.372344988s: waiting for machine to come up
I0214 04:20:29.391597 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:29.392177 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:29.392212 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:29.392127 1549739 retry.go:31] will retry after 2.760319549s: waiting for machine to come up
I0214 04:20:27.189223 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-apiserver_v1.29.0-rc.2: (3.084990766s)
I0214 04:20:27.189276 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 from cache
I0214 04:20:27.189310 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:27.189404 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2
I0214 04:20:29.355802 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-proxy_v1.29.0-rc.2: (2.166363074s)
I0214 04:20:29.355840 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 from cache
I0214 04:20:29.355881 1548199 crio.go:257] Loading image: /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:29.355951 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/storage-provisioner_v5
I0214 04:20:30.013381 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
I0214 04:20:30.013438 1548199 crio.go:257] Loading image: /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:30.013501 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1
I0214 04:20:32.155254 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:32.155727 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | unable to find current IP address of domain embed-certs-722906 in network mk-embed-certs-722906
I0214 04:20:32.155753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | I0214 04:20:32.155677 1549739 retry.go:31] will retry after 4.524050008s: waiting for machine to come up
I0214 04:20:31.977727 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/coredns_v1.11.1: (1.964188552s)
I0214 04:20:31.977769 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 from cache
I0214 04:20:31.977802 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:31.977872 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2
I0214 04:20:34.535494 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-controller-manager_v1.29.0-rc.2: (2.557583724s)
I0214 04:20:34.535538 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 from cache
I0214 04:20:34.535571 1548199 crio.go:257] Loading image: /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:34.535624 1548199 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2
I0214 04:20:35.791070 1548199 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/kube-scheduler_v1.29.0-rc.2: (1.255414762s)
I0214 04:20:35.791122 1548199 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 from cache
I0214 04:20:35.791154 1548199 cache_images.go:123] Successfully loaded all cached images
I0214 04:20:35.791166 1548199 cache_images.go:92] duration metric: took 16.362124396s to LoadCachedImages
I0214 04:20:35.791179 1548199 kubeadm.go:928] updating node { 192.168.39.167 8443 v1.29.0-rc.2 crio true true} ...
I0214 04:20:35.791336 1548199 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.29.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-527067 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.167
[Install]
config:
{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:35.791437 1548199 ssh_runner.go:195] Run: crio config
I0214 04:20:35.848895 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:20:35.848923 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:35.848935 1548199 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:35.848985 1548199 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.167 APIServerPort:8443 KubernetesVersion:v1.29.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-527067 NodeName:no-preload-527067 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.167"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.167 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:35.849152 1548199 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.167
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-527067"
kubeletExtraArgs:
node-ip: 192.168.39.167
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.167"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.29.0-rc.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:35.849221 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.29.0-rc.2
I0214 04:20:35.859377 1548199 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:35.859443 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:35.868486 1548199 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
I0214 04:20:35.885091 1548199 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)
I0214 04:20:35.901749 1548199 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2166 bytes)
I0214 04:20:35.919596 1548199 ssh_runner.go:195] Run: grep 192.168.39.167 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:35.923203 1548199 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.167 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:35.934756 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:36.048443 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:36.063403 1548199 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067 for IP: 192.168.39.167
I0214 04:20:36.063423 1548199 certs.go:194] generating shared ca certs ...
I0214 04:20:36.063440 1548199 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:36.063607 1548199 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:36.063675 1548199 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:36.063691 1548199 certs.go:256] generating profile certs ...
I0214 04:20:36.063805 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/client.key
I0214 04:20:36.063903 1548199 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key.79c0eebd
I0214 04:20:36.063964 1548199 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key
I0214 04:20:36.064127 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:36.064168 1548199 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:36.064182 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:36.064220 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:36.064249 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:36.064281 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:36.064332 1548199 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:36.065313 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:36.101889 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:36.135234 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:36.168832 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:36.204188 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0214 04:20:36.230823 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0214 04:20:36.254917 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:36.282014 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/no-preload-527067/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:36.303131 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:36.323933 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:36.344419 1548199 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:36.365038 1548199 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:36.380645 1548199 ssh_runner.go:195] Run: openssl version
I0214 04:20:36.386091 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:36.395680 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399890 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.399959 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:36.405132 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:36.415168 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:36.424870 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.428976 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.429025 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:36.434401 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:36.443848 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:36.453658 1548199 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457908 1548199 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.457963 1548199 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:36.463066 1548199 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:36.472994 1548199 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:36.477141 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:36.482809 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:36.488342 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:36.493884 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:36.499087 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:36.504410 1548199 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:36.509751 1548199 kubeadm.go:391] StartCluster: {Name:no-preload-527067 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29
.0-rc.2 ClusterName:no-preload-527067 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s
Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:36.509849 1548199 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:36.509914 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.547323 1548199 cri.go:89] found id: ""
I0214 04:20:36.547408 1548199 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:36.556907 1548199 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:36.556928 1548199 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:36.556935 1548199 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:36.557012 1548199 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:36.566003 1548199 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:36.567328 1548199 kubeconfig.go:125] found "no-preload-527067" server: "https://192.168.39.167:8443"
I0214 04:20:36.570250 1548199 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:36.578772 1548199 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.167
I0214 04:20:36.578805 1548199 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:36.578819 1548199 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:36.578868 1548199 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:36.615271 1548199 cri.go:89] found id: ""
I0214 04:20:36.615369 1548199 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:36.631254 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:36.640513 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:36.640544 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:20:36.640605 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:36.649213 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:36.649289 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:36.658011 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:36.667277 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:36.667461 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:36.677535 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:36.686189 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:36.686248 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:36.696716 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:36.706405 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:36.706442 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:36.715622 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:36.725241 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.074017 1548589 start.go:364] duration metric: took 4m16.949827565s to acquireMachinesLock for "default-k8s-diff-port-224675"
I0214 04:20:38.074099 1548589 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:38.074107 1548589 fix.go:54] fixHost starting:
I0214 04:20:38.074546 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:38.074596 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:38.092223 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32909
I0214 04:20:38.092628 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:38.093091 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:20:38.093112 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:38.093545 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:38.093743 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:38.093902 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:20:38.095356 1548589 fix.go:112] recreateIfNeeded on default-k8s-diff-port-224675: state=Stopped err=<nil>
I0214 04:20:38.095385 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
W0214 04:20:38.095570 1548589 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:38.097728 1548589 out.go:177] * Restarting existing kvm2 VM for "default-k8s-diff-port-224675" ...
I0214 04:20:36.682303 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.682827 1548416 main.go:141] libmachine: (embed-certs-722906) Found IP for machine: 192.168.50.108
I0214 04:20:36.682865 1548416 main.go:141] libmachine: (embed-certs-722906) Reserving static IP address...
I0214 04:20:36.682884 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has current primary IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.683294 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.683326 1548416 main.go:141] libmachine: (embed-certs-722906) Reserved static IP address: 192.168.50.108
I0214 04:20:36.683352 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | skip adding static IP to network mk-embed-certs-722906 - found existing host DHCP lease matching {name: "embed-certs-722906", mac: "52:54:00:b9:19:4c", ip: "192.168.50.108"}
I0214 04:20:36.683370 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Getting to WaitForSSH function...
I0214 04:20:36.683386 1548416 main.go:141] libmachine: (embed-certs-722906) Waiting for SSH to be available...
I0214 04:20:36.685555 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.685877 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.685912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.686044 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH client type: external
I0214 04:20:36.686073 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa (-rw-------)
I0214 04:20:36.686108 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.108 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:36.686121 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | About to run SSH command:
I0214 04:20:36.686136 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | exit 0
I0214 04:20:36.777374 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | SSH cmd err, output: <nil>:
I0214 04:20:36.777749 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetConfigRaw
I0214 04:20:36.778583 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:36.781415 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.781891 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.781918 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.782292 1548416 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/config.json ...
I0214 04:20:36.782531 1548416 machine.go:94] provisionDockerMachine start ...
I0214 04:20:36.782576 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:36.782816 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.785327 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.785737 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.785996 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.786168 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786327 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.786501 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.786710 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.787196 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.787214 1548416 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:36.905657 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:36.905687 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.905964 1548416 buildroot.go:166] provisioning hostname "embed-certs-722906"
I0214 04:20:36.905990 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:36.906183 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:36.909442 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.909874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:36.909912 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:36.910070 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:36.910262 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910445 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:36.910582 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:36.910738 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:36.911264 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:36.911289 1548416 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-722906 && echo "embed-certs-722906" | sudo tee /etc/hostname
I0214 04:20:37.046181 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-722906
I0214 04:20:37.046216 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.049414 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.049785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.049819 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.050075 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.050291 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.050646 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.050842 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.051191 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.051235 1548416 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-722906' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-722906/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-722906' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:37.177589 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:37.177622 1548416 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:37.177646 1548416 buildroot.go:174] setting up certificates
I0214 04:20:37.177657 1548416 provision.go:84] configureAuth start
I0214 04:20:37.177668 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetMachineName
I0214 04:20:37.178023 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:37.181013 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181404 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.181435 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.181606 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.183959 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184300 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.184329 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.184472 1548416 provision.go:143] copyHostCerts
I0214 04:20:37.184534 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:37.184544 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:37.184594 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:37.184678 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:37.184685 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:37.184710 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:37.184785 1548416 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:37.184794 1548416 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:37.184813 1548416 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:37.184881 1548416 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.embed-certs-722906 san=[127.0.0.1 192.168.50.108 embed-certs-722906 localhost minikube]
I0214 04:20:37.334150 1548416 provision.go:177] copyRemoteCerts
I0214 04:20:37.334225 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:37.334258 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.336874 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337245 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.337299 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.337492 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.337693 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.337868 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.338016 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.424211 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:37.448257 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0214 04:20:37.472132 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:20:37.496606 1548416 provision.go:87] duration metric: took 318.923431ms to configureAuth
I0214 04:20:37.496633 1548416 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:37.496815 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:37.496904 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.499706 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500129 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.500174 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.500359 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.500566 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500738 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.500873 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.501094 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.501587 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.501614 1548416 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:37.814749 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:37.814781 1548416 machine.go:97] duration metric: took 1.032234304s to provisionDockerMachine
I0214 04:20:37.814796 1548416 start.go:293] postStartSetup for "embed-certs-722906" (driver="kvm2")
I0214 04:20:37.814811 1548416 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:37.814848 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:37.815206 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:37.815237 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.818201 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818621 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.818644 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.818819 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.819026 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.819221 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.819386 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:37.913636 1548416 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:37.919126 1548416 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:37.919153 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:37.919231 1548416 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:37.919328 1548416 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:37.919441 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:37.930902 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:37.955477 1548416 start.go:296] duration metric: took 140.651894ms for postStartSetup
I0214 04:20:37.955515 1548416 fix.go:56] duration metric: took 19.965630101s for fixHost
I0214 04:20:37.955546 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:37.958406 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.958844 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:37.958883 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:37.959025 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:37.959250 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959490 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:37.959647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:37.959876 1548416 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:37.960220 1548416 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.50.108 22 <nil> <nil>}
I0214 04:20:37.960236 1548416 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:38.073852 1548416 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884438.021225394
I0214 04:20:38.073878 1548416 fix.go:216] guest clock: 1707884438.021225394
I0214 04:20:38.073897 1548416 fix.go:229] Guest: 2024-02-14 04:20:38.021225394 +0000 UTC Remote: 2024-02-14 04:20:37.955524144 +0000 UTC m=+277.725419033 (delta=65.70125ms)
I0214 04:20:38.073926 1548416 fix.go:200] guest clock delta is within tolerance: 65.70125ms
I0214 04:20:38.073936 1548416 start.go:83] releasing machines lock for "embed-certs-722906", held for 20.084084933s
I0214 04:20:38.073965 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.074261 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:38.077151 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077577 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.077612 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.077814 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078403 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078604 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:20:38.078683 1548416 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:38.078733 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.078839 1548416 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:38.078867 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:20:38.081284 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081692 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.081758 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081784 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.081870 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082041 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082218 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082256 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:38.082293 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:38.082336 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.082457 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:20:38.082607 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:20:38.082726 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:20:38.082903 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:20:38.190317 1548416 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:38.196626 1548416 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:38.349673 1548416 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:38.356571 1548416 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:38.356677 1548416 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:38.377847 1548416 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:38.377877 1548416 start.go:494] detecting cgroup driver to use...
I0214 04:20:38.377956 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:38.395591 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:38.411254 1548416 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:38.411337 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:38.429922 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:38.446585 1548416 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:38.576797 1548416 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:38.708684 1548416 docker.go:233] disabling docker service ...
I0214 04:20:38.708752 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:38.723898 1548416 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:38.736512 1548416 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:38.864382 1548416 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:38.978645 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:38.995888 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:39.015920 1548416 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:39.015998 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.028138 1548416 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:39.028205 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.041203 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.054736 1548416 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:39.064851 1548416 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:39.074475 1548416 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:39.085772 1548416 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:39.085839 1548416 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:39.102669 1548416 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:39.117041 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:39.248406 1548416 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:39.438738 1548416 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:39.438820 1548416 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:39.445895 1548416 start.go:562] Will wait 60s for crictl version
I0214 04:20:39.445969 1548416 ssh_runner.go:195] Run: which crictl
I0214 04:20:39.450199 1548416 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:39.491583 1548416 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:39.491674 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.534681 1548416 ssh_runner.go:195] Run: crio --version
I0214 04:20:39.593285 1548416 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:39.594908 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetIP
I0214 04:20:39.598263 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.598753 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:20:39.598785 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:20:39.599034 1548416 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0214 04:20:39.603478 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:39.621148 1548416 kubeadm.go:877] updating cluster {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:
false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:39.621309 1548416 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:39.621379 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:39.676783 1548416 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:39.676909 1548416 ssh_runner.go:195] Run: which lz4
I0214 04:20:39.681410 1548416 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:39.686690 1548416 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:39.686727 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:20:38.099207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Start
I0214 04:20:38.099430 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring networks are active...
I0214 04:20:38.100228 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network default is active
I0214 04:20:38.100585 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Ensuring network mk-default-k8s-diff-port-224675 is active
I0214 04:20:38.101059 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Getting domain xml...
I0214 04:20:38.101854 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Creating domain...
I0214 04:20:39.454986 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting to get IP...
I0214 04:20:39.456025 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456576 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.456614 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.456520 1549871 retry.go:31] will retry after 292.69131ms: waiting for machine to come up
I0214 04:20:39.751334 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751908 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:39.751956 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:39.751858 1549871 retry.go:31] will retry after 340.869303ms: waiting for machine to come up
I0214 04:20:40.094535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095142 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.095169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.095051 1549871 retry.go:31] will retry after 293.465495ms: waiting for machine to come up
I0214 04:20:40.390912 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391346 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.391377 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.391290 1549871 retry.go:31] will retry after 457.62012ms: waiting for machine to come up
I0214 04:20:40.851151 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851616 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:40.851645 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:40.851547 1549871 retry.go:31] will retry after 539.345518ms: waiting for machine to come up
I0214 04:20:36.851047 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.089975 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.238873301s)
I0214 04:20:38.090005 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.309755 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.378436 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:38.478394 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:38.478509 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:38.979577 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.478754 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:39.979574 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.479243 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:40.978672 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:41.006970 1548199 api_server.go:72] duration metric: took 2.528578043s to wait for apiserver process to appear ...
I0214 04:20:41.007003 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:41.007024 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.008150 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:20:41.507776 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:41.762516 1548416 crio.go:444] duration metric: took 2.081156311s to copy over tarball
I0214 04:20:41.762608 1548416 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:20:44.980302 1548416 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.217656042s)
I0214 04:20:44.980335 1548416 crio.go:451] duration metric: took 3.217784443s to extract the tarball
I0214 04:20:44.980346 1548416 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:20:45.024706 1548416 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:45.082193 1548416 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:20:45.082217 1548416 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:20:45.082225 1548416 kubeadm.go:928] updating node { 192.168.50.108 8443 v1.28.4 crio true true} ...
I0214 04:20:45.082349 1548416 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-722906 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.50.108
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:20:45.082447 1548416 ssh_runner.go:195] Run: crio config
I0214 04:20:45.147931 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:45.147969 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:45.147982 1548416 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:20:45.148006 1548416 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.108 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-722906 NodeName:embed-certs-722906 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.108"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.108 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:20:45.148164 1548416 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.108
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-722906"
kubeletExtraArgs:
node-ip: 192.168.50.108
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.108"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:20:45.148232 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:20:45.158479 1548416 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:20:45.158553 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:20:45.167772 1548416 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)
I0214 04:20:45.184110 1548416 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:20:45.200469 1548416 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)
I0214 04:20:45.217332 1548416 ssh_runner.go:195] Run: grep 192.168.50.108 control-plane.minikube.internal$ /etc/hosts
I0214 04:20:45.221512 1548416 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.108 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:45.233317 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:41.392312 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:41.393904 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:41.393756 1549871 retry.go:31] will retry after 729.897424ms: waiting for machine to come up
I0214 04:20:42.125952 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126513 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:42.126542 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:42.126448 1549871 retry.go:31] will retry after 1.070487026s: waiting for machine to come up
I0214 04:20:43.198768 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199234 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:43.199269 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:43.199179 1549871 retry.go:31] will retry after 1.144751625s: waiting for machine to come up
I0214 04:20:44.345532 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345958 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:44.345989 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:44.345929 1549871 retry.go:31] will retry after 1.430046726s: waiting for machine to come up
I0214 04:20:45.778221 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778683 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:45.778713 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:45.778628 1549871 retry.go:31] will retry after 2.320641186s: waiting for machine to come up
I0214 04:20:46.508190 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:46.508231 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:45.341316 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:20:45.781473 1548416 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906 for IP: 192.168.50.108
I0214 04:20:45.781494 1548416 certs.go:194] generating shared ca certs ...
I0214 04:20:45.781513 1548416 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:20:45.781690 1548416 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:20:45.781760 1548416 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:20:45.781777 1548416 certs.go:256] generating profile certs ...
I0214 04:20:45.781960 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/client.key
I0214 04:20:45.782154 1548416 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key.de29a2e4
I0214 04:20:45.782215 1548416 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key
I0214 04:20:45.782395 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:20:45.782438 1548416 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:20:45.782453 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:20:45.782491 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:20:45.782537 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:20:45.782570 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:20:45.782625 1548416 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:45.783482 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:20:45.822613 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:20:45.853037 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:20:45.898215 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:20:45.938947 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0214 04:20:45.965143 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:20:45.994794 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:20:46.018374 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/embed-certs-722906/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:20:46.044018 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:20:46.067499 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:20:46.090920 1548416 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:20:46.114475 1548416 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:20:46.132051 1548416 ssh_runner.go:195] Run: openssl version
I0214 04:20:46.137746 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:20:46.147403 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152220 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.152298 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:20:46.158254 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:20:46.167536 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:20:46.179112 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184157 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.184219 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:20:46.190110 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:20:46.200066 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:20:46.210093 1548416 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214882 1548416 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.214955 1548416 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:20:46.220636 1548416 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:20:46.230395 1548416 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:20:46.235238 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:20:46.241337 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:20:46.247195 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:20:46.253414 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:20:46.259696 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:20:46.266214 1548416 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:20:46.272246 1548416 kubeadm.go:391] StartCluster: {Name:embed-certs-722906 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:embed-certs-722906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fal
se MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:20:46.272384 1548416 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:20:46.272458 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.322213 1548416 cri.go:89] found id: ""
I0214 04:20:46.322303 1548416 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:20:46.334965 1548416 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:20:46.334993 1548416 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:20:46.334999 1548416 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:20:46.335055 1548416 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:20:46.344493 1548416 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:20:46.345570 1548416 kubeconfig.go:125] found "embed-certs-722906" server: "https://192.168.50.108:8443"
I0214 04:20:46.347818 1548416 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:20:46.357313 1548416 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.50.108
I0214 04:20:46.357349 1548416 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:20:46.357365 1548416 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:20:46.357429 1548416 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:20:46.403854 1548416 cri.go:89] found id: ""
I0214 04:20:46.403945 1548416 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:20:46.418730 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:20:46.432468 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:20:46.432491 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:20:46.432541 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:20:46.441218 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:20:46.441346 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:20:46.450078 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:20:46.458158 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:20:46.458261 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:20:46.472089 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:20:46.480354 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:20:46.480425 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:20:46.489174 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:20:46.497321 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:20:46.497406 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:20:46.506204 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:20:46.517469 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:46.646342 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.587291 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.799709 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.882294 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:47.990798 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:20:47.990913 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.491970 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.991676 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.491048 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:49.991348 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:48.100608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:48.101169 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:48.101075 1549871 retry.go:31] will retry after 2.658096517s: waiting for machine to come up
I0214 04:20:50.762784 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:50.763407 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:50.763316 1549871 retry.go:31] will retry after 2.514722067s: waiting for machine to come up
I0214 04:20:51.508782 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:51.508854 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:50.491707 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:20:50.511999 1548416 api_server.go:72] duration metric: took 2.521202011s to wait for apiserver process to appear ...
I0214 04:20:50.512032 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:20:50.512056 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.915403 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:20:53.915447 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:20:53.915465 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:53.961623 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:53.961686 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[-]poststarthook/crd-informer-synced failed: reason withheld
[-]poststarthook/start-service-ip-repair-controllers failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[-]poststarthook/apiservice-registration-controller failed: reason withheld
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.012877 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.029797 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.029829 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[-]poststarthook/start-apiextensions-controllers failed: reason withheld
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:54.512349 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:54.517512 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:54.517539 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.013148 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.019019 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:20:55.019067 1548416 api_server.go:103] status: https://192.168.50.108:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:20:55.512961 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:20:55.520464 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:20:55.529064 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:20:55.529096 1548416 api_server.go:131] duration metric: took 5.017056759s to wait for apiserver health ...
I0214 04:20:55.529107 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:20:55.529117 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:20:55.531379 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:20:53.279582 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | unable to find current IP address of domain default-k8s-diff-port-224675 in network mk-default-k8s-diff-port-224675
I0214 04:20:53.280038 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | I0214 04:20:53.279941 1549871 retry.go:31] will retry after 3.362064709s: waiting for machine to come up
I0214 04:20:56.510005 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:20:56.510055 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:20:58.174260 1548015 start.go:364] duration metric: took 56.091842509s to acquireMachinesLock for "old-k8s-version-960884"
I0214 04:20:58.174320 1548015 start.go:96] Skipping create...Using existing machine configuration
I0214 04:20:58.174329 1548015 fix.go:54] fixHost starting:
I0214 04:20:58.174723 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:20:58.174759 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:20:58.194079 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41161
I0214 04:20:58.194519 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:20:58.195088 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:20:58.195119 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:20:58.195478 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:20:58.195686 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:20:58.195855 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:20:58.197422 1548015 fix.go:112] recreateIfNeeded on old-k8s-version-960884: state=Stopped err=<nil>
I0214 04:20:58.197454 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
W0214 04:20:58.197646 1548015 fix.go:138] unexpected machine state, will restart: <nil>
I0214 04:20:58.200239 1548015 out.go:177] * Restarting existing kvm2 VM for "old-k8s-version-960884" ...
I0214 04:20:58.201659 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Start
I0214 04:20:58.201846 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring networks are active...
I0214 04:20:58.202622 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network default is active
I0214 04:20:58.202951 1548015 main.go:141] libmachine: (old-k8s-version-960884) Ensuring network mk-old-k8s-version-960884 is active
I0214 04:20:58.203335 1548015 main.go:141] libmachine: (old-k8s-version-960884) Getting domain xml...
I0214 04:20:58.204058 1548015 main.go:141] libmachine: (old-k8s-version-960884) Creating domain...
I0214 04:20:59.499603 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting to get IP...
I0214 04:20:59.500457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.500948 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.501078 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.500925 1550044 retry.go:31] will retry after 268.008751ms: waiting for machine to come up
I0214 04:20:56.646632 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647206 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has current primary IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.647230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Found IP for machine: 192.168.61.188
I0214 04:20:56.647242 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserving static IP address...
I0214 04:20:56.647731 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Reserved static IP address: 192.168.61.188
I0214 04:20:56.647765 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Waiting for SSH to be available...
I0214 04:20:56.647794 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.647835 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | skip adding static IP to network mk-default-k8s-diff-port-224675 - found existing host DHCP lease matching {name: "default-k8s-diff-port-224675", mac: "52:54:00:e1:b2:a5", ip: "192.168.61.188"}
I0214 04:20:56.647855 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Getting to WaitForSSH function...
I0214 04:20:56.650403 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.650820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.650856 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.651067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH client type: external
I0214 04:20:56.651100 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa (-rw-------)
I0214 04:20:56.651166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.188 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:20:56.651192 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | About to run SSH command:
I0214 04:20:56.651207 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | exit 0
I0214 04:20:56.745447 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | SSH cmd err, output: <nil>:
I0214 04:20:56.745839 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetConfigRaw
I0214 04:20:56.746577 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:56.749052 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749421 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.749460 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.749749 1548589 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/config.json ...
I0214 04:20:56.750003 1548589 machine.go:94] provisionDockerMachine start ...
I0214 04:20:56.750032 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:56.750283 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.752289 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.752669 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.752745 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.752923 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.753226 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.753428 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.753775 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.753787 1548589 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:20:56.885360 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:20:56.885414 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885730 1548589 buildroot.go:166] provisioning hostname "default-k8s-diff-port-224675"
I0214 04:20:56.885763 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:56.885965 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:56.889200 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889612 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:56.889646 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:56.889789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:56.889979 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890141 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:56.890304 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:56.890522 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:56.890994 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:56.891016 1548589 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-224675 && echo "default-k8s-diff-port-224675" | sudo tee /etc/hostname
I0214 04:20:57.036037 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-224675
I0214 04:20:57.036072 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.039174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039572 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.039608 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.039755 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.039972 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040163 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.040409 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.040613 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.040946 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.040964 1548589 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-224675' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-224675/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-224675' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:20:57.182677 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:20:57.182717 1548589 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:20:57.182783 1548589 buildroot.go:174] setting up certificates
I0214 04:20:57.182802 1548589 provision.go:84] configureAuth start
I0214 04:20:57.182822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetMachineName
I0214 04:20:57.183166 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:57.186475 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.186873 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.186913 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.187230 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.189476 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189790 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.189822 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.189971 1548589 provision.go:143] copyHostCerts
I0214 04:20:57.190038 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:20:57.190049 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:20:57.190098 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:20:57.190266 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:20:57.190280 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:20:57.190314 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:20:57.190386 1548589 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:20:57.190394 1548589 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:20:57.190412 1548589 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:20:57.190461 1548589 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-224675 san=[127.0.0.1 192.168.61.188 default-k8s-diff-port-224675 localhost minikube]
I0214 04:20:57.387080 1548589 provision.go:177] copyRemoteCerts
I0214 04:20:57.387149 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:20:57.387175 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.390293 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.390630 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.390820 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.391007 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.391181 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.391322 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.485912 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:20:57.512761 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0214 04:20:57.536095 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0214 04:20:57.558680 1548589 provision.go:87] duration metric: took 375.857715ms to configureAuth
I0214 04:20:57.558710 1548589 buildroot.go:189] setting minikube options for container-runtime
I0214 04:20:57.558918 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:20:57.559003 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.562067 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562500 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.562537 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.562704 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.562907 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563106 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.563246 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.563461 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:57.563823 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:57.563850 1548589 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:20:57.893504 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:20:57.893536 1548589 machine.go:97] duration metric: took 1.143516422s to provisionDockerMachine
I0214 04:20:57.893548 1548589 start.go:293] postStartSetup for "default-k8s-diff-port-224675" (driver="kvm2")
I0214 04:20:57.893559 1548589 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:20:57.893575 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:57.893941 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:20:57.893974 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:57.896371 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896764 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:57.896795 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:57.896910 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:57.897116 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:57.897286 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:57.897442 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:57.996592 1548589 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:20:58.000872 1548589 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:20:58.000900 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:20:58.000983 1548589 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:20:58.001088 1548589 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:20:58.001183 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:20:58.011272 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:20:58.034964 1548589 start.go:296] duration metric: took 141.398226ms for postStartSetup
I0214 04:20:58.035023 1548589 fix.go:56] duration metric: took 19.960915344s for fixHost
I0214 04:20:58.035053 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.037914 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038291 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.038324 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.038581 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.038811 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.038999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.039138 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.039329 1548589 main.go:141] libmachine: Using SSH client type: native
I0214 04:20:58.039672 1548589 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.61.188 22 <nil> <nil>}
I0214 04:20:58.039684 1548589 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:20:58.174082 1548589 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884458.118396657
I0214 04:20:58.174110 1548589 fix.go:216] guest clock: 1707884458.118396657
I0214 04:20:58.174121 1548589 fix.go:229] Guest: 2024-02-14 04:20:58.118396657 +0000 UTC Remote: 2024-02-14 04:20:58.035028403 +0000 UTC m=+277.067763536 (delta=83.368254ms)
I0214 04:20:58.174148 1548589 fix.go:200] guest clock delta is within tolerance: 83.368254ms
I0214 04:20:58.174154 1548589 start.go:83] releasing machines lock for "default-k8s-diff-port-224675", held for 20.100083449s
I0214 04:20:58.174185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.174605 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:58.177237 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177662 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.177693 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.177891 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178381 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:20:58.178690 1548589 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:20:58.178744 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.178844 1548589 ssh_runner.go:195] Run: cat /version.json
I0214 04:20:58.178867 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:20:58.181490 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181789 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.181819 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.181842 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182009 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182185 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.182292 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:58.182352 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.182420 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:58.182520 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:20:58.182582 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.182999 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:20:58.183208 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:20:58.183377 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:20:58.279272 1548589 ssh_runner.go:195] Run: systemctl --version
I0214 04:20:58.306096 1548589 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:20:58.464434 1548589 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:20:58.471146 1548589 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:20:58.471214 1548589 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:20:58.488300 1548589 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:20:58.488334 1548589 start.go:494] detecting cgroup driver to use...
I0214 04:20:58.488423 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:20:58.506634 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:20:58.521226 1548589 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:20:58.521315 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:20:58.536720 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:20:58.549326 1548589 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:20:58.661636 1548589 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:20:58.783909 1548589 docker.go:233] disabling docker service ...
I0214 04:20:58.784000 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:20:58.796379 1548589 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:20:58.807498 1548589 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:20:58.924871 1548589 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:20:59.041964 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:20:59.055151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:20:59.082093 1548589 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0214 04:20:59.082175 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.095126 1548589 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:20:59.095227 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.104759 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.117356 1548589 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:20:59.126315 1548589 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:20:59.135891 1548589 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:20:59.146513 1548589 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:20:59.146572 1548589 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:20:59.162055 1548589 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:20:59.172668 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:20:59.323690 1548589 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:20:59.554209 1548589 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:20:59.554296 1548589 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:20:59.559401 1548589 start.go:562] Will wait 60s for crictl version
I0214 04:20:59.559471 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:20:59.563786 1548589 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:20:59.606476 1548589 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:20:59.606583 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.676861 1548589 ssh_runner.go:195] Run: crio --version
I0214 04:20:59.739175 1548589 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.1 ...
I0214 04:20:55.532872 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:20:55.548094 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:20:55.582319 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:20:55.595384 1548416 system_pods.go:59] 8 kube-system pods found
I0214 04:20:55.595415 1548416 system_pods.go:61] "coredns-5dd5756b68-4njjf" [3526e55f-d197-40a9-a939-bdc324aa0214] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:20:55.595422 1548416 system_pods.go:61] "etcd-embed-certs-722906" [cc60420b-dd77-4385-86f9-d2ddaa5a9b22] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:20:55.595429 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [850aef3c-4402-4e33-a81d-2d4bd97c5503] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:20:55.595435 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [5f2cc407-f67a-4779-ab0d-1a739e070df4] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:20:55.595443 1548416 system_pods.go:61] "kube-proxy-4wk86" [de0506d7-756a-4ce1-ab3c-54aaf8c041ad] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:20:55.595449 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [05db3b4a-941a-4aaf-88e3-35ec35176042] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:20:55.595458 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-5nqbv" [7784c464-f718-4eb0-b9dd-ebb579ead3bc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:20:55.595464 1548416 system_pods.go:61] "storage-provisioner" [d272841c-697d-4708-bce6-6fcad0d9d2b4] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:20:55.595471 1548416 system_pods.go:74] duration metric: took 13.129235ms to wait for pod list to return data ...
I0214 04:20:55.595482 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:20:55.601854 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:20:55.601918 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:20:55.601935 1548416 node_conditions.go:105] duration metric: took 6.44739ms to run NodePressure ...
I0214 04:20:55.601957 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:20:55.954027 1548416 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:20:55.970665 1548416 kubeadm.go:733] kubelet initialised
I0214 04:20:55.970695 1548416 kubeadm.go:734] duration metric: took 16.634129ms waiting for restarted kubelet to initialise ...
I0214 04:20:55.970708 1548416 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:20:55.978062 1548416 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:20:57.985711 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.989728 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"False"
I0214 04:20:59.740766 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetIP
I0214 04:20:59.744066 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744437 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:20:59.744465 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:20:59.744727 1548589 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0214 04:20:59.750187 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:20:59.763984 1548589 kubeadm.go:877] updating cluster {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete
sVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat
ion:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:20:59.764177 1548589 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 04:20:59.764235 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:20:59.814567 1548589 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.28.4". assuming images are not preloaded.
I0214 04:20:59.814655 1548589 ssh_runner.go:195] Run: which lz4
I0214 04:20:59.819563 1548589 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:20:59.824793 1548589 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:20:59.824844 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (458073571 bytes)
I0214 04:21:01.511247 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:01.511301 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:01.665765 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": read tcp 192.168.39.1:46006->192.168.39.167:8443: read: connection reset by peer
I0214 04:20:59.770509 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:20:59.770916 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:20:59.770941 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:20:59.770880 1550044 retry.go:31] will retry after 254.3155ms: waiting for machine to come up
I0214 04:21:00.027295 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.028116 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.028281 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.028236 1550044 retry.go:31] will retry after 304.399751ms: waiting for machine to come up
I0214 04:21:00.334939 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.335679 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.335710 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.335610 1550044 retry.go:31] will retry after 495.017444ms: waiting for machine to come up
I0214 04:21:00.833716 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:00.834301 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:00.834332 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:00.834259 1550044 retry.go:31] will retry after 586.036153ms: waiting for machine to come up
I0214 04:21:01.422440 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:01.423042 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:01.423073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:01.423002 1550044 retry.go:31] will retry after 893.296492ms: waiting for machine to come up
I0214 04:21:02.318089 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:02.318517 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:02.318553 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:02.318444 1550044 retry.go:31] will retry after 890.603828ms: waiting for machine to come up
I0214 04:21:03.210695 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:03.211183 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:03.211219 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:03.211140 1550044 retry.go:31] will retry after 1.068479468s: waiting for machine to come up
I0214 04:21:04.281009 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:04.281818 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:04.281859 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:04.281713 1550044 retry.go:31] will retry after 1.48876639s: waiting for machine to come up
I0214 04:21:00.490145 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:00.490174 1548416 pod_ready.go:81] duration metric: took 4.512078435s for pod "coredns-5dd5756b68-4njjf" in "kube-system" namespace to be "Ready" ...
I0214 04:21:00.490188 1548416 pod_ready.go:78] waiting up to 4m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:02.498108 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:04.500186 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:01.782168 1548589 crio.go:444] duration metric: took 1.962621296s to copy over tarball
I0214 04:21:01.782265 1548589 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:05.094954 1548589 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.312628523s)
I0214 04:21:05.094995 1548589 crio.go:451] duration metric: took 3.312794343s to extract the tarball
I0214 04:21:05.095005 1548589 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:05.138877 1548589 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:05.189028 1548589 crio.go:496] all images are preloaded for cri-o runtime.
I0214 04:21:05.189067 1548589 cache_images.go:84] Images are preloaded, skipping loading
I0214 04:21:05.189079 1548589 kubeadm.go:928] updating node { 192.168.61.188 8444 v1.28.4 crio true true} ...
I0214 04:21:05.189273 1548589 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=default-k8s-diff-port-224675 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.188
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:05.189360 1548589 ssh_runner.go:195] Run: crio config
I0214 04:21:05.268931 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:05.268970 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:05.268985 1548589 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:05.269014 1548589 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.188 APIServerPort:8444 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-224675 NodeName:default-k8s-diff-port-224675 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.188"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.188 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/cer
ts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0214 04:21:05.269248 1548589 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.188
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-224675"
kubeletExtraArgs:
node-ip: 192.168.61.188
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.188"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:05.269373 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0214 04:21:05.282570 1548589 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:05.282677 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:05.294227 1548589 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (328 bytes)
I0214 04:21:05.314442 1548589 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:05.335296 1548589 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
I0214 04:21:05.355453 1548589 ssh_runner.go:195] Run: grep 192.168.61.188 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:05.359558 1548589 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.188 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:05.374035 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:05.500958 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:05.517736 1548589 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675 for IP: 192.168.61.188
I0214 04:21:05.517761 1548589 certs.go:194] generating shared ca certs ...
I0214 04:21:05.517784 1548589 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:05.518063 1548589 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:05.518133 1548589 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:05.518149 1548589 certs.go:256] generating profile certs ...
I0214 04:21:05.518278 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/client.key
I0214 04:21:05.518378 1548589 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key.107453ef
I0214 04:21:05.518440 1548589 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key
I0214 04:21:05.518591 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:05.518663 1548589 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:05.518679 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:05.518715 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:05.518750 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:05.518786 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:05.518843 1548589 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:05.519732 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:05.563956 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:05.600031 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:05.637740 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:05.690706 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0214 04:21:05.737661 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:05.775249 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:05.808393 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/default-k8s-diff-port-224675/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0214 04:21:05.835096 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:05.859782 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:05.885907 1548589 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:05.912030 1548589 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:05.929758 1548589 ssh_runner.go:195] Run: openssl version
I0214 04:21:05.935156 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:05.945003 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949769 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.949864 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:05.955524 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:05.965551 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:05.975674 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980561 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.980621 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:05.986257 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:05.997315 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:06.007670 1548589 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012694 1548589 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:06.012766 1548589 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:02.007691 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.008567 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:02.507730 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:02.508577 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.007700 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:03.008475 1548199 api_server.go:269] stopped: https://192.168.39.167:8443/healthz: Get "https://192.168.39.167:8443/healthz": dial tcp 192.168.39.167:8443: connect: connection refused
I0214 04:21:03.507127 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.797126 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.797164 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:07.797184 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:07.883078 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:07.883120 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:08.007346 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.097373 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.097412 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:08.507874 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:08.516200 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:08.516246 1548199 api_server.go:103] status: https://192.168.39.167:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:09.007697 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:21:09.012802 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:21:09.021792 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:21:09.021833 1548199 api_server.go:131] duration metric: took 28.01482277s to wait for apiserver health ...
I0214 04:21:09.021845 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:21:09.021853 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:09.023946 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:05.771858 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:05.772454 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:05.772494 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:05.772403 1550044 retry.go:31] will retry after 2.280902204s: waiting for machine to come up
I0214 04:21:08.054571 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:08.055138 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:08.055173 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:08.055076 1550044 retry.go:31] will retry after 1.815235532s: waiting for machine to come up
I0214 04:21:06.844839 1548416 pod_ready.go:102] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:07.283580 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.283613 1548416 pod_ready.go:81] duration metric: took 6.793414916s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.283638 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294673 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.294704 1548416 pod_ready.go:81] duration metric: took 11.057139ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.294719 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303085 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.303113 1548416 pod_ready.go:81] duration metric: took 8.385115ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.303125 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310622 1548416 pod_ready.go:92] pod "kube-proxy-4wk86" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:07.310649 1548416 pod_ready.go:81] duration metric: took 7.515057ms for pod "kube-proxy-4wk86" in "kube-system" namespace to be "Ready" ...
I0214 04:21:07.310661 1548416 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.323237 1548416 pod_ready.go:102] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:09.821404 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:09.821523 1548416 pod_ready.go:81] duration metric: took 2.510851991s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:21:09.821565 1548416 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:06.018693 1548589 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:06.380858 1548589 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:06.387108 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:06.393578 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:06.399652 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:06.405980 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:06.412267 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:06.419780 1548589 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:06.427216 1548589 kubeadm.go:391] StartCluster: {Name:default-k8s-diff-port-224675 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.28.4 ClusterName:default-k8s-diff-port-224675 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration
:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:06.427363 1548589 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:06.427422 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.497747 1548589 cri.go:89] found id: ""
I0214 04:21:06.497834 1548589 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:06.516612 1548589 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:06.516658 1548589 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:06.516667 1548589 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:06.516733 1548589 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:06.529291 1548589 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:06.531168 1548589 kubeconfig.go:125] found "default-k8s-diff-port-224675" server: "https://192.168.61.188:8444"
I0214 04:21:06.535161 1548589 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:06.546663 1548589 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.61.188
I0214 04:21:06.546708 1548589 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:06.546726 1548589 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:06.546803 1548589 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:06.597843 1548589 cri.go:89] found id: ""
I0214 04:21:06.597935 1548589 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:06.616190 1548589 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:06.628139 1548589 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:06.628171 1548589 kubeadm.go:156] found existing configuration files:
I0214 04:21:06.628236 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I0214 04:21:06.638453 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:06.638512 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:06.648959 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I0214 04:21:06.660706 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:06.660788 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:06.671857 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I0214 04:21:06.682340 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:06.682407 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:06.692058 1548589 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I0214 04:21:06.701943 1548589 kubeadm.go:162] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:06.702022 1548589 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:06.711790 1548589 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:06.721996 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:06.889535 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.226025 1548589 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.336439873s)
I0214 04:21:08.226061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.459929 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.556113 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:08.663379 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:08.663488 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.164266 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:09.664203 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.163698 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.663743 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:10.689408 1548589 api_server.go:72] duration metric: took 2.026029304s to wait for apiserver process to appear ...
I0214 04:21:10.689439 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:10.689466 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:10.690130 1548589 api_server.go:269] stopped: https://192.168.61.188:8444/healthz: Get "https://192.168.61.188:8444/healthz": dial tcp 192.168.61.188:8444: connect: connection refused
I0214 04:21:09.025318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:09.044094 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:09.065032 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:09.077574 1548199 system_pods.go:59] 8 kube-system pods found
I0214 04:21:09.077615 1548199 system_pods.go:61] "coredns-76f75df574-kszkn" [e042e368-b6a1-481d-ac0e-a41fded08d17] Running
I0214 04:21:09.077624 1548199 system_pods.go:61] "etcd-no-preload-527067" [f9eb0545-49ea-4302-89ba-f897701543c8] Running
I0214 04:21:09.077632 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [294a622e-a6af-46f1-b011-4d932202c48c] Running
I0214 04:21:09.077641 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [cb6ca785-3638-4e5c-8950-bddb982904b4] Running
I0214 04:21:09.077648 1548199 system_pods.go:61] "kube-proxy-x55kr" [b523c872-d6f6-4522-b3f0-669b55d4784c] Running
I0214 04:21:09.077656 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [7e451830-0a27-4fa9-8ebd-36ae39aa0214] Running
I0214 04:21:09.077669 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-jq29b" [0c974098-1c0c-482e-a187-95f35842b947] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:09.077686 1548199 system_pods.go:61] "storage-provisioner" [d4ce4210-3a50-4839-9266-54a8a6725728] Running
I0214 04:21:09.077698 1548199 system_pods.go:74] duration metric: took 12.635754ms to wait for pod list to return data ...
I0214 04:21:09.077713 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:09.080917 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:09.080955 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:09.080972 1548199 node_conditions.go:105] duration metric: took 3.250174ms to run NodePressure ...
I0214 04:21:09.080995 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:09.378306 1548199 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:09.384151 1548199 retry.go:31] will retry after 170.068456ms: kubelet not initialised
I0214 04:21:09.560919 1548199 retry.go:31] will retry after 290.437429ms: kubelet not initialised
I0214 04:21:09.859277 1548199 retry.go:31] will retry after 624.738868ms: kubelet not initialised
I0214 04:21:10.492136 1548199 retry.go:31] will retry after 533.792177ms: kubelet not initialised
I0214 04:21:11.034100 1548199 retry.go:31] will retry after 1.244408489s: kubelet not initialised
I0214 04:21:09.872580 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:09.873073 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:09.873109 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:09.873043 1550044 retry.go:31] will retry after 2.578927184s: waiting for machine to come up
I0214 04:21:12.454474 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:12.454906 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:12.454940 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:12.454858 1550044 retry.go:31] will retry after 3.936870017s: waiting for machine to come up
I0214 04:21:11.833118 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:14.329353 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:11.190349 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.926174 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.926304 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:14.926353 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:14.981084 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:14.981133 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:15.190448 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.196250 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.196274 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:15.690479 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:15.698329 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
W0214 04:21:15.698362 1548589 api_server.go:103] status: https://192.168.61.188:8444/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
[+]poststarthook/apiservice-discovery-controller ok
healthz check failed
I0214 04:21:16.190232 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:21:16.195910 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:21:16.205529 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:21:16.205562 1548589 api_server.go:131] duration metric: took 5.516113354s to wait for apiserver health ...
I0214 04:21:16.205575 1548589 cni.go:84] Creating CNI manager for ""
I0214 04:21:16.205584 1548589 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:16.207433 1548589 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:12.289467 1548199 retry.go:31] will retry after 1.910737554s: kubelet not initialised
I0214 04:21:14.207622 1548199 retry.go:31] will retry after 2.041648758s: kubelet not initialised
I0214 04:21:16.260641 1548199 kubeadm.go:733] kubelet initialised
I0214 04:21:16.260666 1548199 kubeadm.go:734] duration metric: took 6.882327169s waiting for restarted kubelet to initialise ...
I0214 04:21:16.260677 1548199 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.271440 1548199 pod_ready.go:78] waiting up to 4m0s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.208874 1548589 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:16.223699 1548589 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:16.242002 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:16.258621 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:21:16.258672 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0214 04:21:16.258684 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0214 04:21:16.258702 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0214 04:21:16.258720 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0214 04:21:16.258735 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0214 04:21:16.258745 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0214 04:21:16.258757 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:21:16.258773 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0214 04:21:16.258782 1548589 system_pods.go:74] duration metric: took 16.754069ms to wait for pod list to return data ...
I0214 04:21:16.258804 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:16.262763 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:16.262799 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:16.262812 1548589 node_conditions.go:105] duration metric: took 4.002558ms to run NodePressure ...
I0214 04:21:16.262833 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:16.517025 1548589 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:16.522602 1548589 kubeadm.go:733] kubelet initialised
I0214 04:21:16.522681 1548589 kubeadm.go:734] duration metric: took 5.568582ms waiting for restarted kubelet to initialise ...
I0214 04:21:16.522703 1548589 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:16.529946 1548589 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.535926 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535952 1548589 pod_ready.go:81] duration metric: took 5.972224ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.535962 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "coredns-5dd5756b68-27jph" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.535971 1548589 pod_ready.go:78] waiting up to 4m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.541171 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541207 1548589 pod_ready.go:81] duration metric: took 5.225365ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.541221 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.541229 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.546186 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546218 1548589 pod_ready.go:81] duration metric: took 4.980231ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.546231 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.546239 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:16.646668 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646709 1548589 pod_ready.go:81] duration metric: took 100.455975ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:16.646726 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:16.646735 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.049656 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049690 1548589 pod_ready.go:81] duration metric: took 402.946278ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.049704 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-proxy-dbkzv" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.049713 1548589 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.445638 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445677 1548589 pod_ready.go:81] duration metric: took 395.952591ms for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.445694 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.445703 1548589 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:17.847249 1548589 pod_ready.go:97] node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847282 1548589 pod_ready.go:81] duration metric: took 401.569704ms for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:21:17.847311 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: node "default-k8s-diff-port-224675" hosting pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace is currently not "Ready" (skipping!): node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:17.847322 1548589 pod_ready.go:38] duration metric: took 1.324598748s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:17.847345 1548589 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:21:17.861893 1548589 ops.go:34] apiserver oom_adj: -16
I0214 04:21:17.861926 1548589 kubeadm.go:591] duration metric: took 11.345250928s to restartPrimaryControlPlane
I0214 04:21:17.861937 1548589 kubeadm.go:393] duration metric: took 11.434732694s to StartCluster
I0214 04:21:17.861963 1548589 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.862046 1548589 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:21:17.864089 1548589 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:17.864357 1548589 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.61.188 Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:21:17.866315 1548589 out.go:177] * Verifying Kubernetes components...
I0214 04:21:17.864450 1548589 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:21:17.864662 1548589 config.go:182] Loaded profile config "default-k8s-diff-port-224675": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:21:17.867813 1548589 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867813 1548589 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867893 1548589 addons.go:234] Setting addon storage-provisioner=true in "default-k8s-diff-port-224675"
W0214 04:21:17.867911 1548589 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:21:17.867931 1548589 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-224675"
I0214 04:21:17.867822 1548589 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-224675"
I0214 04:21:17.867990 1548589 addons.go:234] Setting addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:17.867995 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
W0214 04:21:17.868002 1548589 addons.go:243] addon metrics-server should already be in state true
I0214 04:21:17.868067 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.868372 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868405 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868471 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868430 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.868586 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.868630 1548589 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:17.885511 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35721
I0214 04:21:17.886123 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.886736 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.886761 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.887121 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.887700 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.887744 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.888429 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36919
I0214 04:21:17.888436 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37749
I0214 04:21:17.888934 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.888943 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.889459 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889479 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889628 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.889638 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.889897 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.890090 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.894107 1548589 addons.go:234] Setting addon default-storageclass=true in "default-k8s-diff-port-224675"
W0214 04:21:17.894129 1548589 addons.go:243] addon default-storageclass should already be in state true
I0214 04:21:17.894158 1548589 host.go:66] Checking if "default-k8s-diff-port-224675" exists ...
I0214 04:21:17.894527 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.894573 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.897686 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.898250 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.898277 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.905863 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43347
I0214 04:21:17.906256 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.906706 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.906719 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.907066 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.907252 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.909082 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.912129 1548589 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:17.913850 1548589 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:17.913867 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:21:17.913882 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.913431 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41665
I0214 04:21:17.914856 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.915448 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.915472 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.916246 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.916924 1548589 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:21:17.916952 1548589 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:21:17.917227 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917496 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.917535 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.917782 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.917997 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.918516 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44391
I0214 04:21:17.918650 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.919229 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.919243 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.919838 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.919858 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.920242 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.921364 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.922929 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.925090 1548589 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:21:16.394555 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:16.395079 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | unable to find current IP address of domain old-k8s-version-960884 in network mk-old-k8s-version-960884
I0214 04:21:16.395118 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | I0214 04:21:16.395000 1550044 retry.go:31] will retry after 4.184306662s: waiting for machine to come up
I0214 04:21:17.930415 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:21:17.930435 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:21:17.930457 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.934174 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934210 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.934233 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.934380 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.937367 1548589 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42083
I0214 04:21:17.937375 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.937552 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.937951 1548589 main.go:141] libmachine: () Calling .GetVersion
I0214 04:21:17.937949 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:17.938390 1548589 main.go:141] libmachine: Using API Version 1
I0214 04:21:17.938405 1548589 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:21:17.938789 1548589 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:21:17.939000 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetState
I0214 04:21:17.940318 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .DriverName
I0214 04:21:17.940561 1548589 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:17.940575 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:21:17.940588 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHHostname
I0214 04:21:17.943188 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943558 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:b2:a5", ip: ""} in network mk-default-k8s-diff-port-224675: {Iface:virbr2 ExpiryTime:2024-02-14 05:20:51 +0000 UTC Type:0 Mac:52:54:00:e1:b2:a5 Iaid: IPaddr:192.168.61.188 Prefix:24 Hostname:default-k8s-diff-port-224675 Clientid:01:52:54:00:e1:b2:a5}
I0214 04:21:17.943600 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | domain default-k8s-diff-port-224675 has defined IP address 192.168.61.188 and MAC address 52:54:00:e1:b2:a5 in network mk-default-k8s-diff-port-224675
I0214 04:21:17.943816 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHPort
I0214 04:21:17.943954 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHKeyPath
I0214 04:21:17.944088 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .GetSSHUsername
I0214 04:21:17.944168 1548589 sshutil.go:53] new ssh client: &{IP:192.168.61.188 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/default-k8s-diff-port-224675/id_rsa Username:docker}
I0214 04:21:18.108100 1548589 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:18.126785 1548589 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:18.199680 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:21:18.199711 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:21:18.211800 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:21:18.225027 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:21:18.225053 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:21:18.244323 1548589 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.244358 1548589 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:21:18.276796 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:21:18.350125 1548589 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:21:19.154449 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154480 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.154805 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.154827 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.154841 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.154853 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.155094 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.155200 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.155172 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.163519 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.163539 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.163825 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.163880 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.561946 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.28509634s)
I0214 04:21:19.562006 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562027 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562344 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.562355 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562371 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562386 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.562395 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.562697 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.562718 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.562731 1548589 addons.go:470] Verifying addon metrics-server=true in "default-k8s-diff-port-224675"
I0214 04:21:19.632363 1548589 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.282192396s)
I0214 04:21:19.632421 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632434 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.632756 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.632777 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.632777 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.632787 1548589 main.go:141] libmachine: Making call to close driver server
I0214 04:21:19.632796 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) Calling .Close
I0214 04:21:19.633163 1548589 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:21:19.633192 1548589 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:21:19.633209 1548589 main.go:141] libmachine: (default-k8s-diff-port-224675) DBG | Closing plugin on server side
I0214 04:21:19.635385 1548589 out.go:177] * Enabled addons: default-storageclass, metrics-server, storage-provisioner
I0214 04:21:16.330627 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:18.829917 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:19.636745 1548589 addons.go:505] duration metric: took 1.772300134s for enable addons: enabled=[default-storageclass metrics-server storage-provisioner]
I0214 04:21:20.130535 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:18.278986 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.279953 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:20.581058 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581627 1548015 main.go:141] libmachine: (old-k8s-version-960884) Found IP for machine: 192.168.72.206
I0214 04:21:20.581661 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has current primary IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.581676 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserving static IP address...
I0214 04:21:20.582088 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.582127 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | skip adding static IP to network mk-old-k8s-version-960884 - found existing host DHCP lease matching {name: "old-k8s-version-960884", mac: "52:54:00:2e:ed:79", ip: "192.168.72.206"}
I0214 04:21:20.582141 1548015 main.go:141] libmachine: (old-k8s-version-960884) Reserved static IP address: 192.168.72.206
I0214 04:21:20.582161 1548015 main.go:141] libmachine: (old-k8s-version-960884) Waiting for SSH to be available...
I0214 04:21:20.582177 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Getting to WaitForSSH function...
I0214 04:21:20.584389 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584675 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.584703 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.584856 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH client type: external
I0214 04:21:20.584883 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Using SSH private key: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa (-rw-------)
I0214 04:21:20.584919 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.206 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa -p 22] /usr/bin/ssh <nil>}
I0214 04:21:20.584935 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | About to run SSH command:
I0214 04:21:20.584946 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | exit 0
I0214 04:21:20.681801 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | SSH cmd err, output: <nil>:
I0214 04:21:20.682218 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetConfigRaw
I0214 04:21:20.683002 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:20.686419 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.686997 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.687032 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.687340 1548015 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/config.json ...
I0214 04:21:20.687596 1548015 machine.go:94] provisionDockerMachine start ...
I0214 04:21:20.687624 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:20.687892 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.690877 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691276 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.691307 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.691491 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.691695 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.691868 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.692066 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.692276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.692587 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.692598 1548015 main.go:141] libmachine: About to run SSH command:
hostname
I0214 04:21:20.821994 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
I0214 04:21:20.822030 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822348 1548015 buildroot.go:166] provisioning hostname "old-k8s-version-960884"
I0214 04:21:20.822383 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:20.822629 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.825677 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826050 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.826081 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.826289 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.826531 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826688 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.826859 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.827085 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.827569 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.827591 1548015 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-960884 && echo "old-k8s-version-960884" | sudo tee /etc/hostname
I0214 04:21:20.970187 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-960884
I0214 04:21:20.970224 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:20.972969 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973418 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:20.973457 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:20.973649 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:20.973838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.973991 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:20.974112 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:20.974276 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:20.974644 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:20.974663 1548015 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-960884' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-960884/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-960884' | sudo tee -a /etc/hosts;
fi
fi
I0214 04:21:21.109947 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0214 04:21:21.109989 1548015 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-1487441/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-1487441/.minikube}
I0214 04:21:21.110028 1548015 buildroot.go:174] setting up certificates
I0214 04:21:21.110040 1548015 provision.go:84] configureAuth start
I0214 04:21:21.110055 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetMachineName
I0214 04:21:21.110430 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:21.113401 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113720 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.113755 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.113920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.116563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.116901 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.116928 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.117065 1548015 provision.go:143] copyHostCerts
I0214 04:21:21.117136 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem, removing ...
I0214 04:21:21.117149 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem
I0214 04:21:21.117216 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.pem (1078 bytes)
I0214 04:21:21.117349 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem, removing ...
I0214 04:21:21.117363 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem
I0214 04:21:21.117397 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/cert.pem (1123 bytes)
I0214 04:21:21.117479 1548015 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem, removing ...
I0214 04:21:21.117495 1548015 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem
I0214 04:21:21.117525 1548015 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-1487441/.minikube/key.pem (1675 bytes)
I0214 04:21:21.117600 1548015 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-960884 san=[127.0.0.1 192.168.72.206 localhost minikube old-k8s-version-960884]
I0214 04:21:21.249602 1548015 provision.go:177] copyRemoteCerts
I0214 04:21:21.249679 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0214 04:21:21.249705 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.252629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253091 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.253120 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.253338 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.253535 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.253683 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.253817 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.352374 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0214 04:21:21.376684 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0214 04:21:21.400100 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0214 04:21:21.422025 1548015 provision.go:87] duration metric: took 311.969213ms to configureAuth
I0214 04:21:21.422062 1548015 buildroot.go:189] setting minikube options for container-runtime
I0214 04:21:21.422289 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:21:21.422388 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.425363 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425732 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.425769 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.425922 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.426103 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426259 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.426369 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.426526 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.426855 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.426883 1548015 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0214 04:21:21.762573 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0214 04:21:21.762683 1548015 machine.go:97] duration metric: took 1.075066333s to provisionDockerMachine
I0214 04:21:21.762703 1548015 start.go:293] postStartSetup for "old-k8s-version-960884" (driver="kvm2")
I0214 04:21:21.762722 1548015 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0214 04:21:21.762772 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:21.763195 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0214 04:21:21.763254 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.766548 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.766932 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.766960 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.767123 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.767363 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.767558 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.767724 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:21.864283 1548015 ssh_runner.go:195] Run: cat /etc/os-release
I0214 04:21:21.869125 1548015 info.go:137] Remote host: Buildroot 2021.02.12
I0214 04:21:21.869155 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/addons for local assets ...
I0214 04:21:21.869235 1548015 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-1487441/.minikube/files for local assets ...
I0214 04:21:21.869404 1548015 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem -> 14946922.pem in /etc/ssl/certs
I0214 04:21:21.869542 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0214 04:21:21.879233 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:21.901977 1548015 start.go:296] duration metric: took 139.253065ms for postStartSetup
I0214 04:21:21.902024 1548015 fix.go:56] duration metric: took 23.727695033s for fixHost
I0214 04:21:21.902051 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:21.904963 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905391 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:21.905429 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:21.905645 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:21.905838 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:21.906175 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:21.906361 1548015 main.go:141] libmachine: Using SSH client type: native
I0214 04:21:21.906733 1548015 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x80a4a0] 0x80d180 <nil> [] 0s} 192.168.72.206 22 <nil> <nil>}
I0214 04:21:21.906748 1548015 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0214 04:21:22.034574 1548015 main.go:141] libmachine: SSH cmd err, output: <nil>: 1707884481.977175244
I0214 04:21:22.034604 1548015 fix.go:216] guest clock: 1707884481.977175244
I0214 04:21:22.034613 1548015 fix.go:229] Guest: 2024-02-14 04:21:21.977175244 +0000 UTC Remote: 2024-02-14 04:21:21.902028761 +0000 UTC m=+362.408004482 (delta=75.146483ms)
I0214 04:21:22.034653 1548015 fix.go:200] guest clock delta is within tolerance: 75.146483ms
I0214 04:21:22.034658 1548015 start.go:83] releasing machines lock for "old-k8s-version-960884", held for 23.860366317s
I0214 04:21:22.034685 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.034987 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:22.038178 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038662 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.038693 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.038881 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039433 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039661 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:21:22.039752 1548015 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0214 04:21:22.039824 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.039923 1548015 ssh_runner.go:195] Run: cat /version.json
I0214 04:21:22.039956 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:21:22.042871 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.042905 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043230 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043269 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043303 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:22.043320 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:22.043406 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043515 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:21:22.043651 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043738 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:21:22.043831 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043920 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:21:22.043988 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.044088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:21:22.155962 1548015 ssh_runner.go:195] Run: systemctl --version
I0214 04:21:22.161514 1548015 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0214 04:21:22.307311 1548015 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0214 04:21:22.313795 1548015 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0214 04:21:22.313886 1548015 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0214 04:21:22.331192 1548015 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0214 04:21:22.331219 1548015 start.go:494] detecting cgroup driver to use...
I0214 04:21:22.331295 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0214 04:21:22.348525 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0214 04:21:22.360700 1548015 docker.go:217] disabling cri-docker service (if available) ...
I0214 04:21:22.360765 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0214 04:21:22.373323 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0214 04:21:22.386326 1548015 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0214 04:21:22.500712 1548015 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0214 04:21:22.628951 1548015 docker.go:233] disabling docker service ...
I0214 04:21:22.629047 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0214 04:21:22.644389 1548015 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0214 04:21:22.656100 1548015 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0214 04:21:22.771454 1548015 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0214 04:21:22.890367 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0214 04:21:22.906025 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0214 04:21:22.923645 1548015 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0214 04:21:22.923718 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.934179 1548015 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0214 04:21:22.934261 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.945371 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.955276 1548015 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0214 04:21:22.965963 1548015 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0214 04:21:22.977213 1548015 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0214 04:21:22.987180 1548015 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0214 04:21:22.987242 1548015 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0214 04:21:23.001621 1548015 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0214 04:21:23.011279 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:23.138894 1548015 ssh_runner.go:195] Run: sudo systemctl restart crio
I0214 04:21:23.320312 1548015 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0214 04:21:23.320405 1548015 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0214 04:21:23.331416 1548015 start.go:562] Will wait 60s for crictl version
I0214 04:21:23.331498 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:23.336532 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0214 04:21:23.383038 1548015 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0214 04:21:23.383147 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.439429 1548015 ssh_runner.go:195] Run: crio --version
I0214 04:21:23.497766 1548015 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.24.1 ...
I0214 04:21:23.499416 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetIP
I0214 04:21:23.502453 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.502863 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:21:23.502890 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:21:23.503096 1548015 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0214 04:21:23.507846 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:23.521497 1548015 kubeadm.go:877] updating cluster {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0
s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:} ...
I0214 04:21:23.521668 1548015 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0214 04:21:23.521743 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:23.563000 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:23.563077 1548015 ssh_runner.go:195] Run: which lz4
I0214 04:21:23.567232 1548015 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0214 04:21:23.571918 1548015 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0214 04:21:23.571956 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0214 04:21:20.832765 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:23.331172 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:22.131519 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:24.132734 1548589 node_ready.go:53] node "default-k8s-diff-port-224675" has status "Ready":"False"
I0214 04:21:25.632316 1548589 node_ready.go:49] node "default-k8s-diff-port-224675" has status "Ready":"True"
I0214 04:21:25.632355 1548589 node_ready.go:38] duration metric: took 7.505537722s for node "default-k8s-diff-port-224675" to be "Ready" ...
I0214 04:21:25.632378 1548589 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:21:25.644082 1548589 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663622 1548589 pod_ready.go:92] pod "coredns-5dd5756b68-27jph" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.663652 1548589 pod_ready.go:81] duration metric: took 19.53614ms for pod "coredns-5dd5756b68-27jph" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.663665 1548589 pod_ready.go:78] waiting up to 6m0s for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684330 1548589 pod_ready.go:92] pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.684364 1548589 pod_ready.go:81] duration metric: took 20.690068ms for pod "etcd-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.684381 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701825 1548589 pod_ready.go:92] pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.701861 1548589 pod_ready.go:81] duration metric: took 17.469749ms for pod "kube-apiserver-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.701880 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720092 1548589 pod_ready.go:92] pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:25.720116 1548589 pod_ready.go:81] duration metric: took 18.227307ms for pod "kube-controller-manager-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:25.720126 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:22.282916 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:24.790590 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:25.407536 1548015 crio.go:444] duration metric: took 1.840347288s to copy over tarball
I0214 04:21:25.407632 1548015 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0214 04:21:28.466951 1548015 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.059268232s)
I0214 04:21:28.466988 1548015 crio.go:451] duration metric: took 3.059413422s to extract the tarball
I0214 04:21:28.466998 1548015 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0214 04:21:28.508517 1548015 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 04:21:28.568984 1548015 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0214 04:21:28.569019 1548015 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0214 04:21:28.569089 1548015 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.569113 1548015 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.569124 1548015 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.569194 1548015 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0214 04:21:28.569261 1548015 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.569341 1548015 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.569195 1548015 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.569577 1548015 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570792 1548015 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.570765 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.570822 1548015 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0214 04:21:28.570828 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.570830 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.570764 1548015 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.570777 1548015 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.570853 1548015 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.761944 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.765651 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.768487 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0214 04:21:28.777658 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.789124 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.831672 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0214 04:21:28.834241 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.835723 1548015 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0214 04:21:28.835774 1548015 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:28.835821 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.846042 1548015 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:21:28.894678 1548015 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0214 04:21:28.894728 1548015 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:28.894778 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944386 1548015 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0214 04:21:28.944443 1548015 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0214 04:21:28.944481 1548015 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0214 04:21:28.944507 1548015 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0214 04:21:28.944509 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.944535 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989723 1548015 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0214 04:21:28.989774 1548015 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0214 04:21:28.989812 1548015 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0214 04:21:28.989821 1548015 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0214 04:21:28.989853 1548015 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:28.989779 1548015 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:28.989907 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989931 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989873 1548015 ssh_runner.go:195] Run: which crictl
I0214 04:21:28.989933 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0214 04:21:29.110089 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0214 04:21:29.110123 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0214 04:21:29.110142 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0214 04:21:29.110230 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0214 04:21:29.110281 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0214 04:21:29.110339 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0214 04:21:29.110389 1548015 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0214 04:21:29.250488 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0214 04:21:29.250791 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0214 04:21:29.254821 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0214 04:21:29.254967 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0214 04:21:29.255074 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0214 04:21:29.255084 1548015 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0214 04:21:29.255142 1548015 cache_images.go:92] duration metric: took 686.107956ms to LoadCachedImages
W0214 04:21:29.255222 1548015 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0: no such file or directory
I0214 04:21:29.255239 1548015 kubeadm.go:928] updating node { 192.168.72.206 8443 v1.16.0 crio true true} ...
I0214 04:21:29.255399 1548015 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-960884 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.206
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0214 04:21:29.255479 1548015 ssh_runner.go:195] Run: crio config
I0214 04:21:29.317891 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:29.317923 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:29.317935 1548015 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0214 04:21:29.317961 1548015 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.206 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-960884 NodeName:old-k8s-version-960884 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.206"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.206 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0214 04:21:29.318104 1548015 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.206
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-960884"
kubeletExtraArgs:
node-ip: 192.168.72.206
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.206"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-960884
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.72.206:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0214 04:21:29.318193 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0214 04:21:29.327452 1548015 binaries.go:44] Found k8s binaries, skipping transfer
I0214 04:21:29.327531 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0214 04:21:29.337200 1548015 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0214 04:21:29.352775 1548015 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0214 04:21:29.370691 1548015 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2181 bytes)
I0214 04:21:29.391607 1548015 ssh_runner.go:195] Run: grep 192.168.72.206 control-plane.minikube.internal$ /etc/hosts
I0214 04:21:29.395665 1548015 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.206 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0214 04:21:29.409170 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:21:29.518566 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:21:29.534160 1548015 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884 for IP: 192.168.72.206
I0214 04:21:29.534202 1548015 certs.go:194] generating shared ca certs ...
I0214 04:21:29.534231 1548015 certs.go:226] acquiring lock for ca certs: {Name:mkae190bb83da0d86112504a0bb46ac248e8e476 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:21:29.534487 1548015 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key
I0214 04:21:29.534575 1548015 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key
I0214 04:21:29.534595 1548015 certs.go:256] generating profile certs ...
I0214 04:21:29.534721 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/client.key
I0214 04:21:29.534813 1548015 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key.83e6709b
I0214 04:21:29.534879 1548015 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key
I0214 04:21:29.535019 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem (1338 bytes)
W0214 04:21:29.535076 1548015 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692_empty.pem, impossibly tiny 0 bytes
I0214 04:21:29.535089 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca-key.pem (1679 bytes)
I0214 04:21:29.535122 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/ca.pem (1078 bytes)
I0214 04:21:29.535155 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/cert.pem (1123 bytes)
I0214 04:21:29.535198 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/key.pem (1675 bytes)
I0214 04:21:29.535265 1548015 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem (1708 bytes)
I0214 04:21:29.536212 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0214 04:21:25.332784 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:27.830166 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:26.031649 1548589 pod_ready.go:92] pod "kube-proxy-dbkzv" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:26.031684 1548589 pod_ready.go:81] duration metric: took 311.550001ms for pod "kube-proxy-dbkzv" in "kube-system" namespace to be "Ready" ...
I0214 04:21:26.031698 1548589 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:28.040585 1548589 pod_ready.go:102] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:30.465468 1548589 pod_ready.go:92] pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:30.465504 1548589 pod_ready.go:81] duration metric: took 4.433796246s for pod "kube-scheduler-default-k8s-diff-port-224675" in "kube-system" namespace to be "Ready" ...
I0214 04:21:30.465519 1548589 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
I0214 04:21:27.279574 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.552593 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:29.576065 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0214 04:21:29.714093 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0214 04:21:29.748054 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0214 04:21:29.777699 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0214 04:21:29.804606 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0214 04:21:29.829987 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0214 04:21:29.853803 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/old-k8s-version-960884/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0214 04:21:29.878360 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0214 04:21:29.901845 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/certs/1494692.pem --> /usr/share/ca-certificates/1494692.pem (1338 bytes)
I0214 04:21:29.926801 1548015 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/ssl/certs/14946922.pem --> /usr/share/ca-certificates/14946922.pem (1708 bytes)
I0214 04:21:29.951044 1548015 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0214 04:21:29.970807 1548015 ssh_runner.go:195] Run: openssl version
I0214 04:21:29.977053 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0214 04:21:29.990302 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996045 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 14 02:48 /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:29.996150 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0214 04:21:30.002320 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0214 04:21:30.014065 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1494692.pem && ln -fs /usr/share/ca-certificates/1494692.pem /etc/ssl/certs/1494692.pem"
I0214 04:21:30.027194 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032670 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 14 02:58 /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.032739 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1494692.pem
I0214 04:21:30.039164 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1494692.pem /etc/ssl/certs/51391683.0"
I0214 04:21:30.051920 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14946922.pem && ln -fs /usr/share/ca-certificates/14946922.pem /etc/ssl/certs/14946922.pem"
I0214 04:21:30.064135 1548015 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070013 1548015 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 14 02:58 /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.070096 1548015 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14946922.pem
I0214 04:21:30.076531 1548015 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14946922.pem /etc/ssl/certs/3ec20f2e.0"
I0214 04:21:30.087989 1548015 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0214 04:21:30.094182 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0214 04:21:30.100653 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0214 04:21:30.106827 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0214 04:21:30.112695 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0214 04:21:30.118991 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0214 04:21:30.124783 1548015 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0214 04:21:30.130728 1548015 kubeadm.go:391] StartCluster: {Name:old-k8s-version-960884 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.16.0 ClusterName:old-k8s-version-960884 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s M
ount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 04:21:30.130856 1548015 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0214 04:21:30.130920 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.172760 1548015 cri.go:89] found id: ""
I0214 04:21:30.172844 1548015 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0214 04:21:30.182798 1548015 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0214 04:21:30.182820 1548015 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0214 04:21:30.182833 1548015 kubeadm.go:587] restartPrimaryControlPlane start ...
I0214 04:21:30.182890 1548015 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0214 04:21:30.191987 1548015 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0214 04:21:30.193332 1548015 kubeconfig.go:125] found "old-k8s-version-960884" server: "https://192.168.72.206:8443"
I0214 04:21:30.195906 1548015 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0214 04:21:30.204941 1548015 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.72.206
I0214 04:21:30.204971 1548015 kubeadm.go:1153] stopping kube-system containers ...
I0214 04:21:30.204983 1548015 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}
I0214 04:21:30.205030 1548015 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0214 04:21:30.246746 1548015 cri.go:89] found id: ""
I0214 04:21:30.246835 1548015 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0214 04:21:30.265837 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:21:30.277949 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:21:30.277986 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:21:30.278049 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:21:30.287840 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:21:30.287899 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:21:30.298734 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:21:30.307885 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:21:30.307983 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:21:30.317668 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:21:30.326303 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:21:30.326366 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:21:30.335884 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:21:30.344902 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:21:30.345020 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:21:30.355826 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:21:30.366201 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:30.517881 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.202023 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.400048 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.491748 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:31.625368 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:21:31.625475 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.126481 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:32.626533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.126533 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.625871 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:21:33.658063 1548015 api_server.go:72] duration metric: took 2.032718395s to wait for apiserver process to appear ...
I0214 04:21:33.658096 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:21:33.658118 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:30.329984 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.830531 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.831590 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:32.475902 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.973325 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:31.780474 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:34.281836 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:36.284001 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.658562 1548015 api_server.go:269] stopped: https://192.168.72.206:8443/healthz: Get "https://192.168.72.206:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0214 04:21:38.658613 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.453628 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.453667 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:39.453686 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.476016 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0214 04:21:39.476042 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0214 04:21:37.330750 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.829556 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.659245 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:39.678800 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:39.678842 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.158920 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.165230 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W0214 04:21:40.165286 1548015 api_server.go:103] status: https://192.168.72.206:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[-]poststarthook/ca-registration failed: reason withheld
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
I0214 04:21:40.659134 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:21:40.666024 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:21:40.674534 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:21:40.674571 1548015 api_server.go:131] duration metric: took 7.016466266s to wait for apiserver health ...
I0214 04:21:40.674584 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:21:40.674594 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:21:40.676474 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:21:36.974542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:39.474238 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:38.781991 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.280560 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:40.677823 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:21:40.689136 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:21:40.709008 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:21:40.719306 1548015 system_pods.go:59] 7 kube-system pods found
I0214 04:21:40.719343 1548015 system_pods.go:61] "coredns-5644d7b6d9-9ph4x" [6f0623c3-2524-4ba1-b0f2-43c8cdf5d3b2] Running
I0214 04:21:40.719350 1548015 system_pods.go:61] "etcd-old-k8s-version-960884" [6b8c8c75-cb3e-4b82-bc58-51b05ed826a7] Running
I0214 04:21:40.719357 1548015 system_pods.go:61] "kube-apiserver-old-k8s-version-960884" [2d8f7b59-3872-4499-9504-1f030e7c8094] Running
I0214 04:21:40.719364 1548015 system_pods.go:61] "kube-controller-manager-old-k8s-version-960884" [78c409e9-42ac-447c-99c6-6f9b687c2d36] Running
I0214 04:21:40.719378 1548015 system_pods.go:61] "kube-proxy-csc94" [091dfdb5-e19e-40c3-8d1a-e27448a61134] Running
I0214 04:21:40.719384 1548015 system_pods.go:61] "kube-scheduler-old-k8s-version-960884" [7cd0a53c-f839-4886-8902-95a9617c0223] Running
I0214 04:21:40.719390 1548015 system_pods.go:61] "storage-provisioner" [1531bf30-b7cb-46dd-8059-139eda59ab91] Running
I0214 04:21:40.719402 1548015 system_pods.go:74] duration metric: took 10.361661ms to wait for pod list to return data ...
I0214 04:21:40.719419 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:21:40.723811 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:21:40.723849 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:21:40.723864 1548015 node_conditions.go:105] duration metric: took 4.43897ms to run NodePressure ...
I0214 04:21:40.723893 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0214 04:21:40.977897 1548015 kubeadm.go:718] waiting for restarted kubelet to initialise ...
I0214 04:21:40.981121 1548015 retry.go:31] will retry after 128.555505ms: kubelet not initialised
I0214 04:21:41.115327 1548015 retry.go:31] will retry after 372.280627ms: kubelet not initialised
I0214 04:21:41.502405 1548015 retry.go:31] will retry after 313.632774ms: kubelet not initialised
I0214 04:21:41.825529 1548015 retry.go:31] will retry after 544.787289ms: kubelet not initialised
I0214 04:21:42.384758 1548015 retry.go:31] will retry after 1.43607177s: kubelet not initialised
I0214 04:21:43.832903 1548015 retry.go:31] will retry after 1.235835339s: kubelet not initialised
I0214 04:21:42.329232 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.330406 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:41.974395 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:44.477378 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:43.778781 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.778914 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:45.073614 1548015 retry.go:31] will retry after 4.115318211s: kubelet not initialised
I0214 04:21:49.193659 1548015 retry.go:31] will retry after 3.071167603s: kubelet not initialised
I0214 04:21:46.829802 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.331008 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:46.974416 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:49.473600 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:48.278392 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:50.279104 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.271827 1548015 retry.go:31] will retry after 4.905866185s: kubelet not initialised
I0214 04:21:51.331690 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.829509 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:51.973092 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:53.974274 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:52.280558 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:54.782002 1548199 pod_ready.go:102] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:55.278849 1548199 pod_ready.go:92] pod "coredns-76f75df574-kszkn" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.278875 1548199 pod_ready.go:81] duration metric: took 39.007391751s for pod "coredns-76f75df574-kszkn" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.278887 1548199 pod_ready.go:78] waiting up to 4m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284671 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.284698 1548199 pod_ready.go:81] duration metric: took 5.804847ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.284711 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289743 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.289762 1548199 pod_ready.go:81] duration metric: took 5.043413ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.289770 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294751 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.294769 1548199 pod_ready.go:81] duration metric: took 4.99309ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.294778 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299781 1548199 pod_ready.go:92] pod "kube-proxy-x55kr" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.299805 1548199 pod_ready.go:81] duration metric: took 5.020271ms for pod "kube-proxy-x55kr" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.299817 1548199 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677017 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:21:55.677045 1548199 pod_ready.go:81] duration metric: took 377.218998ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:21:55.677059 1548199 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
I0214 04:21:57.184269 1548015 retry.go:31] will retry after 9.183740474s: kubelet not initialised
I0214 04:21:56.331498 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.828024 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:56.473208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:58.475219 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.974208 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:21:57.684889 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.187231 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:00.829899 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.329789 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:03.474087 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:05.973662 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:02.683519 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:04.686765 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:06.375294 1548015 retry.go:31] will retry after 10.020373951s: kubelet not initialised
I0214 04:22:05.330250 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.829740 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.830530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.978588 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:10.473694 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:07.184721 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:09.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:11.185656 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.329405 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.829220 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:12.474366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:14.975443 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:13.683763 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:15.683805 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:16.402320 1548015 retry.go:31] will retry after 15.374173134s: kubelet not initialised
I0214 04:22:16.829525 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.330075 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:17.474403 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:19.973780 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:18.185466 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:20.186291 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.829432 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:23.834007 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:21.976320 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.474283 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:22.684964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:24.685062 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.685477 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.329169 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.329997 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:26.476641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:28.973366 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:30.974012 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:29.184272 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.184459 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:31.781677 1548015 kubeadm.go:733] kubelet initialised
I0214 04:22:31.781704 1548015 kubeadm.go:734] duration metric: took 50.803779674s waiting for restarted kubelet to initialise ...
I0214 04:22:31.781719 1548015 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:22:31.786850 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791542 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.791560 1548015 pod_ready.go:81] duration metric: took 4.686316ms for pod "coredns-5644d7b6d9-2xsxc" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.791568 1548015 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796485 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.796505 1548015 pod_ready.go:81] duration metric: took 4.931563ms for pod "coredns-5644d7b6d9-9ph4x" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.796514 1548015 pod_ready.go:78] waiting up to 4m0s for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805785 1548015 pod_ready.go:92] pod "etcd-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.805802 1548015 pod_ready.go:81] duration metric: took 9.282838ms for pod "etcd-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.805810 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810054 1548015 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:31.810071 1548015 pod_ready.go:81] duration metric: took 4.255532ms for pod "kube-apiserver-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:31.810082 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182215 1548015 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.182243 1548015 pod_ready.go:81] duration metric: took 372.153995ms for pod "kube-controller-manager-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.182252 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582145 1548015 pod_ready.go:92] pod "kube-proxy-csc94" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.582173 1548015 pod_ready.go:81] duration metric: took 399.915006ms for pod "kube-proxy-csc94" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.582181 1548015 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981350 1548015 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace has status "Ready":"True"
I0214 04:22:32.981378 1548015 pod_ready.go:81] duration metric: took 399.188492ms for pod "kube-scheduler-old-k8s-version-960884" in "kube-system" namespace to be "Ready" ...
I0214 04:22:32.981415 1548015 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
I0214 04:22:30.830906 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.330140 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.473744 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.973699 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:33.186827 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.686309 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:34.989538 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.488713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.488883 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:35.828958 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.829284 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:39.829823 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.974025 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.473910 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:37.688964 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:40.185392 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:41.989551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.487817 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.329132 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.329344 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.475040 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.972605 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:42.187968 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:44.683996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.685030 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.488902 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.489494 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.829203 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.829494 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:46.973991 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:49.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:48.685120 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.686084 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:50.988398 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:52.988448 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.332998 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.829030 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:51.979340 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.476506 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:53.184251 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:55.685108 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:54.990421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:57.488098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:59.489487 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.328826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:56.973425 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.973762 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:22:58.185513 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.684633 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.989929 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:04.489964 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:00.828826 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.832159 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:01.473241 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:03.474787 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.474970 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:02.685927 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.184376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:06.494093 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:08.989439 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:05.328777 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.828637 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.829373 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.973237 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.975687 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:07.184628 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:09.184711 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.187647 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.488966 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.988214 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:11.830718 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.329069 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:12.474693 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:14.977568 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:13.189114 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:15.684342 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.490073 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.989036 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:16.329532 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.332792 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:17.475839 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:19.972797 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:18.184713 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.683768 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.489160 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.489440 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:20.829097 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.830033 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.830536 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:21.974815 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:23.976133 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:22.684285 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:24.685554 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:25.988251 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.988908 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.329244 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.330485 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:26.475964 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:28.982419 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:27.184598 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.683919 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.684156 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:29.991522 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:32.488915 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.829760 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.329419 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:31.473542 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.973595 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.973745 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:33.685000 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:35.685530 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:34.988612 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.988713 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.989808 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:36.829339 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:39.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.473757 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.474119 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:38.184045 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:40.185960 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.488363 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.989158 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:41.329290 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:43.329388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.975321 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.473736 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:42.683468 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:44.690416 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:46.489697 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:48.989092 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:45.829184 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.831722 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.474154 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.974446 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:47.184559 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:49.186644 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.687583 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:51.489421 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:53.988562 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:50.329667 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.338563 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.829530 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:52.472871 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.473807 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:54.184095 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.687057 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.488978 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.989503 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.829824 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.329912 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:56.474847 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:58.973570 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:00.973652 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:23:59.184086 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.184899 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.488818 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.987787 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:01.830119 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:04.329491 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:02.973916 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.473218 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:03.686039 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.184833 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:05.988871 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.989591 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:06.329626 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.330752 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:07.973857 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.474126 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:08.185966 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.684238 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.489965 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.989505 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:10.829538 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.830552 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.834481 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.973081 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.474984 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:12.686130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:15.184428 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:14.989770 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.488555 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.330299 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.828863 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.974045 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:20.474441 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:17.185605 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.684728 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.685632 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:19.988389 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.989011 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.491174 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:21.829015 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:23.830388 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:22.974348 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:25.473908 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:24.183571 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.184732 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.989443 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:29.489238 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:26.329468 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.829440 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:27.973912 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.472580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:28.184943 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:30.684148 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.489461 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.989426 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:31.328521 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:33.329174 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.474634 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:34.476234 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:32.684963 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.185485 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.488685 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.489813 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:35.829187 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.829640 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:36.973580 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:38.974641 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:37.684542 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.186898 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.490022 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.988898 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:40.328976 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.329745 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.829057 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:41.473013 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:43.473476 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:45.474557 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:42.683866 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.684597 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:46.687189 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:44.994614 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.489146 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.329572 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.831061 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:47.474959 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.973243 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.187340 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.684163 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:49.988804 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:51.989029 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.489969 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.328728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.328898 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:52.473423 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.975259 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:54.184131 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.184881 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.490033 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.989280 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:56.329901 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.827955 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:57.473867 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:59.973370 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:24:58.684729 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.684873 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.487690 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.988399 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:00.828728 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:02.829737 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:01.973785 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:04.472611 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:03.183568 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.184388 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.988477 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.989996 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:05.329020 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.829709 1548416 pod_ready.go:102] pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.821931 1548416 pod_ready.go:81] duration metric: took 4m0.000330437s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" ...
E0214 04:25:09.821969 1548416 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-5nqbv" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:09.821992 1548416 pod_ready.go:38] duration metric: took 4m13.851272943s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:09.822023 1548416 kubeadm.go:591] duration metric: took 4m23.487018823s to restartPrimaryControlPlane
W0214 04:25:09.822227 1548416 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:09.822321 1548416 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:06.472962 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:08.473224 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.475222 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:07.184478 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:09.185147 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:11.186402 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:10.490868 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.989663 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:12.974982 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.472802 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:13.187130 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.685270 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:15.489955 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.988265 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:17.473792 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:19.974720 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:18.185036 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:20.687587 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.917450 1548416 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (14.095094363s)
I0214 04:25:23.917578 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:23.933147 1548416 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:25:23.944003 1548416 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:25:23.954648 1548416 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:25:23.954670 1548416 kubeadm.go:156] found existing configuration files:
I0214 04:25:23.954721 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:25:23.964628 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:25:23.964687 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:25:23.975077 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:25:23.985324 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:25:23.985395 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:25:23.994917 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:25:24.003630 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:25:24.003677 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:25:24.012938 1548416 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:25:24.021462 1548416 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:25:24.021516 1548416 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:25:24.030687 1548416 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:25:24.084345 1548416 kubeadm.go:309] [init] Using Kubernetes version: v1.28.4
I0214 04:25:24.084459 1548416 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:25:24.247090 1548416 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:25:24.247242 1548416 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:25:24.247374 1548416 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:25:24.485795 1548416 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:25:19.988669 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:21.988724 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.989786 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.487801 1548416 out.go:204] - Generating certificates and keys ...
I0214 04:25:24.487929 1548416 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:25:24.488045 1548416 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:25:24.488156 1548416 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:25:24.488237 1548416 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:25:24.488319 1548416 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:25:24.488383 1548416 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:25:24.488535 1548416 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:25:24.489833 1548416 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:25:24.491055 1548416 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:25:24.492160 1548416 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:25:24.492954 1548416 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:25:24.493057 1548416 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:25:24.698026 1548416 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:25:24.804410 1548416 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:25:24.911827 1548416 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:25:25.071754 1548416 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:25:25.072362 1548416 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:25:25.074829 1548416 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:25:25.076806 1548416 out.go:204] - Booting up control plane ...
I0214 04:25:25.076910 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:25:25.077012 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:25:25.077429 1548416 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:25:25.093739 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:25:25.094504 1548416 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:25:25.094594 1548416 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:25:25.245976 1548416 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:25:22.473854 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:24.474402 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:23.183996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:25.186464 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.489150 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.489653 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:26.974174 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:28.975072 1548589 pod_ready.go:102] pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.473411 1548589 pod_ready.go:81] duration metric: took 4m0.007878225s for pod "metrics-server-57f55c9bc5-8bqch" in "kube-system" namespace to be "Ready" ...
E0214 04:25:30.473436 1548589 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0214 04:25:30.473443 1548589 pod_ready.go:38] duration metric: took 4m4.841053907s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:30.473469 1548589 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:30.473534 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:30.473603 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:30.529327 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:30.529352 1548589 cri.go:89] found id: ""
I0214 04:25:30.529362 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:30.529463 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.538030 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:30.538092 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:30.589897 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:30.589925 1548589 cri.go:89] found id: ""
I0214 04:25:30.589936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:30.590005 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.595536 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:30.595652 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:30.650191 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:30.650224 1548589 cri.go:89] found id: ""
I0214 04:25:30.650235 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:30.650305 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.666693 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:30.666780 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:30.725870 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:30.725896 1548589 cri.go:89] found id: ""
I0214 04:25:30.725906 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:30.725982 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.731165 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:30.731252 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:30.772330 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:30.772361 1548589 cri.go:89] found id: ""
I0214 04:25:30.772372 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:30.772432 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.777656 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:30.777735 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:30.825727 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:30.825760 1548589 cri.go:89] found id: ""
I0214 04:25:30.825771 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:30.825849 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.830555 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:30.830636 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:30.885427 1548589 cri.go:89] found id: ""
I0214 04:25:30.885461 1548589 logs.go:276] 0 containers: []
W0214 04:25:30.885471 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:30.885480 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:30.885549 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:30.932894 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:30.932928 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:30.932935 1548589 cri.go:89] found id: ""
I0214 04:25:30.932945 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:30.933011 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.937903 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:30.941946 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:30.941972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:30.957244 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:30.957298 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:31.006421 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:31.006469 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:27.687719 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:30.184052 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:33.251700 1548416 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.005690 seconds
I0214 04:25:33.251865 1548416 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:25:33.279172 1548416 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:25:33.813646 1548416 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:25:33.813879 1548416 kubeadm.go:309] [mark-control-plane] Marking the node embed-certs-722906 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:25:34.330117 1548416 kubeadm.go:309] [bootstrap-token] Using token: ljwfse.zvxgc1v12nz5i5q8
I0214 04:25:30.490723 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:32.490888 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.331680 1548416 out.go:204] - Configuring RBAC rules ...
I0214 04:25:34.331854 1548416 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:25:34.338019 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:25:34.346414 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:25:34.356280 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:25:34.363364 1548416 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:25:34.367537 1548416 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:25:34.386334 1548416 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:25:34.635264 1548416 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:25:34.746128 1548416 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:25:34.747640 1548416 kubeadm.go:309]
I0214 04:25:34.747718 1548416 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:25:34.747729 1548416 kubeadm.go:309]
I0214 04:25:34.747815 1548416 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:25:34.747825 1548416 kubeadm.go:309]
I0214 04:25:34.747855 1548416 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:25:34.747919 1548416 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:25:34.747991 1548416 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:25:34.748001 1548416 kubeadm.go:309]
I0214 04:25:34.748053 1548416 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:25:34.748057 1548416 kubeadm.go:309]
I0214 04:25:34.748096 1548416 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:25:34.748102 1548416 kubeadm.go:309]
I0214 04:25:34.748166 1548416 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:25:34.748221 1548416 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:25:34.748286 1548416 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:25:34.748293 1548416 kubeadm.go:309]
I0214 04:25:34.748388 1548416 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:25:34.748476 1548416 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:25:34.748483 1548416 kubeadm.go:309]
I0214 04:25:34.748576 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748694 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:25:34.748719 1548416 kubeadm.go:309] --control-plane
I0214 04:25:34.748725 1548416 kubeadm.go:309]
I0214 04:25:34.748824 1548416 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:25:34.748831 1548416 kubeadm.go:309]
I0214 04:25:34.748897 1548416 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ljwfse.zvxgc1v12nz5i5q8 \
I0214 04:25:34.748999 1548416 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:25:34.752065 1548416 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:25:34.752103 1548416 cni.go:84] Creating CNI manager for ""
I0214 04:25:34.752116 1548416 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:25:34.753766 1548416 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:25:34.754902 1548416 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:25:34.796511 1548416 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:25:34.854873 1548416 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:25:34.855010 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:34.855147 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-722906 minikube.k8s.io/updated_at=2024_02_14T04_25_34_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=embed-certs-722906 minikube.k8s.io/primary=true
I0214 04:25:34.950220 1548416 ops.go:34] apiserver oom_adj: -16
I0214 04:25:35.202083 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:31.057754 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:31.057788 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:31.119551 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:31.119592 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:31.180933 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:31.180972 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:31.236512 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:31.236559 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:31.290709 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:31.290749 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:31.343989 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:31.344029 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:31.391042 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:31.391076 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:31.436728 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:31.436768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:31.924773 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:31.924835 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:32.076912 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:32.076958 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.634522 1548589 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:34.660761 1548589 api_server.go:72] duration metric: took 4m16.796363202s to wait for apiserver process to appear ...
I0214 04:25:34.660794 1548589 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:34.660846 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:34.660918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:34.730857 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:34.730891 1548589 cri.go:89] found id: ""
I0214 04:25:34.730902 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:34.730963 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.735849 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:34.735918 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:34.791895 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:34.791926 1548589 cri.go:89] found id: ""
I0214 04:25:34.791936 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:34.791999 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.798706 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:34.798792 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:34.848256 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:34.848280 1548589 cri.go:89] found id: ""
I0214 04:25:34.848288 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:34.848339 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.853629 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:34.853699 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:34.908476 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:34.908509 1548589 cri.go:89] found id: ""
I0214 04:25:34.908521 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:34.908586 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.913799 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:34.913881 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:34.956647 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:34.956733 1548589 cri.go:89] found id: ""
I0214 04:25:34.956747 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:34.956799 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:34.961972 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:34.962058 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:35.005734 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.005763 1548589 cri.go:89] found id: ""
I0214 04:25:35.005772 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:35.005824 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.012134 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:35.012215 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:35.057761 1548589 cri.go:89] found id: ""
I0214 04:25:35.057788 1548589 logs.go:276] 0 containers: []
W0214 04:25:35.057795 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:35.057801 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:35.057902 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:35.100965 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.100992 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.100996 1548589 cri.go:89] found id: ""
I0214 04:25:35.101003 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:35.101058 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.105885 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:35.110123 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:35.110151 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:35.189435 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:35.189477 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:35.206289 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:35.206328 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:35.263399 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:35.263450 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:35.329373 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:35.329410 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:35.370980 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:35.371016 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:35.519971 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:35.520010 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:35.565453 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:35.565488 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:35.622596 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:35.622626 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:35.679526 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:35.679563 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:35.726343 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:35.726386 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:35.774533 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:35.774578 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:35.819726 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:35.819758 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:32.186812 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.686565 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:34.989832 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:37.489923 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:35.702927 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.203043 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:36.702176 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.203031 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:37.702509 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.203045 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.703098 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.203120 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:39.702193 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:40.202469 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:38.718371 1548589 api_server.go:253] Checking apiserver healthz at https://192.168.61.188:8444/healthz ...
I0214 04:25:38.726571 1548589 api_server.go:279] https://192.168.61.188:8444/healthz returned 200:
ok
I0214 04:25:38.728501 1548589 api_server.go:141] control plane version: v1.28.4
I0214 04:25:38.728531 1548589 api_server.go:131] duration metric: took 4.067727996s to wait for apiserver health ...
I0214 04:25:38.728543 1548589 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:38.728574 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0214 04:25:38.728639 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0214 04:25:38.777478 1548589 cri.go:89] found id: "be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:38.777506 1548589 cri.go:89] found id: ""
I0214 04:25:38.777516 1548589 logs.go:276] 1 containers: [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2]
I0214 04:25:38.777582 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.785109 1548589 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0214 04:25:38.785170 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0214 04:25:38.829370 1548589 cri.go:89] found id: "501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:38.829398 1548589 cri.go:89] found id: ""
I0214 04:25:38.829409 1548589 logs.go:276] 1 containers: [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b]
I0214 04:25:38.829475 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.834285 1548589 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0214 04:25:38.834359 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0214 04:25:38.879921 1548589 cri.go:89] found id: "e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:38.879967 1548589 cri.go:89] found id: ""
I0214 04:25:38.879978 1548589 logs.go:276] 1 containers: [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5]
I0214 04:25:38.880045 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.884937 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0214 04:25:38.884994 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0214 04:25:38.929638 1548589 cri.go:89] found id: "72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:38.929663 1548589 cri.go:89] found id: ""
I0214 04:25:38.929672 1548589 logs.go:276] 1 containers: [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90]
I0214 04:25:38.929739 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.934420 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0214 04:25:38.934485 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0214 04:25:38.982428 1548589 cri.go:89] found id: "778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:38.982464 1548589 cri.go:89] found id: ""
I0214 04:25:38.982476 1548589 logs.go:276] 1 containers: [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540]
I0214 04:25:38.982541 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:38.987942 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0214 04:25:38.988014 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0214 04:25:39.027009 1548589 cri.go:89] found id: "127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:39.027041 1548589 cri.go:89] found id: ""
I0214 04:25:39.027051 1548589 logs.go:276] 1 containers: [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71]
I0214 04:25:39.027115 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.031258 1548589 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0214 04:25:39.031312 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0214 04:25:39.074333 1548589 cri.go:89] found id: ""
I0214 04:25:39.074363 1548589 logs.go:276] 0 containers: []
W0214 04:25:39.074374 1548589 logs.go:278] No container was found matching "kindnet"
I0214 04:25:39.074382 1548589 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0214 04:25:39.074445 1548589 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0214 04:25:39.121097 1548589 cri.go:89] found id: "d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.121119 1548589 cri.go:89] found id: "71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.121125 1548589 cri.go:89] found id: ""
I0214 04:25:39.121132 1548589 logs.go:276] 2 containers: [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970]
I0214 04:25:39.121192 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.125559 1548589 ssh_runner.go:195] Run: which crictl
I0214 04:25:39.129744 1548589 logs.go:123] Gathering logs for coredns [e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5] ...
I0214 04:25:39.129768 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e173981e717075afe39cb18c83e46a39764b5db1c99b679b811fbe51d54892e5"
I0214 04:25:39.169819 1548589 logs.go:123] Gathering logs for kube-proxy [778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540] ...
I0214 04:25:39.169857 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 778678b7dbd2a827bb9a01087c697c02d8a2d7e6409af3217a9a6a35096ee540"
I0214 04:25:39.217193 1548589 logs.go:123] Gathering logs for etcd [501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b] ...
I0214 04:25:39.217224 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 501b83ee5fe015cd3998e694270dbf186c9b230156cdba16a140d91b3d7c8c8b"
I0214 04:25:39.267119 1548589 logs.go:123] Gathering logs for kube-apiserver [be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2] ...
I0214 04:25:39.267173 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be8456a3075c913f6339da99b53435fd91425ac35d4fd2e481ad19a3b3a0e9c2"
I0214 04:25:39.333382 1548589 logs.go:123] Gathering logs for storage-provisioner [d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff] ...
I0214 04:25:39.333426 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d096f7fcb2dc804d152c26425f3b829044ccb77d578599b7d1b944d11842c4ff"
I0214 04:25:39.380541 1548589 logs.go:123] Gathering logs for storage-provisioner [71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970] ...
I0214 04:25:39.380575 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 71629517c493ba68075f31747c019c7363ebe270023380d08b30f818b3dbf970"
I0214 04:25:39.426020 1548589 logs.go:123] Gathering logs for CRI-O ...
I0214 04:25:39.426061 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0214 04:25:39.787418 1548589 logs.go:123] Gathering logs for kubelet ...
I0214 04:25:39.787471 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0214 04:25:39.850366 1548589 logs.go:123] Gathering logs for describe nodes ...
I0214 04:25:39.850412 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0214 04:25:39.970082 1548589 logs.go:123] Gathering logs for kube-scheduler [72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90] ...
I0214 04:25:39.970127 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 72296e4b9708d7595bfaf8e16b15dfb63d2519d388af417a71390c1bfae3cc90"
I0214 04:25:40.014849 1548589 logs.go:123] Gathering logs for kube-controller-manager [127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71] ...
I0214 04:25:40.014876 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 127e4a7f35e1f35341c34042121c871c79ae32fde062112acaafdd1300b35d71"
I0214 04:25:40.064556 1548589 logs.go:123] Gathering logs for container status ...
I0214 04:25:40.064597 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0214 04:25:40.116058 1548589 logs.go:123] Gathering logs for dmesg ...
I0214 04:25:40.116092 1548589 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0214 04:25:37.187809 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:39.684638 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.642784 1548589 system_pods.go:59] 8 kube-system pods found
I0214 04:25:42.642824 1548589 system_pods.go:61] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.642836 1548589 system_pods.go:61] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.642847 1548589 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.642854 1548589 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.642860 1548589 system_pods.go:61] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.642866 1548589 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.642876 1548589 system_pods.go:61] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.642889 1548589 system_pods.go:61] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.642900 1548589 system_pods.go:74] duration metric: took 3.914348976s to wait for pod list to return data ...
I0214 04:25:42.642913 1548589 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:42.647178 1548589 default_sa.go:45] found service account: "default"
I0214 04:25:42.647199 1548589 default_sa.go:55] duration metric: took 4.279291ms for default service account to be created ...
I0214 04:25:42.647208 1548589 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:42.656453 1548589 system_pods.go:86] 8 kube-system pods found
I0214 04:25:42.656474 1548589 system_pods.go:89] "coredns-5dd5756b68-27jph" [099e2538-7a01-4da3-b27c-490e408e8b76] Running
I0214 04:25:42.656480 1548589 system_pods.go:89] "etcd-default-k8s-diff-port-224675" [1f514409-d807-4a6f-af20-1e8450762f5b] Running
I0214 04:25:42.656485 1548589 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-224675" [7582097b-b8a7-49c3-b7bb-ba665947cd47] Running
I0214 04:25:42.656490 1548589 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-224675" [b6493784-f537-417b-a720-61d403962cab] Running
I0214 04:25:42.656494 1548589 system_pods.go:89] "kube-proxy-dbkzv" [79b9bb9e-6b4b-4883-ab61-f3b8d6c1040b] Running
I0214 04:25:42.656498 1548589 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-224675" [9adf0afc-d527-4514-8713-8980fcd1d9e6] Running
I0214 04:25:42.656504 1548589 system_pods.go:89] "metrics-server-57f55c9bc5-8bqch" [95e64837-e855-49a4-adda-14b8dc40ec42] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:42.656509 1548589 system_pods.go:89] "storage-provisioner" [d1139208-fa62-4d5b-89c4-387eef62f726] Running
I0214 04:25:42.656517 1548589 system_pods.go:126] duration metric: took 9.303804ms to wait for k8s-apps to be running ...
I0214 04:25:42.656523 1548589 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:42.656567 1548589 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:42.675938 1548589 system_svc.go:56] duration metric: took 19.40332ms WaitForService to wait for kubelet
I0214 04:25:42.675968 1548589 kubeadm.go:576] duration metric: took 4m24.811581461s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:42.675997 1548589 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:42.680017 1548589 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:42.680051 1548589 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:42.680099 1548589 node_conditions.go:105] duration metric: took 4.09496ms to run NodePressure ...
I0214 04:25:42.680116 1548589 start.go:240] waiting for startup goroutines ...
I0214 04:25:42.680129 1548589 start.go:245] waiting for cluster config update ...
I0214 04:25:42.680147 1548589 start.go:254] writing updated cluster config ...
I0214 04:25:42.680530 1548589 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:42.736509 1548589 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:42.739295 1548589 out.go:177] * Done! kubectl is now configured to use "default-k8s-diff-port-224675" cluster and "default" namespace by default
I0214 04:25:39.988499 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:42.487797 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.488009 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:40.702290 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.202214 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:41.702270 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.202407 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.702166 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.202987 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:43.702484 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.202110 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:44.702114 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:45.202558 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:42.184826 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:44.685376 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.685510 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:45.702721 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.202291 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.703068 1548416 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:25:46.837652 1548416 kubeadm.go:1106] duration metric: took 11.982686598s to wait for elevateKubeSystemPrivileges
W0214 04:25:46.837704 1548416 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:25:46.837716 1548416 kubeadm.go:393] duration metric: took 5m0.565491944s to StartCluster
I0214 04:25:46.837742 1548416 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.837855 1548416 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:25:46.840795 1548416 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:25:46.841125 1548416 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.50.108 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:25:46.842696 1548416 out.go:177] * Verifying Kubernetes components...
I0214 04:25:46.841205 1548416 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:25:46.841387 1548416 config.go:182] Loaded profile config "embed-certs-722906": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:25:46.844126 1548416 addons.go:69] Setting default-storageclass=true in profile "embed-certs-722906"
I0214 04:25:46.844139 1548416 addons.go:69] Setting metrics-server=true in profile "embed-certs-722906"
I0214 04:25:46.844161 1548416 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-722906"
I0214 04:25:46.844186 1548416 addons.go:234] Setting addon metrics-server=true in "embed-certs-722906"
W0214 04:25:46.844201 1548416 addons.go:243] addon metrics-server should already be in state true
I0214 04:25:46.844238 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844126 1548416 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-722906"
I0214 04:25:46.844300 1548416 addons.go:234] Setting addon storage-provisioner=true in "embed-certs-722906"
W0214 04:25:46.844326 1548416 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:25:46.844126 1548416 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:25:46.844363 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.844562 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844592 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844663 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844699 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.844736 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.844799 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.861369 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43067
I0214 04:25:46.861608 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41001
I0214 04:25:46.862027 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862176 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.862591 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862626 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.862672 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.862689 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.863022 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863215 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37963
I0214 04:25:46.863398 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.863596 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.863763 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.864032 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.864056 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.864428 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.864568 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.864611 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.864955 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.865007 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.867986 1548416 addons.go:234] Setting addon default-storageclass=true in "embed-certs-722906"
W0214 04:25:46.868013 1548416 addons.go:243] addon default-storageclass should already be in state true
I0214 04:25:46.868058 1548416 host.go:66] Checking if "embed-certs-722906" exists ...
I0214 04:25:46.868432 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.868487 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.881291 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39701
I0214 04:25:46.882035 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.882540 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.882555 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.883263 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34619
I0214 04:25:46.883304 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.883548 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.883717 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.884554 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.884580 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.885036 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.885241 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.885647 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.885718 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35895
I0214 04:25:46.887988 1548416 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:25:46.886555 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.886681 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.889304 1548416 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:46.889318 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:25:46.889335 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.890487 1548416 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:25:46.489212 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:48.990116 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:46.890206 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.891625 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.891590 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:25:46.891694 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:25:46.891710 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.892169 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.892674 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893285 1548416 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:25:46.893311 1548416 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:25:46.893494 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.893556 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.893583 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.893734 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.893993 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.894174 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.894439 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.894862 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.894886 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.895040 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.895172 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.895286 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.895362 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:46.912395 1548416 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38507
I0214 04:25:46.912945 1548416 main.go:141] libmachine: () Calling .GetVersion
I0214 04:25:46.913571 1548416 main.go:141] libmachine: Using API Version 1
I0214 04:25:46.913598 1548416 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:25:46.913955 1548416 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:25:46.914139 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetState
I0214 04:25:46.915701 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .DriverName
I0214 04:25:46.915924 1548416 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:46.915936 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:25:46.915949 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHHostname
I0214 04:25:46.918689 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919161 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b9:19:4c", ip: ""} in network mk-embed-certs-722906: {Iface:virbr1 ExpiryTime:2024-02-14 05:11:49 +0000 UTC Type:0 Mac:52:54:00:b9:19:4c Iaid: IPaddr:192.168.50.108 Prefix:24 Hostname:embed-certs-722906 Clientid:01:52:54:00:b9:19:4c}
I0214 04:25:46.919259 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | domain embed-certs-722906 has defined IP address 192.168.50.108 and MAC address 52:54:00:b9:19:4c in network mk-embed-certs-722906
I0214 04:25:46.919614 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHPort
I0214 04:25:46.919795 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHKeyPath
I0214 04:25:46.919991 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .GetSSHUsername
I0214 04:25:46.920118 1548416 sshutil.go:53] new ssh client: &{IP:192.168.50.108 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/embed-certs-722906/id_rsa Username:docker}
I0214 04:25:47.174988 1548416 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:25:47.211043 1548416 node_ready.go:35] waiting up to 6m0s for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248873 1548416 node_ready.go:49] node "embed-certs-722906" has status "Ready":"True"
I0214 04:25:47.248902 1548416 node_ready.go:38] duration metric: took 37.827003ms for node "embed-certs-722906" to be "Ready" ...
I0214 04:25:47.248914 1548416 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:47.291049 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:25:47.295308 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:47.304396 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:25:47.304431 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:25:47.312577 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:25:47.352103 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:25:47.352142 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:25:47.652975 1548416 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:47.653009 1548416 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:25:47.701829 1548416 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:25:49.316545 1548416 pod_ready.go:102] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.106061464s)
I0214 04:25:49.397232 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397245 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397161 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.084547595s)
I0214 04:25:49.397335 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397353 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397607 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397715 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397743 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397752 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397771 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.397807 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.397824 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.397839 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.397694 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.397987 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.398013 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398033 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.398118 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.398132 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.454369 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.454395 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.454743 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.454768 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.658753 1548416 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.956862479s)
I0214 04:25:49.658827 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.658845 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659187 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659205 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659217 1548416 main.go:141] libmachine: Making call to close driver server
I0214 04:25:49.659226 1548416 main.go:141] libmachine: (embed-certs-722906) Calling .Close
I0214 04:25:49.659474 1548416 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:25:49.659492 1548416 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:25:49.659501 1548416 main.go:141] libmachine: (embed-certs-722906) DBG | Closing plugin on server side
I0214 04:25:49.659504 1548416 addons.go:470] Verifying addon metrics-server=true in "embed-certs-722906"
I0214 04:25:49.662582 1548416 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:25:49.664096 1548416 addons.go:505] duration metric: took 2.82289258s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:25:48.687996 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:51.185303 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:50.303857 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:50.303890 1548416 pod_ready.go:81] duration metric: took 3.008544941s for pod "coredns-5dd5756b68-62wp6" in "kube-system" namespace to be "Ready" ...
I0214 04:25:50.303906 1548416 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312602 1548416 pod_ready.go:92] pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.312630 1548416 pod_ready.go:81] duration metric: took 1.008715179s for pod "coredns-5dd5756b68-kh9dr" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.312643 1548416 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318888 1548416 pod_ready.go:92] pod "etcd-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.318913 1548416 pod_ready.go:81] duration metric: took 6.260888ms for pod "etcd-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.318925 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326339 1548416 pod_ready.go:92] pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.326358 1548416 pod_ready.go:81] duration metric: took 7.425473ms for pod "kube-apiserver-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.326366 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336131 1548416 pod_ready.go:92] pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:51.336157 1548416 pod_ready.go:81] duration metric: took 9.784766ms for pod "kube-controller-manager-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:51.336170 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344427 1548416 pod_ready.go:92] pod "kube-proxy-tzpr9" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.344452 1548416 pod_ready.go:81] duration metric: took 1.008276095s for pod "kube-proxy-tzpr9" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.344461 1548416 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703142 1548416 pod_ready.go:92] pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace has status "Ready":"True"
I0214 04:25:52.703165 1548416 pod_ready.go:81] duration metric: took 358.6975ms for pod "kube-scheduler-embed-certs-722906" in "kube-system" namespace to be "Ready" ...
I0214 04:25:52.703173 1548416 pod_ready.go:38] duration metric: took 5.454247611s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:52.703187 1548416 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:25:52.703240 1548416 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:25:52.721042 1548416 api_server.go:72] duration metric: took 5.879877619s to wait for apiserver process to appear ...
I0214 04:25:52.721069 1548416 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:25:52.721091 1548416 api_server.go:253] Checking apiserver healthz at https://192.168.50.108:8443/healthz ...
I0214 04:25:52.727234 1548416 api_server.go:279] https://192.168.50.108:8443/healthz returned 200:
ok
I0214 04:25:52.728584 1548416 api_server.go:141] control plane version: v1.28.4
I0214 04:25:52.728607 1548416 api_server.go:131] duration metric: took 7.530707ms to wait for apiserver health ...
I0214 04:25:52.728617 1548416 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:25:52.905660 1548416 system_pods.go:59] 9 kube-system pods found
I0214 04:25:52.905694 1548416 system_pods.go:61] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:52.905702 1548416 system_pods.go:61] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:52.905709 1548416 system_pods.go:61] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:52.905714 1548416 system_pods.go:61] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:52.905719 1548416 system_pods.go:61] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:52.905724 1548416 system_pods.go:61] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:52.905731 1548416 system_pods.go:61] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:52.905740 1548416 system_pods.go:61] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:52.905753 1548416 system_pods.go:61] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:52.905764 1548416 system_pods.go:74] duration metric: took 177.140213ms to wait for pod list to return data ...
I0214 04:25:52.905777 1548416 default_sa.go:34] waiting for default service account to be created ...
I0214 04:25:53.100558 1548416 default_sa.go:45] found service account: "default"
I0214 04:25:53.100586 1548416 default_sa.go:55] duration metric: took 194.801355ms for default service account to be created ...
I0214 04:25:53.100596 1548416 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:25:53.304778 1548416 system_pods.go:86] 9 kube-system pods found
I0214 04:25:53.304808 1548416 system_pods.go:89] "coredns-5dd5756b68-62wp6" [6b69aa94-f092-4150-81a8-7e8cdfdfd8e0] Running
I0214 04:25:53.304814 1548416 system_pods.go:89] "coredns-5dd5756b68-kh9dr" [426598eb-a63c-4572-ac6a-d912bfee04d1] Running
I0214 04:25:53.304818 1548416 system_pods.go:89] "etcd-embed-certs-722906" [db0cccd4-9735-46f3-a2ee-363b0b86c7ca] Running
I0214 04:25:53.304822 1548416 system_pods.go:89] "kube-apiserver-embed-certs-722906" [1d2781a0-63ed-485e-bb6e-d92c8c953764] Running
I0214 04:25:53.304826 1548416 system_pods.go:89] "kube-controller-manager-embed-certs-722906" [27a14abc-b1d6-472d-8a50-67acca0f0144] Running
I0214 04:25:53.304830 1548416 system_pods.go:89] "kube-proxy-tzpr9" [4251f9f9-12fc-4189-8bb2-2570aa4b4109] Running
I0214 04:25:53.304836 1548416 system_pods.go:89] "kube-scheduler-embed-certs-722906" [d3ede148-04db-4872-bb4a-8edbe778d1b1] Running
I0214 04:25:53.304843 1548416 system_pods.go:89] "metrics-server-57f55c9bc5-hzsfq" [82d19d9d-ee11-4ae7-be7e-1efbc027606f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:25:53.304848 1548416 system_pods.go:89] "storage-provisioner" [91a5aa8f-0a2e-4bf3-995f-24013154be0f] Running
I0214 04:25:53.304857 1548416 system_pods.go:126] duration metric: took 204.2556ms to wait for k8s-apps to be running ...
I0214 04:25:53.304863 1548416 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:25:53.304908 1548416 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:25:53.321806 1548416 system_svc.go:56] duration metric: took 16.912625ms WaitForService to wait for kubelet
I0214 04:25:53.321844 1548416 kubeadm.go:576] duration metric: took 6.480687176s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:25:53.321873 1548416 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:25:53.501541 1548416 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:25:53.501571 1548416 node_conditions.go:123] node cpu capacity is 2
I0214 04:25:53.501582 1548416 node_conditions.go:105] duration metric: took 179.703171ms to run NodePressure ...
I0214 04:25:53.501593 1548416 start.go:240] waiting for startup goroutines ...
I0214 04:25:53.501600 1548416 start.go:245] waiting for cluster config update ...
I0214 04:25:53.501610 1548416 start.go:254] writing updated cluster config ...
I0214 04:25:53.501868 1548416 ssh_runner.go:195] Run: rm -f paused
I0214 04:25:53.554017 1548416 start.go:599] kubectl: 1.29.1, cluster: 1.28.4 (minor skew: 1)
I0214 04:25:53.556089 1548416 out.go:177] * Done! kubectl is now configured to use "embed-certs-722906" cluster and "default" namespace by default
I0214 04:25:51.488936 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.988506 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:53.686041 1548199 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:55.677854 1548199 pod_ready.go:81] duration metric: took 4m0.000776482s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" ...
E0214 04:25:55.677886 1548199 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-57f55c9bc5-jq29b" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:25:55.677908 1548199 pod_ready.go:38] duration metric: took 4m39.417217273s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:25:55.677936 1548199 kubeadm.go:591] duration metric: took 5m19.120995318s to restartPrimaryControlPlane
W0214 04:25:55.678003 1548199 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:25:55.678033 1548199 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:25:55.989446 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:25:58.490001 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:00.989098 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:03.488351 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:05.491080 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:07.990103 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:09.129870 1548199 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (13.451791169s)
I0214 04:26:09.129957 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:09.143478 1548199 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:09.153419 1548199 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:09.162505 1548199 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:09.162527 1548199 kubeadm.go:156] found existing configuration files:
I0214 04:26:09.162576 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:09.171259 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:09.171322 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:09.179961 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:09.188272 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:09.188334 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:09.197398 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:09.206885 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:09.206953 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:09.215702 1548199 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:09.224447 1548199 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:09.224504 1548199 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:09.233076 1548199 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.29.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0214 04:26:09.449400 1548199 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:10.489135 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:12.490085 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:14.989284 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:16.989501 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:19.489121 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:20.589989 1548199 kubeadm.go:309] [init] Using Kubernetes version: v1.29.0-rc.2
I0214 04:26:20.590079 1548199 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:20.590160 1548199 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:20.590282 1548199 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:20.590404 1548199 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:20.590459 1548199 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:20.592006 1548199 out.go:204] - Generating certificates and keys ...
I0214 04:26:20.592122 1548199 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:20.592229 1548199 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:20.592338 1548199 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:20.592403 1548199 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:20.592503 1548199 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:20.592599 1548199 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:20.592693 1548199 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:20.592787 1548199 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:20.592902 1548199 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:20.592997 1548199 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:20.593045 1548199 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:20.593123 1548199 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:20.593198 1548199 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:20.593294 1548199 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0214 04:26:20.593365 1548199 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:20.593442 1548199 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:20.593534 1548199 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:20.593660 1548199 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:20.593761 1548199 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:20.595405 1548199 out.go:204] - Booting up control plane ...
I0214 04:26:20.595518 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:20.595632 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:20.595748 1548199 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:20.595890 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:20.596009 1548199 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:20.596086 1548199 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0214 04:26:20.596252 1548199 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:20.596349 1548199 kubeadm.go:309] [apiclient] All control plane components are healthy after 8.003185 seconds
I0214 04:26:20.596497 1548199 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:20.596673 1548199 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:20.596762 1548199 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:20.597019 1548199 kubeadm.go:309] [mark-control-plane] Marking the node no-preload-527067 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0214 04:26:20.597103 1548199 kubeadm.go:309] [bootstrap-token] Using token: yl18az.ikdg7kzcuqfvy8ic
I0214 04:26:20.598756 1548199 out.go:204] - Configuring RBAC rules ...
I0214 04:26:20.598884 1548199 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:20.598995 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0214 04:26:20.599173 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:20.599325 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:20.599486 1548199 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:20.599606 1548199 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:20.599753 1548199 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0214 04:26:20.599838 1548199 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:20.599907 1548199 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:20.599918 1548199 kubeadm.go:309]
I0214 04:26:20.599999 1548199 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:20.600014 1548199 kubeadm.go:309]
I0214 04:26:20.600130 1548199 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:20.600144 1548199 kubeadm.go:309]
I0214 04:26:20.600185 1548199 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:20.600262 1548199 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:20.600334 1548199 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:20.600344 1548199 kubeadm.go:309]
I0214 04:26:20.600414 1548199 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0214 04:26:20.600423 1548199 kubeadm.go:309]
I0214 04:26:20.600486 1548199 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0214 04:26:20.600494 1548199 kubeadm.go:309]
I0214 04:26:20.600559 1548199 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:20.600678 1548199 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:20.600743 1548199 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:20.600749 1548199 kubeadm.go:309]
I0214 04:26:20.600828 1548199 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:20.600931 1548199 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:20.600952 1548199 kubeadm.go:309]
I0214 04:26:20.601036 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601125 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:20.601144 1548199 kubeadm.go:309] --control-plane
I0214 04:26:20.601149 1548199 kubeadm.go:309]
I0214 04:26:20.601216 1548199 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:20.601222 1548199 kubeadm.go:309]
I0214 04:26:20.601302 1548199 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token yl18az.ikdg7kzcuqfvy8ic \
I0214 04:26:20.601453 1548199 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:20.601475 1548199 cni.go:84] Creating CNI manager for ""
I0214 04:26:20.601488 1548199 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:20.603974 1548199 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:20.605318 1548199 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:20.625217 1548199 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:20.665755 1548199 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:20.665828 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:20.665845 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes no-preload-527067 minikube.k8s.io/updated_at=2024_02_14T04_26_20_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=no-preload-527067 minikube.k8s.io/primary=true
I0214 04:26:20.978111 1548199 ops.go:34] apiserver oom_adj: -16
I0214 04:26:20.978350 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.478785 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:21.490359 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:23.988822 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:21.979082 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.478676 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:22.978647 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.479016 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:23.979139 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.478469 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:24.979026 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.478991 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.979248 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:26.478422 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:25.989074 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:28.488567 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:26.978971 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.478678 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:27.978661 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.479360 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:28.978439 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.479419 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:29.978677 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.478657 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.979294 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:31.478514 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:30.489293 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.490551 1548015 pod_ready.go:102] pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:32.982429 1548015 pod_ready.go:81] duration metric: took 4m0.000999321s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" ...
E0214 04:26:32.982455 1548015 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-74d5856cc6-hs6pb" in "kube-system" namespace to be "Ready" (will not retry!)
I0214 04:26:32.982485 1548015 pod_ready.go:38] duration metric: took 4m1.20075372s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:32.982524 1548015 kubeadm.go:591] duration metric: took 5m2.799685673s to restartPrimaryControlPlane
W0214 04:26:32.982589 1548015 out.go:239] ! Unable to restart control-plane node(s), will reset cluster: <no value>
I0214 04:26:32.982617 1548015 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0214 04:26:31.979099 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.478987 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:32.979077 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.479009 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:33.979314 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.478489 1548199 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:34.612101 1548199 kubeadm.go:1106] duration metric: took 13.946337661s to wait for elevateKubeSystemPrivileges
W0214 04:26:34.612159 1548199 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:26:34.612171 1548199 kubeadm.go:393] duration metric: took 5m58.102428414s to StartCluster
I0214 04:26:34.612196 1548199 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.612300 1548199 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:26:34.615005 1548199 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:26:34.615369 1548199 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.167 Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:26:34.617155 1548199 out.go:177] * Verifying Kubernetes components...
I0214 04:26:34.615466 1548199 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:26:34.615560 1548199 config.go:182] Loaded profile config "no-preload-527067": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0214 04:26:34.618768 1548199 addons.go:69] Setting storage-provisioner=true in profile "no-preload-527067"
I0214 04:26:34.618791 1548199 addons.go:69] Setting metrics-server=true in profile "no-preload-527067"
I0214 04:26:34.618813 1548199 addons.go:234] Setting addon storage-provisioner=true in "no-preload-527067"
I0214 04:26:34.618820 1548199 addons.go:234] Setting addon metrics-server=true in "no-preload-527067"
W0214 04:26:34.618825 1548199 addons.go:243] addon storage-provisioner should already be in state true
W0214 04:26:34.618829 1548199 addons.go:243] addon metrics-server should already be in state true
I0214 04:26:34.618772 1548199 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:26:34.618884 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618886 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.618775 1548199 addons.go:69] Setting default-storageclass=true in profile "no-preload-527067"
I0214 04:26:34.618993 1548199 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-527067"
I0214 04:26:34.619298 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619308 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619333 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619337 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.619341 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.619372 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.640257 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32983
I0214 04:26:34.640580 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36149
I0214 04:26:34.640597 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39493
I0214 04:26:34.640873 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.640987 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641373 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.641523 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641545 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.641583 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.641611 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642323 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642329 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.642423 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.642449 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.642627 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.642851 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.643118 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643159 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.643410 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.643444 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.646798 1548199 addons.go:234] Setting addon default-storageclass=true in "no-preload-527067"
W0214 04:26:34.646822 1548199 addons.go:243] addon default-storageclass should already be in state true
I0214 04:26:34.646854 1548199 host.go:66] Checking if "no-preload-527067" exists ...
I0214 04:26:34.647219 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.647255 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.661218 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42977
I0214 04:26:34.661948 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.662433 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.662460 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.662620 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33585
I0214 04:26:34.662742 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43125
I0214 04:26:34.662815 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.662980 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.663003 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663243 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.663722 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663743 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.663678 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.663990 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.664043 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664472 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.664637 1548199 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:26:34.664688 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.664751 1548199 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:26:34.665180 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.667379 1548199 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:26:34.668945 1548199 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:34.668969 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:26:34.668989 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.666787 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.670977 1548199 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:26:34.672956 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:26:34.672975 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:26:34.672994 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.673016 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.672384 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673068 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.673095 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.673204 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.673357 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.673524 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.676340 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.676867 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.676922 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.677027 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.677226 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.677799 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.677995 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.688291 1548199 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46577
I0214 04:26:34.688787 1548199 main.go:141] libmachine: () Calling .GetVersion
I0214 04:26:34.689408 1548199 main.go:141] libmachine: Using API Version 1
I0214 04:26:34.689428 1548199 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:26:34.689974 1548199 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:26:34.690207 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetState
I0214 04:26:34.691884 1548199 main.go:141] libmachine: (no-preload-527067) Calling .DriverName
I0214 04:26:34.692131 1548199 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:34.692145 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:26:34.692161 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHHostname
I0214 04:26:34.695649 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696104 1548199 main.go:141] libmachine: (no-preload-527067) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fa:89:aa", ip: ""} in network mk-no-preload-527067: {Iface:virbr3 ExpiryTime:2024-02-14 05:20:09 +0000 UTC Type:0 Mac:52:54:00:fa:89:aa Iaid: IPaddr:192.168.39.167 Prefix:24 Hostname:no-preload-527067 Clientid:01:52:54:00:fa:89:aa}
I0214 04:26:34.696127 1548199 main.go:141] libmachine: (no-preload-527067) DBG | domain no-preload-527067 has defined IP address 192.168.39.167 and MAC address 52:54:00:fa:89:aa in network mk-no-preload-527067
I0214 04:26:34.696274 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHPort
I0214 04:26:34.696463 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHKeyPath
I0214 04:26:34.696600 1548199 main.go:141] libmachine: (no-preload-527067) Calling .GetSSHUsername
I0214 04:26:34.696724 1548199 sshutil.go:53] new ssh client: &{IP:192.168.39.167 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/no-preload-527067/id_rsa Username:docker}
I0214 04:26:34.961474 1548199 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:26:34.991187 1548199 node_ready.go:35] waiting up to 6m0s for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001485 1548199 node_ready.go:49] node "no-preload-527067" has status "Ready":"True"
I0214 04:26:35.001505 1548199 node_ready.go:38] duration metric: took 10.286336ms for node "no-preload-527067" to be "Ready" ...
I0214 04:26:35.001515 1548199 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:35.008527 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:35.194026 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:26:35.194058 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:26:35.195705 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:26:35.220973 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:26:35.241307 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:26:35.241374 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:26:35.312068 1548199 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:35.312103 1548199 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:26:35.375420 1548199 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.29.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169864 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.169831 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.169901 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170341 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170364 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170376 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170386 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170395 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170472 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170493 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170504 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.170514 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.170906 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170927 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.170931 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.170961 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.170970 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.240387 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.240440 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.240813 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.240831 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365401 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365431 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.365774 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.365798 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.365808 1548199 main.go:141] libmachine: (no-preload-527067) DBG | Closing plugin on server side
I0214 04:26:36.365814 1548199 main.go:141] libmachine: Making call to close driver server
I0214 04:26:36.365836 1548199 main.go:141] libmachine: (no-preload-527067) Calling .Close
I0214 04:26:36.366107 1548199 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:26:36.366128 1548199 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:26:36.366141 1548199 addons.go:470] Verifying addon metrics-server=true in "no-preload-527067"
I0214 04:26:36.367846 1548199 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:26:36.369323 1548199 addons.go:505] duration metric: took 1.753864307s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:26:37.042437 1548199 pod_ready.go:102] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"False"
I0214 04:26:38.019213 1548199 pod_ready.go:92] pod "coredns-76f75df574-4zm9s" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.019249 1548199 pod_ready.go:81] duration metric: took 3.010693835s for pod "coredns-76f75df574-4zm9s" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.019263 1548199 pod_ready.go:78] waiting up to 6m0s for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027650 1548199 pod_ready.go:92] pod "coredns-76f75df574-m2q5f" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.027677 1548199 pod_ready.go:81] duration metric: took 8.406148ms for pod "coredns-76f75df574-m2q5f" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.027690 1548199 pod_ready.go:78] waiting up to 6m0s for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.033993 1548199 pod_ready.go:92] pod "etcd-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.034019 1548199 pod_ready.go:81] duration metric: took 6.321413ms for pod "etcd-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.034028 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042724 1548199 pod_ready.go:92] pod "kube-apiserver-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.042759 1548199 pod_ready.go:81] duration metric: took 8.716807ms for pod "kube-apiserver-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.042772 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050793 1548199 pod_ready.go:92] pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:38.050819 1548199 pod_ready.go:81] duration metric: took 8.039526ms for pod "kube-controller-manager-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:38.050828 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213505 1548199 pod_ready.go:92] pod "kube-proxy-66w6n" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.213536 1548199 pod_ready.go:81] duration metric: took 1.162700616s for pod "kube-proxy-66w6n" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.213550 1548199 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613918 1548199 pod_ready.go:92] pod "kube-scheduler-no-preload-527067" in "kube-system" namespace has status "Ready":"True"
I0214 04:26:39.613945 1548199 pod_ready.go:81] duration metric: took 400.387683ms for pod "kube-scheduler-no-preload-527067" in "kube-system" namespace to be "Ready" ...
I0214 04:26:39.613953 1548199 pod_ready.go:38] duration metric: took 4.6124289s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:26:39.613972 1548199 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:26:39.614036 1548199 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:26:39.630218 1548199 api_server.go:72] duration metric: took 5.014782329s to wait for apiserver process to appear ...
I0214 04:26:39.630255 1548199 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:26:39.630286 1548199 api_server.go:253] Checking apiserver healthz at https://192.168.39.167:8443/healthz ...
I0214 04:26:39.637180 1548199 api_server.go:279] https://192.168.39.167:8443/healthz returned 200:
ok
I0214 04:26:39.638716 1548199 api_server.go:141] control plane version: v1.29.0-rc.2
I0214 04:26:39.638768 1548199 api_server.go:131] duration metric: took 8.502857ms to wait for apiserver health ...
I0214 04:26:39.638776 1548199 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:26:39.824405 1548199 system_pods.go:59] 9 kube-system pods found
I0214 04:26:39.824444 1548199 system_pods.go:61] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:39.824452 1548199 system_pods.go:61] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:39.824459 1548199 system_pods.go:61] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:39.824466 1548199 system_pods.go:61] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:39.824473 1548199 system_pods.go:61] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:39.824480 1548199 system_pods.go:61] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:39.824486 1548199 system_pods.go:61] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:39.824497 1548199 system_pods.go:61] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:39.824506 1548199 system_pods.go:61] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:39.824520 1548199 system_pods.go:74] duration metric: took 185.738017ms to wait for pod list to return data ...
I0214 04:26:39.824530 1548199 default_sa.go:34] waiting for default service account to be created ...
I0214 04:26:40.013391 1548199 default_sa.go:45] found service account: "default"
I0214 04:26:40.013415 1548199 default_sa.go:55] duration metric: took 188.875578ms for default service account to be created ...
I0214 04:26:40.013424 1548199 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:26:40.217587 1548199 system_pods.go:86] 9 kube-system pods found
I0214 04:26:40.217616 1548199 system_pods.go:89] "coredns-76f75df574-4zm9s" [729cf388-b804-4317-bea5-03628f7f8421] Running
I0214 04:26:40.217622 1548199 system_pods.go:89] "coredns-76f75df574-m2q5f" [a9dbacf5-755b-4ccd-8d8d-35e0ab14f8de] Running
I0214 04:26:40.217626 1548199 system_pods.go:89] "etcd-no-preload-527067" [27651385-cc84-40c1-b809-70dd7056d03a] Running
I0214 04:26:40.217630 1548199 system_pods.go:89] "kube-apiserver-no-preload-527067" [d0670d0b-1f3d-417d-9983-064de3ee0a42] Running
I0214 04:26:40.217635 1548199 system_pods.go:89] "kube-controller-manager-no-preload-527067" [0a4d4278-211a-4d8c-93da-732f17a983d1] Running
I0214 04:26:40.217639 1548199 system_pods.go:89] "kube-proxy-66w6n" [56d3be00-ea72-4583-860c-4649713362d6] Running
I0214 04:26:40.217644 1548199 system_pods.go:89] "kube-scheduler-no-preload-527067" [ebf9b2bb-6952-41e4-8129-f223c6930f32] Running
I0214 04:26:40.217651 1548199 system_pods.go:89] "metrics-server-57f55c9bc5-rkc5k" [a40d07fe-4d4e-4492-b885-56e374360de1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:26:40.217656 1548199 system_pods.go:89] "storage-provisioner" [5233420f-4207-41fb-86dc-1fa430d52add] Running
I0214 04:26:40.217665 1548199 system_pods.go:126] duration metric: took 204.236287ms to wait for k8s-apps to be running ...
I0214 04:26:40.217672 1548199 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:26:40.217718 1548199 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:40.234093 1548199 system_svc.go:56] duration metric: took 16.409726ms WaitForService to wait for kubelet
I0214 04:26:40.234124 1548199 kubeadm.go:576] duration metric: took 5.61871569s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:26:40.234149 1548199 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:26:40.414050 1548199 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:26:40.414083 1548199 node_conditions.go:123] node cpu capacity is 2
I0214 04:26:40.414095 1548199 node_conditions.go:105] duration metric: took 179.940381ms to run NodePressure ...
I0214 04:26:40.414107 1548199 start.go:240] waiting for startup goroutines ...
I0214 04:26:40.414113 1548199 start.go:245] waiting for cluster config update ...
I0214 04:26:40.414123 1548199 start.go:254] writing updated cluster config ...
I0214 04:26:40.414399 1548199 ssh_runner.go:195] Run: rm -f paused
I0214 04:26:40.471952 1548199 start.go:599] kubectl: 1.29.1, cluster: 1.29.0-rc.2 (minor skew: 0)
I0214 04:26:40.474067 1548199 out.go:177] * Done! kubectl is now configured to use "no-preload-527067" cluster and "default" namespace by default
I0214 04:26:39.897152 1548015 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (6.91450391s)
I0214 04:26:39.897269 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:26:39.912739 1548015 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0214 04:26:39.923449 1548015 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0214 04:26:39.939932 1548015 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0214 04:26:39.939961 1548015 kubeadm.go:156] found existing configuration files:
I0214 04:26:39.940018 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0214 04:26:39.953815 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0214 04:26:39.953883 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0214 04:26:39.962552 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0214 04:26:39.971167 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0214 04:26:39.971216 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0214 04:26:39.979864 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0214 04:26:39.988192 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0214 04:26:39.988315 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0214 04:26:39.997134 1548015 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0214 04:26:40.005722 1548015 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0214 04:26:40.005762 1548015 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0214 04:26:40.015266 1548015 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0214 04:26:40.076413 1548015 kubeadm.go:309] [init] Using Kubernetes version: v1.16.0
I0214 04:26:40.076723 1548015 kubeadm.go:309] [preflight] Running pre-flight checks
I0214 04:26:40.230449 1548015 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0214 04:26:40.230618 1548015 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0214 04:26:40.230731 1548015 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0214 04:26:40.478573 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0214 04:26:40.479934 1548015 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0214 04:26:40.489997 1548015 kubeadm.go:309] [kubelet-start] Activating the kubelet service
I0214 04:26:40.644188 1548015 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0214 04:26:40.646342 1548015 out.go:204] - Generating certificates and keys ...
I0214 04:26:40.646467 1548015 kubeadm.go:309] [certs] Using existing ca certificate authority
I0214 04:26:40.646561 1548015 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0214 04:26:40.646688 1548015 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0214 04:26:40.646835 1548015 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0214 04:26:40.646956 1548015 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0214 04:26:40.647034 1548015 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0214 04:26:40.647235 1548015 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0214 04:26:40.647843 1548015 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0214 04:26:40.648304 1548015 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0214 04:26:40.649043 1548015 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0214 04:26:40.649108 1548015 kubeadm.go:309] [certs] Using the existing "sa" key
I0214 04:26:40.649182 1548015 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0214 04:26:40.935104 1548015 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0214 04:26:41.023680 1548015 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0214 04:26:41.246180 1548015 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0214 04:26:41.346131 1548015 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0214 04:26:41.346986 1548015 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0214 04:26:41.349022 1548015 out.go:204] - Booting up control plane ...
I0214 04:26:41.349146 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0214 04:26:41.352956 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0214 04:26:41.355013 1548015 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0214 04:26:41.356192 1548015 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0214 04:26:41.359118 1548015 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0214 04:26:52.863670 1548015 kubeadm.go:309] [apiclient] All control plane components are healthy after 11.504059 seconds
I0214 04:26:52.863792 1548015 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0214 04:26:52.880996 1548015 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config-1.16" in namespace kube-system with the configuration for the kubelets in the cluster
I0214 04:26:53.404015 1548015 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0214 04:26:53.404215 1548015 kubeadm.go:309] [mark-control-plane] Marking the node old-k8s-version-960884 as control-plane by adding the label "node-role.kubernetes.io/master=''"
I0214 04:26:53.916361 1548015 kubeadm.go:309] [bootstrap-token] Using token: 0ncwgq.h72unli3702wifzv
I0214 04:26:53.917805 1548015 out.go:204] - Configuring RBAC rules ...
I0214 04:26:53.917949 1548015 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0214 04:26:53.927093 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0214 04:26:53.932015 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0214 04:26:53.935192 1548015 kubeadm.go:309] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0214 04:26:53.938316 1548015 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0214 04:26:54.012603 1548015 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0214 04:26:54.352255 1548015 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0214 04:26:54.354368 1548015 kubeadm.go:309]
I0214 04:26:54.354465 1548015 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0214 04:26:54.354478 1548015 kubeadm.go:309]
I0214 04:26:54.354557 1548015 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0214 04:26:54.354569 1548015 kubeadm.go:309]
I0214 04:26:54.354605 1548015 kubeadm.go:309] mkdir -p $HOME/.kube
I0214 04:26:54.354686 1548015 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0214 04:26:54.354760 1548015 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0214 04:26:54.354775 1548015 kubeadm.go:309]
I0214 04:26:54.354824 1548015 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0214 04:26:54.354894 1548015 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0214 04:26:54.354972 1548015 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0214 04:26:54.354983 1548015 kubeadm.go:309]
I0214 04:26:54.355115 1548015 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0214 04:26:54.355264 1548015 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0214 04:26:54.355276 1548015 kubeadm.go:309]
I0214 04:26:54.355393 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355557 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626 \
I0214 04:26:54.355606 1548015 kubeadm.go:309] --control-plane
I0214 04:26:54.355613 1548015 kubeadm.go:309]
I0214 04:26:54.355679 1548015 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0214 04:26:54.355686 1548015 kubeadm.go:309]
I0214 04:26:54.355780 1548015 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token 0ncwgq.h72unli3702wifzv \
I0214 04:26:54.355925 1548015 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:9ce38749d11e772377edc978fe1a704f3da079e02e45448e837c4fb22a10d626
I0214 04:26:54.356354 1548015 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0214 04:26:54.356485 1548015 cni.go:84] Creating CNI manager for ""
I0214 04:26:54.356504 1548015 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 04:26:54.358086 1548015 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0214 04:26:54.359624 1548015 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0214 04:26:54.371756 1548015 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0214 04:26:54.389927 1548015 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0214 04:26:54.390013 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes old-k8s-version-960884 minikube.k8s.io/updated_at=2024_02_14T04_26_54_0700 minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356 minikube.k8s.io/name=old-k8s-version-960884 minikube.k8s.io/primary=true
I0214 04:26:54.390016 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:54.431990 1548015 ops.go:34] apiserver oom_adj: -16
I0214 04:26:54.626609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.126943 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:55.627715 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.127333 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:56.626894 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.126758 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:57.626794 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.127609 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:58.627033 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.126732 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:26:59.627253 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.127445 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:00.627305 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.126733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:01.627428 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.127101 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:02.627112 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.127318 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:03.627564 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.127249 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:04.627430 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.127707 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:05.627355 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.127647 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:06.626733 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.126735 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:07.627135 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.127098 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:08.626845 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.127164 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:09.627189 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.127584 1548015 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0214 04:27:10.232804 1548015 kubeadm.go:1106] duration metric: took 15.842870427s to wait for elevateKubeSystemPrivileges
W0214 04:27:10.232858 1548015 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0214 04:27:10.232867 1548015 kubeadm.go:393] duration metric: took 5m40.102162281s to StartCluster
I0214 04:27:10.232888 1548015 settings.go:142] acquiring lock: {Name:mka11b16d39048151a9e71eef35fe6a0f31b8e2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.233054 1548015 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:27:10.235716 1548015 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/kubeconfig: {Name:mk64c1c94b607813b961202f4f6b601abef1ab1a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 04:27:10.236044 1548015 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.72.206 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0214 04:27:10.237600 1548015 out.go:177] * Verifying Kubernetes components...
I0214 04:27:10.236151 1548015 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0214 04:27:10.238873 1548015 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0214 04:27:10.236262 1548015 config.go:182] Loaded profile config "old-k8s-version-960884": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0214 04:27:10.237637 1548015 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-960884"
I0214 04:27:10.238984 1548015 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-960884"
W0214 04:27:10.238997 1548015 addons.go:243] addon storage-provisioner should already be in state true
I0214 04:27:10.237648 1548015 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-960884"
I0214 04:27:10.239056 1548015 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:10.237659 1548015 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-960884"
I0214 04:27:10.239095 1548015 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-960884"
I0214 04:27:10.239028 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
W0214 04:27:10.239066 1548015 addons.go:243] addon metrics-server should already be in state true
I0214 04:27:10.239210 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.239508 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239514 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239536 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.239544 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.239578 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.259948 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37397
I0214 04:27:10.260188 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33423
I0214 04:27:10.260189 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41519
I0214 04:27:10.260483 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260579 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.260588 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.261044 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261057 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261069 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261073 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261137 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.261152 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.261462 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261531 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261578 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.261964 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.262091 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262123 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.262177 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.262206 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.265041 1548015 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-960884"
W0214 04:27:10.265057 1548015 addons.go:243] addon default-storageclass should already be in state true
I0214 04:27:10.265079 1548015 host.go:66] Checking if "old-k8s-version-960884" exists ...
I0214 04:27:10.265355 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.265388 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.281666 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35115
I0214 04:27:10.282244 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.282939 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.282959 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.283421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.283696 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.285726 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.287965 1548015 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0214 04:27:10.287003 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37937
I0214 04:27:10.289469 1548015 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.289494 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0214 04:27:10.289513 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.290515 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.291054 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.291066 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.291421 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.291810 1548015 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 04:27:10.291838 1548015 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 04:27:10.295055 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295563 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.295588 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.295834 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.296046 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.296225 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.296429 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.299942 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37359
I0214 04:27:10.300312 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.300732 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.300749 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.301045 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.301234 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.303089 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.304834 1548015 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0214 04:27:10.306097 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0214 04:27:10.306115 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0214 04:27:10.306132 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.308576 1548015 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37931
I0214 04:27:10.308935 1548015 main.go:141] libmachine: () Calling .GetVersion
I0214 04:27:10.309498 1548015 main.go:141] libmachine: Using API Version 1
I0214 04:27:10.309517 1548015 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 04:27:10.309629 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.309890 1548015 main.go:141] libmachine: () Calling .GetMachineName
I0214 04:27:10.310082 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetState
I0214 04:27:10.310137 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.310163 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.310357 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.310556 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.310953 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.311088 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.311700 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .DriverName
I0214 04:27:10.311908 1548015 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.311922 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0214 04:27:10.311935 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHHostname
I0214 04:27:10.315147 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315579 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2e:ed:79", ip: ""} in network mk-old-k8s-version-960884: {Iface:virbr4 ExpiryTime:2024-02-14 05:21:12 +0000 UTC Type:0 Mac:52:54:00:2e:ed:79 Iaid: IPaddr:192.168.72.206 Prefix:24 Hostname:old-k8s-version-960884 Clientid:01:52:54:00:2e:ed:79}
I0214 04:27:10.315639 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | domain old-k8s-version-960884 has defined IP address 192.168.72.206 and MAC address 52:54:00:2e:ed:79 in network mk-old-k8s-version-960884
I0214 04:27:10.315862 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHPort
I0214 04:27:10.316084 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHKeyPath
I0214 04:27:10.316268 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .GetSSHUsername
I0214 04:27:10.316454 1548015 sshutil.go:53] new ssh client: &{IP:192.168.72.206 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/old-k8s-version-960884/id_rsa Username:docker}
I0214 04:27:10.457777 1548015 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0214 04:27:10.480620 1548015 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.491995 1548015 node_ready.go:49] node "old-k8s-version-960884" has status "Ready":"True"
I0214 04:27:10.492022 1548015 node_ready.go:38] duration metric: took 11.363355ms for node "old-k8s-version-960884" to be "Ready" ...
I0214 04:27:10.492035 1548015 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:10.497386 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:10.561045 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0214 04:27:10.584516 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0214 04:27:10.593942 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0214 04:27:10.593967 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0214 04:27:10.621414 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0214 04:27:10.621438 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0214 04:27:10.694662 1548015 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:10.694688 1548015 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0214 04:27:10.747668 1548015 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0214 04:27:11.306565 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306591 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306723 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.306756 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.306919 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.306969 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.306988 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.306996 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307152 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307075 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307244 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307255 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.307265 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.307062 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.307496 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307512 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.307685 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.307698 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.394434 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.394467 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.394790 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.394815 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523086 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523107 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523443 1548015 main.go:141] libmachine: (old-k8s-version-960884) DBG | Closing plugin on server side
I0214 04:27:11.523505 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523519 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523534 1548015 main.go:141] libmachine: Making call to close driver server
I0214 04:27:11.523546 1548015 main.go:141] libmachine: (old-k8s-version-960884) Calling .Close
I0214 04:27:11.523818 1548015 main.go:141] libmachine: Successfully made call to close driver server
I0214 04:27:11.523839 1548015 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 04:27:11.523853 1548015 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-960884"
I0214 04:27:11.525563 1548015 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server
I0214 04:27:11.526853 1548015 addons.go:505] duration metric: took 1.290704397s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server]
I0214 04:27:12.555185 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:15.004085 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:17.005427 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:19.506364 1548015 pod_ready.go:102] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"False"
I0214 04:27:20.521073 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.521097 1548015 pod_ready.go:81] duration metric: took 10.02368927s for pod "coredns-5644d7b6d9-cvlfp" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.521114 1548015 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530815 1548015 pod_ready.go:92] pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.530849 1548015 pod_ready.go:81] duration metric: took 9.726579ms for pod "coredns-5644d7b6d9-wp56j" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.530866 1548015 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.539987 1548015 pod_ready.go:92] pod "kube-proxy-4jhcb" in "kube-system" namespace has status "Ready":"True"
I0214 04:27:20.540019 1548015 pod_ready.go:81] duration metric: took 9.143682ms for pod "kube-proxy-4jhcb" in "kube-system" namespace to be "Ready" ...
I0214 04:27:20.540033 1548015 pod_ready.go:38] duration metric: took 10.047982488s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0214 04:27:20.540055 1548015 api_server.go:52] waiting for apiserver process to appear ...
I0214 04:27:20.540113 1548015 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 04:27:20.564418 1548015 api_server.go:72] duration metric: took 10.328326886s to wait for apiserver process to appear ...
I0214 04:27:20.564452 1548015 api_server.go:88] waiting for apiserver healthz status ...
I0214 04:27:20.564478 1548015 api_server.go:253] Checking apiserver healthz at https://192.168.72.206:8443/healthz ...
I0214 04:27:20.573942 1548015 api_server.go:279] https://192.168.72.206:8443/healthz returned 200:
ok
I0214 04:27:20.575255 1548015 api_server.go:141] control plane version: v1.16.0
I0214 04:27:20.575287 1548015 api_server.go:131] duration metric: took 10.826827ms to wait for apiserver health ...
I0214 04:27:20.575298 1548015 system_pods.go:43] waiting for kube-system pods to appear ...
I0214 04:27:20.581952 1548015 system_pods.go:59] 5 kube-system pods found
I0214 04:27:20.581982 1548015 system_pods.go:61] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.581989 1548015 system_pods.go:61] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.581996 1548015 system_pods.go:61] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.582006 1548015 system_pods.go:61] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.582014 1548015 system_pods.go:61] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.582025 1548015 system_pods.go:74] duration metric: took 6.718437ms to wait for pod list to return data ...
I0214 04:27:20.582034 1548015 default_sa.go:34] waiting for default service account to be created ...
I0214 04:27:20.584695 1548015 default_sa.go:45] found service account: "default"
I0214 04:27:20.584724 1548015 default_sa.go:55] duration metric: took 2.678001ms for default service account to be created ...
I0214 04:27:20.584735 1548015 system_pods.go:116] waiting for k8s-apps to be running ...
I0214 04:27:20.589847 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.589876 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.589886 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.589896 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.589912 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.589924 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.589950 1548015 retry.go:31] will retry after 248.508062ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:20.844936 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:20.844971 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:20.844977 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:20.844981 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:20.844988 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:20.844993 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:20.845010 1548015 retry.go:31] will retry after 367.089613ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.218037 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.218074 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.218082 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.218089 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.218099 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.218105 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.218126 1548015 retry.go:31] will retry after 419.193903ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:21.642404 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:21.642441 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:21.642447 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:21.642452 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:21.642459 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:21.642465 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:21.642483 1548015 retry.go:31] will retry after 451.345597ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.099422 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.099453 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.099459 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.099466 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.099474 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.099480 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.099499 1548015 retry.go:31] will retry after 651.082119ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:22.756099 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:22.756128 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:22.756134 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:22.756148 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:22.756159 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:22.756169 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:22.756189 1548015 retry.go:31] will retry after 586.140581ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:23.348131 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:23.348163 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:23.348168 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:23.348172 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:23.348178 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:23.348183 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:23.348202 1548015 retry.go:31] will retry after 870.913743ms: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:24.224631 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:24.224665 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:24.224674 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:24.224680 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:24.224690 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:24.224697 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:24.224719 1548015 retry.go:31] will retry after 1.13554102s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:25.365563 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:25.365593 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:25.365598 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:25.365603 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:25.365609 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:25.365614 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:25.365633 1548015 retry.go:31] will retry after 1.737635615s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:27.109613 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:27.109642 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:27.109647 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:27.109651 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:27.109657 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:27.109664 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:27.109684 1548015 retry.go:31] will retry after 1.744560644s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:28.860288 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:28.860319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:28.860327 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:28.860333 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:28.860343 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:28.860350 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:28.860372 1548015 retry.go:31] will retry after 2.781231308s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:31.647467 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:31.647509 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:31.647518 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:31.647525 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:31.647536 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:31.647543 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:31.647566 1548015 retry.go:31] will retry after 3.406936773s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:35.060683 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:35.060716 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:35.060721 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:35.060725 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:35.060735 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:35.060742 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:35.060765 1548015 retry.go:31] will retry after 3.181009478s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:38.247591 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:38.247626 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:38.247634 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:38.247639 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:38.247648 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:38.247655 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:38.247679 1548015 retry.go:31] will retry after 4.973684574s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:43.227832 1548015 system_pods.go:86] 5 kube-system pods found
I0214 04:27:43.227888 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:43.227896 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:43.227902 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:43.227914 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:43.227921 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:43.227947 1548015 retry.go:31] will retry after 6.269902816s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:49.502449 1548015 system_pods.go:86] 6 kube-system pods found
I0214 04:27:49.502483 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:49.502491 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:49.502497 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:49.502503 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Pending
I0214 04:27:49.502511 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:49.502518 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:49.502541 1548015 retry.go:31] will retry after 7.09681765s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler
I0214 04:27:56.607786 1548015 system_pods.go:86] 7 kube-system pods found
I0214 04:27:56.607823 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:27:56.607833 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:27:56.607843 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:27:56.607850 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:27:56.607863 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:27:56.607878 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:27:56.607894 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:27:56.607917 1548015 retry.go:31] will retry after 9.404244714s: missing components: etcd, kube-apiserver
I0214 04:28:06.017960 1548015 system_pods.go:86] 8 kube-system pods found
I0214 04:28:06.017990 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:06.017995 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:06.017999 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Pending
I0214 04:28:06.018004 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:06.018008 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:06.018012 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:06.018018 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:06.018025 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:06.018044 1548015 retry.go:31] will retry after 13.524747575s: missing components: etcd, kube-apiserver
I0214 04:28:19.549284 1548015 system_pods.go:86] 9 kube-system pods found
I0214 04:28:19.549319 1548015 system_pods.go:89] "coredns-5644d7b6d9-cvlfp" [134715b3-0a00-4310-96e4-5276e99dadf2] Running
I0214 04:28:19.549331 1548015 system_pods.go:89] "coredns-5644d7b6d9-wp56j" [2d917ce5-0b4f-4b60-a90a-d7716ad059fb] Running
I0214 04:28:19.549337 1548015 system_pods.go:89] "etcd-old-k8s-version-960884" [4139e0e7-331e-4e99-b8fc-3186d211ee4e] Running
I0214 04:28:19.549351 1548015 system_pods.go:89] "kube-apiserver-old-k8s-version-960884" [a70eef81-e29d-4b42-9bba-e396214086b6] Running
I0214 04:28:19.549357 1548015 system_pods.go:89] "kube-controller-manager-old-k8s-version-960884" [37617735-b74a-407a-8b6c-9a2295844c54] Running
I0214 04:28:19.549364 1548015 system_pods.go:89] "kube-proxy-4jhcb" [81b8e912-db95-4b07-83ec-144395d2969b] Running
I0214 04:28:19.549371 1548015 system_pods.go:89] "kube-scheduler-old-k8s-version-960884" [6144500d-8da8-4639-8622-394761ceb332] Running
I0214 04:28:19.549383 1548015 system_pods.go:89] "metrics-server-74d5856cc6-msxjd" [2dc894aa-a939-449b-920c-581740c11163] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0214 04:28:19.549394 1548015 system_pods.go:89] "storage-provisioner" [bfd747ba-2943-4b53-b832-efe266cf71c5] Running
I0214 04:28:19.549413 1548015 system_pods.go:126] duration metric: took 58.964669894s to wait for k8s-apps to be running ...
I0214 04:28:19.549427 1548015 system_svc.go:44] waiting for kubelet service to be running ....
I0214 04:28:19.549488 1548015 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 04:28:19.575300 1548015 system_svc.go:56] duration metric: took 25.86022ms WaitForService to wait for kubelet
I0214 04:28:19.575336 1548015 kubeadm.go:576] duration metric: took 1m9.339251431s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0214 04:28:19.575379 1548015 node_conditions.go:102] verifying NodePressure condition ...
I0214 04:28:19.579124 1548015 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0214 04:28:19.579155 1548015 node_conditions.go:123] node cpu capacity is 2
I0214 04:28:19.579195 1548015 node_conditions.go:105] duration metric: took 3.807562ms to run NodePressure ...
I0214 04:28:19.579211 1548015 start.go:240] waiting for startup goroutines ...
I0214 04:28:19.579226 1548015 start.go:245] waiting for cluster config update ...
I0214 04:28:19.579242 1548015 start.go:254] writing updated cluster config ...
I0214 04:28:19.579574 1548015 ssh_runner.go:195] Run: rm -f paused
I0214 04:28:19.634648 1548015 start.go:599] kubectl: 1.29.1, cluster: 1.16.0 (minor skew: 13)
I0214 04:28:19.636438 1548015 out.go:177]
W0214 04:28:19.637884 1548015 out.go:239] ! /usr/local/bin/kubectl is version 1.29.1, which may have incompatibilities with Kubernetes 1.16.0.
I0214 04:28:19.639178 1548015 out.go:177] - Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'
I0214 04:28:19.640482 1548015 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-960884" cluster and "default" namespace by default
==> CRI-O <==
-- Journal begins at Wed 2024-02-14 04:21:11 UTC, ends at Wed 2024-02-14 04:39:49 UTC. --
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.120127132Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885589120111895,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:114472,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=309f960f-4eaa-403a-98a1-8d16dfda4d23 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.120767810Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=ca5dad8e-2cba-4d0b-bba7-9f1662142810 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.120818562Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=ca5dad8e-2cba-4d0b-bba7-9f1662142810 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.121015264Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6,PodSandboxId:ff07fb81155289fb8a6ebbbfcab47b4e0a500ea65fbba1a16c09013f4f268811,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884833080487360,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bfd747ba-2943-4b53-b832-efe266cf71c5,},Annotations:map[string]string{io.kubernetes.container.hash: 2d0e57d4,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32,PodSandboxId:3580c876b471dcef719e1086f44004fc29346ab911afaa4d34a2f6d097815a77,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1707884831735054087,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4jhcb,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81b8e912-db95-4b07-83ec-144395d2969b,},Annotations:map[string]string{io.kubernetes.container.hash: 8e540c25,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199,PodSandboxId:0d7bdda5d35df21f4df5358b04bff6cfc7afa188bd16f299e21f548fd5e4e23d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832196386331,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wp56j,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2d917ce5-0b4f-4b60-a90a-d7716ad059fb,},Annotations:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5,PodSandboxId:efbc750f2e830d8d086b170ea40a88a987a93ad4e16479a051a52845e7935f0d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832030508242,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-cvlfp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 134715b3-0a00-4310-96e4-5276e99dadf2,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c,PodSandboxId:f1798de3ba2eaa8be063eb8aaca77f237d6ec7f8a0686ff3c9bac6c37fc1a06a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1707884804816382464,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2f9341bf7e5e91d7a52a6d90438b5af1,},Annotations:map[string]string{io.kubernetes.container.hash: a54cc6c2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422,PodSandboxId:0ed5118dfef28fafafa24aa15b97dd242d196cca23419dfbdf1a8e84a6ca3a68,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1707884803446466737,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602,PodSandboxId:fb1abe14d0dec6293bb4601266ef431981c7454d8d57d26472a94b1225f13993,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1707884803268985505,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1707884802637314638,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_EXITED,CreatedAt:1707884493091572502,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io
.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=ca5dad8e-2cba-4d0b-bba7-9f1662142810 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.167379805Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=dea834d6-fea4-4820-b731-955d61e3935e name=/runtime.v1.RuntimeService/Version
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.167453615Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=dea834d6-fea4-4820-b731-955d61e3935e name=/runtime.v1.RuntimeService/Version
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.168511640Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=206ebeb5-7e38-4c41-8f62-1989e80a2838 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.169179812Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885589169159890,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:114472,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=206ebeb5-7e38-4c41-8f62-1989e80a2838 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.170007915Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=7fbd6cd0-3bda-44d0-9294-230d7d0f49d0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.170068229Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=7fbd6cd0-3bda-44d0-9294-230d7d0f49d0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.170324934Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6,PodSandboxId:ff07fb81155289fb8a6ebbbfcab47b4e0a500ea65fbba1a16c09013f4f268811,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884833080487360,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bfd747ba-2943-4b53-b832-efe266cf71c5,},Annotations:map[string]string{io.kubernetes.container.hash: 2d0e57d4,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32,PodSandboxId:3580c876b471dcef719e1086f44004fc29346ab911afaa4d34a2f6d097815a77,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1707884831735054087,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4jhcb,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81b8e912-db95-4b07-83ec-144395d2969b,},Annotations:map[string]string{io.kubernetes.container.hash: 8e540c25,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199,PodSandboxId:0d7bdda5d35df21f4df5358b04bff6cfc7afa188bd16f299e21f548fd5e4e23d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832196386331,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wp56j,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2d917ce5-0b4f-4b60-a90a-d7716ad059fb,},Annotations:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5,PodSandboxId:efbc750f2e830d8d086b170ea40a88a987a93ad4e16479a051a52845e7935f0d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832030508242,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-cvlfp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 134715b3-0a00-4310-96e4-5276e99dadf2,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c,PodSandboxId:f1798de3ba2eaa8be063eb8aaca77f237d6ec7f8a0686ff3c9bac6c37fc1a06a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1707884804816382464,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2f9341bf7e5e91d7a52a6d90438b5af1,},Annotations:map[string]string{io.kubernetes.container.hash: a54cc6c2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422,PodSandboxId:0ed5118dfef28fafafa24aa15b97dd242d196cca23419dfbdf1a8e84a6ca3a68,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1707884803446466737,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602,PodSandboxId:fb1abe14d0dec6293bb4601266ef431981c7454d8d57d26472a94b1225f13993,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1707884803268985505,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1707884802637314638,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_EXITED,CreatedAt:1707884493091572502,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io
.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=7fbd6cd0-3bda-44d0-9294-230d7d0f49d0 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.208655893Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=3e56b24f-2e75-470d-8087-8dae88d1a85c name=/runtime.v1.RuntimeService/Version
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.208763482Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=3e56b24f-2e75-470d-8087-8dae88d1a85c name=/runtime.v1.RuntimeService/Version
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.210270104Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=0b7d4fc4-73e6-450a-bef3-21c74362bb48 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.210634761Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885589210621853,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:114472,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=0b7d4fc4-73e6-450a-bef3-21c74362bb48 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.211229927Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=7f61dcb3-a8dd-4d31-9a48-31e8444e9b8f name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.211316345Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=7f61dcb3-a8dd-4d31-9a48-31e8444e9b8f name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.211499579Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6,PodSandboxId:ff07fb81155289fb8a6ebbbfcab47b4e0a500ea65fbba1a16c09013f4f268811,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884833080487360,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bfd747ba-2943-4b53-b832-efe266cf71c5,},Annotations:map[string]string{io.kubernetes.container.hash: 2d0e57d4,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32,PodSandboxId:3580c876b471dcef719e1086f44004fc29346ab911afaa4d34a2f6d097815a77,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1707884831735054087,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4jhcb,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81b8e912-db95-4b07-83ec-144395d2969b,},Annotations:map[string]string{io.kubernetes.container.hash: 8e540c25,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199,PodSandboxId:0d7bdda5d35df21f4df5358b04bff6cfc7afa188bd16f299e21f548fd5e4e23d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832196386331,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wp56j,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2d917ce5-0b4f-4b60-a90a-d7716ad059fb,},Annotations:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5,PodSandboxId:efbc750f2e830d8d086b170ea40a88a987a93ad4e16479a051a52845e7935f0d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832030508242,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-cvlfp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 134715b3-0a00-4310-96e4-5276e99dadf2,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c,PodSandboxId:f1798de3ba2eaa8be063eb8aaca77f237d6ec7f8a0686ff3c9bac6c37fc1a06a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1707884804816382464,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2f9341bf7e5e91d7a52a6d90438b5af1,},Annotations:map[string]string{io.kubernetes.container.hash: a54cc6c2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422,PodSandboxId:0ed5118dfef28fafafa24aa15b97dd242d196cca23419dfbdf1a8e84a6ca3a68,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1707884803446466737,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602,PodSandboxId:fb1abe14d0dec6293bb4601266ef431981c7454d8d57d26472a94b1225f13993,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1707884803268985505,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1707884802637314638,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_EXITED,CreatedAt:1707884493091572502,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io
.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=7f61dcb3-a8dd-4d31-9a48-31e8444e9b8f name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.245303283Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=72d96708-b7f7-4e8c-a6ee-11c5cb87c8a6 name=/runtime.v1.RuntimeService/Version
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.245356402Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=72d96708-b7f7-4e8c-a6ee-11c5cb87c8a6 name=/runtime.v1.RuntimeService/Version
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.246325793Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=50098f51-6e34-49fb-bd9c-7388dfef2272 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.246821212Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1707885589246807140,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:114472,},InodesUsed:&UInt64Value{Value:63,},},},}" file="go-grpc-middleware/chain.go:25" id=50098f51-6e34-49fb-bd9c-7388dfef2272 name=/runtime.v1.ImageService/ImageFsInfo
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.247635173Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=2d5d1896-9bea-43d1-b14d-0787a9e46a07 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.247853927Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=2d5d1896-9bea-43d1-b14d-0787a9e46a07 name=/runtime.v1.RuntimeService/ListContainers
Feb 14 04:39:49 old-k8s-version-960884 crio[721]: time="2024-02-14 04:39:49.248103670Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6,PodSandboxId:ff07fb81155289fb8a6ebbbfcab47b4e0a500ea65fbba1a16c09013f4f268811,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1707884833080487360,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: bfd747ba-2943-4b53-b832-efe266cf71c5,},Annotations:map[string]string{io.kubernetes.container.hash: 2d0e57d4,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32,PodSandboxId:3580c876b471dcef719e1086f44004fc29346ab911afaa4d34a2f6d097815a77,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1707884831735054087,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-4jhcb,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81b8e912-db95-4b07-83ec-144395d2969b,},Annotations:map[string]string{io.kubernetes.container.hash: 8e540c25,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199,PodSandboxId:0d7bdda5d35df21f4df5358b04bff6cfc7afa188bd16f299e21f548fd5e4e23d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832196386331,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wp56j,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2d917ce5-0b4f-4b60-a90a-d7716ad059fb,},Annotations:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5,PodSandboxId:efbc750f2e830d8d086b170ea40a88a987a93ad4e16479a051a52845e7935f0d,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1707884832030508242,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-cvlfp,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 134715b3-0a00-4310-96e4-5276e99dadf2,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 14e9231a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c,PodSandboxId:f1798de3ba2eaa8be063eb8aaca77f237d6ec7f8a0686ff3c9bac6c37fc1a06a,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1707884804816382464,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2f9341bf7e5e91d7a52a6d90438b5af1,},Annotations:map[string]string{io.kubernetes.container.hash: a54cc6c2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422,PodSandboxId:0ed5118dfef28fafafa24aa15b97dd242d196cca23419dfbdf1a8e84a6ca3a68,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1707884803446466737,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602,PodSandboxId:fb1abe14d0dec6293bb4601266ef431981c7454d8d57d26472a94b1225f13993,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1707884803268985505,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:1,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1707884802637314638,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 1,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed,PodSandboxId:613da19332bc036e971a8603c2c9dd1f3632c4983ec480977f7ec6699ebd78c2,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_EXITED,CreatedAt:1707884493091572502,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io
.kubernetes.pod.name: kube-apiserver-old-k8s-version-960884,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 97f4b2c9ffed01a1bf9e115c98b83094,},Annotations:map[string]string{io.kubernetes.container.hash: 621759a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=2d5d1896-9bea-43d1-b14d-0787a9e46a07 name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
8f5f681f9794f 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 12 minutes ago Running storage-provisioner 0 ff07fb8115528 storage-provisioner
b3af97708606f bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b 12 minutes ago Running coredns 0 0d7bdda5d35df coredns-5644d7b6d9-wp56j
6793f1bcffc53 bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b 12 minutes ago Running coredns 0 efbc750f2e830 coredns-5644d7b6d9-cvlfp
74da573ff459c c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384 12 minutes ago Running kube-proxy 0 3580c876b471d kube-proxy-4jhcb
287d9af047b57 b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed 13 minutes ago Running etcd 0 f1798de3ba2ea etcd-old-k8s-version-960884
56049750a916d 06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d 13 minutes ago Running kube-controller-manager 0 0ed5118dfef28 kube-controller-manager-old-k8s-version-960884
7c48edb0479b7 301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a 13 minutes ago Running kube-scheduler 0 fb1abe14d0dec kube-scheduler-old-k8s-version-960884
0a8601ad92afc b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e 13 minutes ago Running kube-apiserver 1 613da19332bc0 kube-apiserver-old-k8s-version-960884
d44a0803bd8b3 b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e 18 minutes ago Exited kube-apiserver 0 613da19332bc0 kube-apiserver-old-k8s-version-960884
==> coredns [6793f1bcffc535f461b5a6136334cca885c3948e64381754b8e541284de6d6d5] <==
.:53
2024-02-14T04:27:12.445Z [INFO] plugin/reload: Running configuration MD5 = f64cb9b977c7dfca58c4fab108535a76
2024-02-14T04:27:12.445Z [INFO] CoreDNS-1.6.2
2024-02-14T04:27:12.445Z [INFO] linux/amd64, go1.12.8, 795a3eb
CoreDNS-1.6.2
linux/amd64, go1.12.8, 795a3eb
==> coredns [b3af97708606f75370a23b526f7676ebf97bd9b2cf6fc07df94871df9e820199] <==
.:53
2024-02-14T04:27:12.525Z [INFO] plugin/reload: Running configuration MD5 = f64cb9b977c7dfca58c4fab108535a76
2024-02-14T04:27:12.525Z [INFO] CoreDNS-1.6.2
2024-02-14T04:27:12.525Z [INFO] linux/amd64, go1.12.8, 795a3eb
CoreDNS-1.6.2
linux/amd64, go1.12.8, 795a3eb
==> describe nodes <==
Name: old-k8s-version-960884
Roles: master
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-960884
kubernetes.io/os=linux
minikube.k8s.io/commit=3f800605fc20837b939aa95343770ddbd55fc356
minikube.k8s.io/name=old-k8s-version-960884
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_02_14T04_26_54_0700
minikube.k8s.io/version=v1.32.0
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 14 Feb 2024 04:26:49 +0000
Taints: <none>
Unschedulable: false
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 14 Feb 2024 04:38:49 +0000 Wed, 14 Feb 2024 04:26:43 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 14 Feb 2024 04:38:49 +0000 Wed, 14 Feb 2024 04:26:43 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 14 Feb 2024 04:38:49 +0000 Wed, 14 Feb 2024 04:26:43 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 14 Feb 2024 04:38:49 +0000 Wed, 14 Feb 2024 04:26:43 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.72.206
Hostname: old-k8s-version-960884
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: adaba3ef87084e6f99d0d445b2725ddc
System UUID: adaba3ef-8708-4e6f-99d0-d445b2725ddc
Boot ID: 79e47847-5a37-42d7-9558-08eba00fc214
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.16.0
Kube-Proxy Version: v1.16.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-5644d7b6d9-cvlfp 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 12m
kube-system coredns-5644d7b6d9-wp56j 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 12m
kube-system etcd-old-k8s-version-960884 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system kube-apiserver-old-k8s-version-960884 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system kube-controller-manager-old-k8s-version-960884 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 11m
kube-system kube-proxy-4jhcb 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
kube-system kube-scheduler-old-k8s-version-960884 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
kube-system metrics-server-74d5856cc6-msxjd 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (9%!)(MISSING) 0 (0%!)(MISSING) 12m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 0 (0%!)(MISSING)
memory 340Mi (16%!)(MISSING) 340Mi (16%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 13m (x8 over 13m) kubelet, old-k8s-version-960884 Node old-k8s-version-960884 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 13m (x8 over 13m) kubelet, old-k8s-version-960884 Node old-k8s-version-960884 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 13m (x7 over 13m) kubelet, old-k8s-version-960884 Node old-k8s-version-960884 status is now: NodeHasSufficientPID
Normal Starting 12m kube-proxy, old-k8s-version-960884 Starting kube-proxy.
==> dmesg <==
[Feb14 04:21] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.073447] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.910068] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.700119] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.163664] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.513975] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000014] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)
[ +8.835753] systemd-fstab-generator[648]: Ignoring "noauto" for root device
[ +0.120817] systemd-fstab-generator[659]: Ignoring "noauto" for root device
[ +0.154928] systemd-fstab-generator[672]: Ignoring "noauto" for root device
[ +0.111437] systemd-fstab-generator[683]: Ignoring "noauto" for root device
[ +0.248002] systemd-fstab-generator[707]: Ignoring "noauto" for root device
[ +6.383332] systemd-fstab-generator[908]: Ignoring "noauto" for root device
[ +1.873409] systemd-fstab-generator[1033]: Ignoring "noauto" for root device
[ +0.344071] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[ +25.807621] kauditd_printk_skb: 13 callbacks suppressed
[Feb14 04:22] kauditd_printk_skb: 2 callbacks suppressed
[Feb14 04:26] systemd-fstab-generator[3151]: Ignoring "noauto" for root device
[Feb14 04:27] systemd-fstab-generator[3774]: Ignoring "noauto" for root device
[ +1.388754] kauditd_printk_skb: 7 callbacks suppressed
[ +8.501614] kauditd_printk_skb: 7 callbacks suppressed
==> etcd [287d9af047b57a6cf5b0fa0e6d9989d30777989d755bc0ea8101b342c710997c] <==
2024-02-14 04:26:44.970764 I | raft: 9632424b77387a60 became follower at term 0
2024-02-14 04:26:44.970787 I | raft: newRaft 9632424b77387a60 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
2024-02-14 04:26:44.970899 I | raft: 9632424b77387a60 became follower at term 1
2024-02-14 04:26:44.981938 W | auth: simple token is not cryptographically signed
2024-02-14 04:26:44.987381 I | etcdserver: starting server... [version: 3.3.15, cluster version: to_be_decided]
2024-02-14 04:26:44.989827 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file =
2024-02-14 04:26:44.989967 I | embed: listening for metrics on http://192.168.72.206:2381
2024-02-14 04:26:44.990215 I | embed: listening for metrics on http://127.0.0.1:2381
2024-02-14 04:26:44.990318 I | etcdserver: 9632424b77387a60 as single-node; fast-forwarding 9 ticks (election ticks 10)
2024-02-14 04:26:44.990811 I | etcdserver/membership: added member 9632424b77387a60 [https://192.168.72.206:2380] to cluster 388f1870140103c
2024-02-14 04:26:45.571588 I | raft: 9632424b77387a60 is starting a new election at term 1
2024-02-14 04:26:45.571639 I | raft: 9632424b77387a60 became candidate at term 2
2024-02-14 04:26:45.571653 I | raft: 9632424b77387a60 received MsgVoteResp from 9632424b77387a60 at term 2
2024-02-14 04:26:45.571740 I | raft: 9632424b77387a60 became leader at term 2
2024-02-14 04:26:45.571751 I | raft: raft.node: 9632424b77387a60 elected leader 9632424b77387a60 at term 2
2024-02-14 04:26:45.571907 I | etcdserver: setting up the initial cluster version to 3.3
2024-02-14 04:26:45.573550 N | etcdserver/membership: set the initial cluster version to 3.3
2024-02-14 04:26:45.573813 I | etcdserver/api: enabled capabilities for version 3.3
2024-02-14 04:26:45.574009 I | etcdserver: published {Name:old-k8s-version-960884 ClientURLs:[https://192.168.72.206:2379]} to cluster 388f1870140103c
2024-02-14 04:26:45.574057 I | embed: ready to serve client requests
2024-02-14 04:26:45.574845 I | embed: ready to serve client requests
2024-02-14 04:26:45.575493 I | embed: serving client requests on 192.168.72.206:2379
2024-02-14 04:26:45.575819 I | embed: serving client requests on 127.0.0.1:2379
2024-02-14 04:36:46.052294 I | mvcc: store.index: compact 663
2024-02-14 04:36:46.054461 I | mvcc: finished scheduled compaction at 663 (took 1.613182ms)
==> kernel <==
04:39:49 up 18 min, 0 users, load average: 0.04, 0.24, 0.24
Linux old-k8s-version-960884 5.10.57 #1 SMP Thu Dec 28 22:04:21 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
==> kube-apiserver [0a8601ad92afc4e0d0d5d8fb78813aa95fc910b4aad155820620b5a7815d0da5] <==
I0214 04:31:50.289133 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:31:50.289242 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:31:50.289290 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:31:50.289297 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:32:50.289803 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:32:50.289907 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:32:50.289946 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:32:50.289953 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:34:50.290490 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:34:50.290870 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:34:50.290977 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:34:50.291009 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:36:50.292723 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:36:50.293062 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:36:50.293148 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:36:50.293172 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0214 04:37:50.293532 1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io
W0214 04:37:50.293650 1 handler_proxy.go:99] no RequestInfo found in the context
E0214 04:37:50.293787 1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0214 04:37:50.293811 1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
==> kube-apiserver [d44a0803bd8b3c3d3319db3723bfcfce5c4c564864f8df63fe20cb043f5f58ed] <==
W0214 04:26:39.633916 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.647544 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.650439 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.659080 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.662481 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.676395 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.679572 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.720510 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.724276 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.733347 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.737282 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.737951 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.741522 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.758023 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.761901 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.763652 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.763966 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.786260 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.797297 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.835957 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.844085 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.849750 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.872485 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.875513 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0214 04:26:39.881621 1 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
==> kube-controller-manager [56049750a916df802b50d8d661bdb48d73716269601178b4a33e63bd512d2422] <==
W0214 04:33:34.379366 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:33:43.634734 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:34:06.381356 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:34:13.886813 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:34:38.383790 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:34:44.139441 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:35:10.385976 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:35:14.391785 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:35:42.387984 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:35:44.643826 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:36:14.389833 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:36:14.895872 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0214 04:36:45.147439 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:36:46.392021 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:37:15.399360 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:37:18.393880 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:37:45.651319 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:37:50.395511 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:38:15.903436 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:38:22.397596 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:38:46.155113 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:38:54.399539 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:39:16.406969 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0214 04:39:26.401715 1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0214 04:39:46.658940 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
==> kube-proxy [74da573ff459c56166461201c66007cf0b69f05d686461837ee53f4c1e601b32] <==
W0214 04:27:12.734965 1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy
I0214 04:27:12.751075 1 node.go:135] Successfully retrieved node IP: 192.168.72.206
I0214 04:27:12.751325 1 server_others.go:149] Using iptables Proxier.
I0214 04:27:12.758656 1 server.go:529] Version: v1.16.0
I0214 04:27:12.761905 1 config.go:131] Starting endpoints config controller
I0214 04:27:12.762081 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
I0214 04:27:12.762330 1 config.go:313] Starting service config controller
I0214 04:27:12.762340 1 shared_informer.go:197] Waiting for caches to sync for service config
I0214 04:27:12.888946 1 shared_informer.go:204] Caches are synced for endpoints config
I0214 04:27:12.889031 1 shared_informer.go:204] Caches are synced for service config
==> kube-scheduler [7c48edb0479b71008681fcaf7f04603ebf99145e34adf128d546f56db44b8602] <==
I0214 04:26:49.302541 1 secure_serving.go:123] Serving securely on 127.0.0.1:10259
E0214 04:26:49.339111 1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:26:49.342083 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 04:26:49.342243 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 04:26:49.349890 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 04:26:49.351058 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 04:26:49.351232 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:26:49.351262 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:49.351378 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 04:26:49.352808 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 04:26:49.352856 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:26:49.352931 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:50.341298 1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0214 04:26:50.344225 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0214 04:26:50.354049 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0214 04:26:50.354902 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0214 04:26:50.355795 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0214 04:26:50.356957 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0214 04:26:50.358359 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0214 04:26:50.359398 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0214 04:26:50.363540 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0214 04:26:50.364920 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0214 04:26:50.365820 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0214 04:27:09.860295 1 factory.go:585] pod is already present in the activeQ
E0214 04:27:09.893518 1 factory.go:585] pod is already present in the activeQ
==> kubelet <==
-- Journal begins at Wed 2024-02-14 04:21:11 UTC, ends at Wed 2024-02-14 04:39:49 UTC. --
Feb 14 04:35:19 old-k8s-version-960884 kubelet[3169]: E0214 04:35:19.987107 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:35:31 old-k8s-version-960884 kubelet[3169]: E0214 04:35:31.986539 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:35:42 old-k8s-version-960884 kubelet[3169]: E0214 04:35:42.986749 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:35:55 old-k8s-version-960884 kubelet[3169]: E0214 04:35:55.987608 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:36:09 old-k8s-version-960884 kubelet[3169]: E0214 04:36:09.986412 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:36:23 old-k8s-version-960884 kubelet[3169]: E0214 04:36:23.986305 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:36:35 old-k8s-version-960884 kubelet[3169]: E0214 04:36:35.987159 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:36:42 old-k8s-version-960884 kubelet[3169]: E0214 04:36:42.088363 3169 container_manager_linux.go:510] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service
Feb 14 04:36:49 old-k8s-version-960884 kubelet[3169]: E0214 04:36:49.985981 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:37:04 old-k8s-version-960884 kubelet[3169]: E0214 04:37:04.986192 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:37:19 old-k8s-version-960884 kubelet[3169]: E0214 04:37:19.986324 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:37:33 old-k8s-version-960884 kubelet[3169]: E0214 04:37:33.986548 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:37:45 old-k8s-version-960884 kubelet[3169]: E0214 04:37:45.986897 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:37:57 old-k8s-version-960884 kubelet[3169]: E0214 04:37:57.986220 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:38:08 old-k8s-version-960884 kubelet[3169]: E0214 04:38:08.998112 3169 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Feb 14 04:38:08 old-k8s-version-960884 kubelet[3169]: E0214 04:38:08.998208 3169 kuberuntime_image.go:50] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Feb 14 04:38:08 old-k8s-version-960884 kubelet[3169]: E0214 04:38:08.998270 3169 kuberuntime_manager.go:783] container start failed: ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Feb 14 04:38:08 old-k8s-version-960884 kubelet[3169]: E0214 04:38:08.998303 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
Feb 14 04:38:22 old-k8s-version-960884 kubelet[3169]: E0214 04:38:22.986630 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:38:34 old-k8s-version-960884 kubelet[3169]: E0214 04:38:34.001103 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:38:48 old-k8s-version-960884 kubelet[3169]: E0214 04:38:48.986863 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:38:59 old-k8s-version-960884 kubelet[3169]: E0214 04:38:59.986242 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:39:14 old-k8s-version-960884 kubelet[3169]: E0214 04:39:14.986472 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:39:29 old-k8s-version-960884 kubelet[3169]: E0214 04:39:29.987309 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Feb 14 04:39:43 old-k8s-version-960884 kubelet[3169]: E0214 04:39:43.986649 3169 pod_workers.go:191] Error syncing pod 2dc894aa-a939-449b-920c-581740c11163 ("metrics-server-74d5856cc6-msxjd_kube-system(2dc894aa-a939-449b-920c-581740c11163)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> storage-provisioner [8f5f681f9794f6161492c2a1a51d66b47154b588b2baf33eb0f1ae7c80bf89c6] <==
I0214 04:27:13.221352 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0214 04:27:13.237375 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0214 04:27:13.237476 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0214 04:27:13.246016 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0214 04:27:13.246216 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-960884_b849acf6-8bb7-4535-aeb5-efb2c4228d0c!
I0214 04:27:13.248314 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"2dbdfca2-a4bf-4471-9a7f-a3d7d8aeef69", APIVersion:"v1", ResourceVersion:"414", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-960884_b849acf6-8bb7-4535-aeb5-efb2c4228d0c became leader
I0214 04:27:13.347964 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-960884_b849acf6-8bb7-4535-aeb5-efb2c4228d0c!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-960884 -n old-k8s-version-960884
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-960884 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-74d5856cc6-msxjd
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-960884 describe pod metrics-server-74d5856cc6-msxjd
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-960884 describe pod metrics-server-74d5856cc6-msxjd: exit status 1 (65.9581ms)
** stderr **
Error from server (NotFound): pods "metrics-server-74d5856cc6-msxjd" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-960884 describe pod metrics-server-74d5856cc6-msxjd: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (147.72s)
=== RUN TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:81: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-558086 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=crio --driver=kvm2 --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-558086 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=crio --driver=kvm2 --container-runtime=crio: (9.176216798s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (9.18s)
=== RUN TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-558086
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-558086: exit status 85 (75.873355ms)
-- stdout --
==> Audit <==
|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
| start | -o=json --download-only | download-only-558086 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | -p download-only-558086 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
==> Last Start <==
Log file created at: 2024/02/14 02:48:03
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 02:48:03.139144 1494704 out.go:291] Setting OutFile to fd 1 ...
I0214 02:48:03.139294 1494704 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 02:48:03.139307 1494704 out.go:304] Setting ErrFile to fd 2...
I0214 02:48:03.139315 1494704 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 02:48:03.139618 1494704 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
W0214 02:48:03.139825 1494704 root.go:314] Error reading config file at /home/jenkins/minikube-integration/17909-1487441/.minikube/config/config.json: open /home/jenkins/minikube-integration/17909-1487441/.minikube/config/config.json: no such file or directory
I0214 02:48:03.140578 1494704 out.go:298] Setting JSON to true
I0214 02:48:03.141657 1494704 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":19830,"bootTime":1707859053,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 02:48:03.141728 1494704 start.go:138] virtualization: kvm guest
I0214 02:48:03.144410 1494704 out.go:97] [download-only-558086] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 02:48:03.145893 1494704 out.go:169] MINIKUBE_LOCATION=17909
W0214 02:48:03.144534 1494704 preload.go:294] Failed to list preload files: open /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball: no such file or directory
I0214 02:48:03.144621 1494704 notify.go:220] Checking for updates...
I0214 02:48:03.148535 1494704 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 02:48:03.149877 1494704 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 02:48:03.151141 1494704 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 02:48:03.152407 1494704 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
W0214 02:48:03.154833 1494704 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I0214 02:48:03.155037 1494704 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 02:48:03.186708 1494704 out.go:97] Using the kvm2 driver based on user configuration
I0214 02:48:03.186749 1494704 start.go:296] selected driver: kvm2
I0214 02:48:03.186756 1494704 start.go:900] validating driver "kvm2" against <nil>
I0214 02:48:03.187106 1494704 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 02:48:03.187187 1494704 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 02:48:03.201572 1494704 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 02:48:03.201629 1494704 start_flags.go:308] no existing cluster config was found, will generate one from the flags
I0214 02:48:03.202112 1494704 start_flags.go:391] Using suggested 6000MB memory alloc based on sys=32089MB, container=0MB
I0214 02:48:03.202263 1494704 start_flags.go:925] Wait components to verify : map[apiserver:true system_pods:true]
I0214 02:48:03.202333 1494704 cni.go:84] Creating CNI manager for ""
I0214 02:48:03.202347 1494704 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 02:48:03.202355 1494704 start_flags.go:317] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0214 02:48:03.202404 1494704 start.go:339] cluster config:
{Name:download-only-558086 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:6000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-558086 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Cont
ainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 02:48:03.202560 1494704 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 02:48:03.204527 1494704 out.go:97] Downloading VM boot image ...
I0214 02:48:03.204589 1494704 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso.sha256 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/iso/amd64/minikube-v1.32.1-1703784139-17866-amd64.iso
I0214 02:48:06.293084 1494704 out.go:97] Starting "download-only-558086" primary control-plane node in "download-only-558086" cluster
I0214 02:48:06.293112 1494704 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0214 02:48:06.321530 1494704 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4
I0214 02:48:06.321558 1494704 cache.go:56] Caching tarball of preloaded images
I0214 02:48:06.321690 1494704 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0214 02:48:06.323550 1494704 out.go:97] Downloading Kubernetes v1.16.0 preload ...
I0214 02:48:06.323567 1494704 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 ...
I0214 02:48:06.362550 1494704 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4?checksum=md5:432b600409d778ea7a21214e83948570 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4
* The control-plane node download-only-558086 host does not exist
To start a cluster, run: "minikube start -p download-only-558086"
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.08s)
=== RUN TestDownloadOnly/v1.16.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run: out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.16.0/DeleteAll (0.15s)
=== RUN TestDownloadOnly/v1.16.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run: out/minikube-linux-amd64 delete -p download-only-558086
--- PASS: TestDownloadOnly/v1.16.0/DeleteAlwaysSucceeds (0.14s)
=== RUN TestDownloadOnly/v1.28.4/json-events
aaa_download_only_test.go:81: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-082683 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=crio --driver=kvm2 --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-082683 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=crio --driver=kvm2 --container-runtime=crio: (6.123531374s)
--- PASS: TestDownloadOnly/v1.28.4/json-events (6.12s)
=== RUN TestDownloadOnly/v1.28.4/preload-exists
--- PASS: TestDownloadOnly/v1.28.4/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.28.4/LogsDuration
aaa_download_only_test.go:184: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-082683
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-082683: exit status 85 (78.532433ms)
-- stdout --
==> Audit <==
|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-558086 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | -p download-only-558086 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | --all | minikube | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| delete | -p download-only-558086 | download-only-558086 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| start | -o=json --download-only | download-only-082683 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | -p download-only-082683 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 02:48:12
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 02:48:12.678263 1494869 out.go:291] Setting OutFile to fd 1 ...
I0214 02:48:12.678511 1494869 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 02:48:12.678519 1494869 out.go:304] Setting ErrFile to fd 2...
I0214 02:48:12.678524 1494869 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 02:48:12.678715 1494869 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 02:48:12.679343 1494869 out.go:298] Setting JSON to true
I0214 02:48:12.680297 1494869 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":19840,"bootTime":1707859053,"procs":211,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 02:48:12.680358 1494869 start.go:138] virtualization: kvm guest
I0214 02:48:12.682796 1494869 out.go:97] [download-only-082683] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 02:48:12.684337 1494869 out.go:169] MINIKUBE_LOCATION=17909
I0214 02:48:12.682978 1494869 notify.go:220] Checking for updates...
I0214 02:48:12.686977 1494869 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 02:48:12.688297 1494869 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 02:48:12.689592 1494869 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 02:48:12.691049 1494869 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
W0214 02:48:12.693535 1494869 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I0214 02:48:12.693791 1494869 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 02:48:12.725440 1494869 out.go:97] Using the kvm2 driver based on user configuration
I0214 02:48:12.725468 1494869 start.go:296] selected driver: kvm2
I0214 02:48:12.725479 1494869 start.go:900] validating driver "kvm2" against <nil>
I0214 02:48:12.725774 1494869 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 02:48:12.725843 1494869 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 02:48:12.740372 1494869 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 02:48:12.740426 1494869 start_flags.go:308] no existing cluster config was found, will generate one from the flags
I0214 02:48:12.740897 1494869 start_flags.go:391] Using suggested 6000MB memory alloc based on sys=32089MB, container=0MB
I0214 02:48:12.741027 1494869 start_flags.go:925] Wait components to verify : map[apiserver:true system_pods:true]
I0214 02:48:12.741085 1494869 cni.go:84] Creating CNI manager for ""
I0214 02:48:12.741100 1494869 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 02:48:12.741112 1494869 start_flags.go:317] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0214 02:48:12.741187 1494869 start.go:339] cluster config:
{Name:download-only-082683 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:6000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:download-only-082683 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Cont
ainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 02:48:12.741303 1494869 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 02:48:12.743044 1494869 out.go:97] Starting "download-only-082683" primary control-plane node in "download-only-082683" cluster
I0214 02:48:12.743057 1494869 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 02:48:12.771803 1494869 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 02:48:12.771822 1494869 cache.go:56] Caching tarball of preloaded images
I0214 02:48:12.771956 1494869 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0214 02:48:12.773843 1494869 out.go:97] Downloading Kubernetes v1.28.4 preload ...
I0214 02:48:12.773859 1494869 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 ...
I0214 02:48:12.805725 1494869 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4?checksum=md5:b0bd7b3b222c094c365d9c9e10e48fc7 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0214 02:48:17.037217 1494869 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 ...
I0214 02:48:17.037359 1494869 preload.go:255] verifying checksum of /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 ...
* The control-plane node download-only-082683 host does not exist
To start a cluster, run: "minikube start -p download-only-082683"
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.4/LogsDuration (0.08s)
=== RUN TestDownloadOnly/v1.28.4/DeleteAll
aaa_download_only_test.go:197: (dbg) Run: out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.4/DeleteAll (0.15s)
=== RUN TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run: out/minikube-linux-amd64 delete -p download-only-082683
--- PASS: TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.14s)
=== RUN TestDownloadOnly/v1.29.0-rc.2/json-events
aaa_download_only_test.go:81: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-867870 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=crio --driver=kvm2 --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-867870 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=crio --driver=kvm2 --container-runtime=crio: (5.533874541s)
--- PASS: TestDownloadOnly/v1.29.0-rc.2/json-events (5.53s)
=== RUN TestDownloadOnly/v1.29.0-rc.2/preload-exists
--- PASS: TestDownloadOnly/v1.29.0-rc.2/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.29.0-rc.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-867870
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-867870: exit status 85 (77.877593ms)
-- stdout --
==> Audit <==
|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-558086 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | -p download-only-558086 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | --all | minikube | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| delete | -p download-only-558086 | download-only-558086 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| start | -o=json --download-only | download-only-082683 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | -p download-only-082683 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.28.4 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| delete | --all | minikube | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| delete | -p download-only-082683 | download-only-082683 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | 14 Feb 24 02:48 UTC |
| start | -o=json --download-only | download-only-867870 | jenkins | v1.32.0 | 14 Feb 24 02:48 UTC | |
| | -p download-only-867870 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.29.0-rc.2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/02/14 02:48:19
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.21.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0214 02:48:19.170219 1495023 out.go:291] Setting OutFile to fd 1 ...
I0214 02:48:19.170453 1495023 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 02:48:19.170462 1495023 out.go:304] Setting ErrFile to fd 2...
I0214 02:48:19.170467 1495023 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 02:48:19.170649 1495023 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 02:48:19.171208 1495023 out.go:298] Setting JSON to true
I0214 02:48:19.172187 1495023 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":19847,"bootTime":1707859053,"procs":211,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 02:48:19.172257 1495023 start.go:138] virtualization: kvm guest
I0214 02:48:19.174750 1495023 out.go:97] [download-only-867870] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 02:48:19.176288 1495023 out.go:169] MINIKUBE_LOCATION=17909
I0214 02:48:19.174935 1495023 notify.go:220] Checking for updates...
I0214 02:48:19.179391 1495023 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 02:48:19.180926 1495023 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 02:48:19.182561 1495023 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 02:48:19.184262 1495023 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
W0214 02:48:19.187006 1495023 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I0214 02:48:19.187250 1495023 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 02:48:19.220921 1495023 out.go:97] Using the kvm2 driver based on user configuration
I0214 02:48:19.220956 1495023 start.go:296] selected driver: kvm2
I0214 02:48:19.220963 1495023 start.go:900] validating driver "kvm2" against <nil>
I0214 02:48:19.221381 1495023 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 02:48:19.221488 1495023 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-1487441/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0214 02:48:19.235993 1495023 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0214 02:48:19.236053 1495023 start_flags.go:308] no existing cluster config was found, will generate one from the flags
I0214 02:48:19.236515 1495023 start_flags.go:391] Using suggested 6000MB memory alloc based on sys=32089MB, container=0MB
I0214 02:48:19.236646 1495023 start_flags.go:925] Wait components to verify : map[apiserver:true system_pods:true]
I0214 02:48:19.236712 1495023 cni.go:84] Creating CNI manager for ""
I0214 02:48:19.236726 1495023 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0214 02:48:19.236733 1495023 start_flags.go:317] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0214 02:48:19.236790 1495023 start.go:339] cluster config:
{Name:download-only-867870 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:6000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:download-only-867870 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 02:48:19.236907 1495023 iso.go:125] acquiring lock: {Name:mk909a99aeee05c08712bda2b2268d5c0717a6ba Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0214 02:48:19.238898 1495023 out.go:97] Starting "download-only-867870" primary control-plane node in "download-only-867870" cluster
I0214 02:48:19.238916 1495023 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 02:48:19.271474 1495023 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4
I0214 02:48:19.271503 1495023 cache.go:56] Caching tarball of preloaded images
I0214 02:48:19.271630 1495023 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 02:48:19.273599 1495023 out.go:97] Downloading Kubernetes v1.29.0-rc.2 preload ...
I0214 02:48:19.273622 1495023 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 ...
I0214 02:48:19.306914 1495023 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4?checksum=md5:9e0f57288adacc30aad3ff7e72a8dc68 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4
I0214 02:48:22.939955 1495023 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 ...
I0214 02:48:22.940051 1495023 preload.go:255] verifying checksum of /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 ...
I0214 02:48:23.861678 1495023 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on crio
I0214 02:48:23.862027 1495023 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/download-only-867870/config.json ...
I0214 02:48:23.862059 1495023 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/download-only-867870/config.json: {Name:mkd601482b7535086c56364b3ef61a45b8f75ea1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0214 02:48:23.862226 1495023 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
I0214 02:48:23.862357 1495023 download.go:107] Downloading: https://dl.k8s.io/release/v1.29.0-rc.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.29.0-rc.2/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/17909-1487441/.minikube/cache/linux/amd64/v1.29.0-rc.2/kubectl
* The control-plane node download-only-867870 host does not exist
To start a cluster, run: "minikube start -p download-only-867870"
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.08s)
=== RUN TestDownloadOnly/v1.29.0-rc.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run: out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.15s)
=== RUN TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run: out/minikube-linux-amd64 delete -p download-only-867870
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.14s)
=== RUN TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run: out/minikube-linux-amd64 start --download-only -p binary-mirror-299732 --alsologtostderr --binary-mirror http://127.0.0.1:39433 --driver=kvm2 --container-runtime=crio
helpers_test.go:175: Cleaning up "binary-mirror-299732" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p binary-mirror-299732
--- PASS: TestBinaryMirror (0.60s)
=== RUN TestOffline
=== PAUSE TestOffline
=== CONT TestOffline
aab_offline_test.go:55: (dbg) Run: out/minikube-linux-amd64 start -p offline-crio-796275 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=kvm2 --container-runtime=crio
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-amd64 start -p offline-crio-796275 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=kvm2 --container-runtime=crio: (2m17.875815642s)
helpers_test.go:175: Cleaning up "offline-crio-796275" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p offline-crio-796275
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p offline-crio-796275: (1.236627629s)
--- PASS: TestOffline (139.11s)
=== RUN TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== CONT TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:928: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p addons-800005
addons_test.go:928: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p addons-800005: exit status 85 (69.360732ms)
-- stdout --
* Profile "addons-800005" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p addons-800005"
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)
=== RUN TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== CONT TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run: out/minikube-linux-amd64 addons disable dashboard -p addons-800005
addons_test.go:939: (dbg) Non-zero exit: out/minikube-linux-amd64 addons disable dashboard -p addons-800005: exit status 85 (68.246678ms)
-- stdout --
* Profile "addons-800005" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p addons-800005"
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)
=== RUN TestAddons/Setup
addons_test.go:109: (dbg) Run: out/minikube-linux-amd64 start -p addons-800005 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2 --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:109: (dbg) Done: out/minikube-linux-amd64 start -p addons-800005 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2 --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller: (2m30.124641192s)
--- PASS: TestAddons/Setup (150.12s)
=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:330: registry stabilized in 27.499762ms
addons_test.go:332: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-9l6tm" [ccff4ebf-39ee-4847-a92d-b8ee82c5c63b] Running
addons_test.go:332: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.006600848s
addons_test.go:335: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-vrqqj" [689ae998-6ed9-4bf5-82b9-cba2b81a3011] Running
addons_test.go:335: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.006398343s
addons_test.go:340: (dbg) Run: kubectl --context addons-800005 delete po -l run=registry-test --now
addons_test.go:345: (dbg) Run: kubectl --context addons-800005 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:345: (dbg) Done: kubectl --context addons-800005 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.9553308s)
addons_test.go:359: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 ip
2024/02/14 02:51:13 [DEBUG] GET http://192.168.39.41:5000
addons_test.go:388: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (17.84s)
=== RUN TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget
=== CONT TestAddons/parallel/InspektorGadget
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-qb9j4" [6cef40ca-1a88-4183-9ac1-56758f9c59e9] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.005044282s
addons_test.go:841: (dbg) Run: out/minikube-linux-amd64 addons disable inspektor-gadget -p addons-800005
addons_test.go:841: (dbg) Done: out/minikube-linux-amd64 addons disable inspektor-gadget -p addons-800005: (6.338620746s)
--- PASS: TestAddons/parallel/InspektorGadget (11.34s)
=== RUN TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer
=== CONT TestAddons/parallel/MetricsServer
addons_test.go:407: metrics-server stabilized in 27.222961ms
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-69cf46c98-7kp75" [8b154b19-9591-4cfb-9f09-8a99b2264cd7] Running
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 6.008863534s
addons_test.go:415: (dbg) Run: kubectl --context addons-800005 top pods -n kube-system
addons_test.go:432: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 addons disable metrics-server --alsologtostderr -v=1
addons_test.go:432: (dbg) Done: out/minikube-linux-amd64 -p addons-800005 addons disable metrics-server --alsologtostderr -v=1: (1.16938674s)
--- PASS: TestAddons/parallel/MetricsServer (7.27s)
=== RUN TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller
=== CONT TestAddons/parallel/HelmTiller
addons_test.go:456: tiller-deploy stabilized in 5.901627ms
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...
helpers_test.go:344: "tiller-deploy-7b677967b9-gxlps" [4737926a-4232-4741-b94d-5dc60bd19e71] Running
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.011738062s
addons_test.go:473: (dbg) Run: kubectl --context addons-800005 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version
addons_test.go:473: (dbg) Done: kubectl --context addons-800005 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (13.660825323s)
addons_test.go:478: kubectl --context addons-800005 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: unexpected stderr: Unable to use a TTY - input is not a terminal or the right kind of file
If you don't see a command prompt, try pressing enter.
warning: couldn't attach to pod/helm-test, falling back to streaming logs: unable to upgrade connection: container helm-test not found in pod helm-test_kube-system
addons_test.go:490: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (19.64s)
=== RUN TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI
=== CONT TestAddons/parallel/CSI
addons_test.go:561: csi-hostpath-driver pods stabilized in 29.953454ms
addons_test.go:564: (dbg) Run: kubectl --context addons-800005 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:569: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:574: (dbg) Run: kubectl --context addons-800005 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:579: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [f03385e6-a3be-4de7-89c9-494dbb37d2bf] Pending
helpers_test.go:344: "task-pv-pod" [f03385e6-a3be-4de7-89c9-494dbb37d2bf] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [f03385e6-a3be-4de7-89c9-494dbb37d2bf] Running
addons_test.go:579: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 14.004443351s
addons_test.go:584: (dbg) Run: kubectl --context addons-800005 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:589: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run: kubectl --context addons-800005 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run: kubectl --context addons-800005 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:594: (dbg) Run: kubectl --context addons-800005 delete pod task-pv-pod
addons_test.go:594: (dbg) Done: kubectl --context addons-800005 delete pod task-pv-pod: (1.347599309s)
addons_test.go:600: (dbg) Run: kubectl --context addons-800005 delete pvc hpvc
addons_test.go:606: (dbg) Run: kubectl --context addons-800005 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:611: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:616: (dbg) Run: kubectl --context addons-800005 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:621: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [931ecc5f-4927-41cb-8160-1d940c93a55d] Pending
helpers_test.go:344: "task-pv-pod-restore" [931ecc5f-4927-41cb-8160-1d940c93a55d] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [931ecc5f-4927-41cb-8160-1d940c93a55d] Running
addons_test.go:621: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.004962834s
addons_test.go:626: (dbg) Run: kubectl --context addons-800005 delete pod task-pv-pod-restore
addons_test.go:630: (dbg) Run: kubectl --context addons-800005 delete pvc hpvc-restore
addons_test.go:634: (dbg) Run: kubectl --context addons-800005 delete volumesnapshot new-snapshot-demo
addons_test.go:638: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:638: (dbg) Done: out/minikube-linux-amd64 -p addons-800005 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.813300237s)
addons_test.go:642: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (85.95s)
=== RUN TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp
=== CONT TestAddons/parallel/Headlamp
addons_test.go:824: (dbg) Run: out/minikube-linux-amd64 addons enable headlamp -p addons-800005 --alsologtostderr -v=1
addons_test.go:824: (dbg) Done: out/minikube-linux-amd64 addons enable headlamp -p addons-800005 --alsologtostderr -v=1: (1.638395378s)
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-7ddfbb94ff-27l8v" [ff0d4656-0f01-425c-8d71-a7615010290e] Pending
helpers_test.go:344: "headlamp-7ddfbb94ff-27l8v" [ff0d4656-0f01-425c-8d71-a7615010290e] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-7ddfbb94ff-27l8v" [ff0d4656-0f01-425c-8d71-a7615010290e] Running
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 14.00490289s
--- PASS: TestAddons/parallel/Headlamp (15.64s)
=== RUN TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner
=== CONT TestAddons/parallel/CloudSpanner
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-64c8c85f65-w4pht" [0e23cde5-1a53-4d63-9ca9-05080fa625d8] Running
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.00743446s
addons_test.go:860: (dbg) Run: out/minikube-linux-amd64 addons disable cloud-spanner -p addons-800005
--- PASS: TestAddons/parallel/CloudSpanner (5.95s)
=== RUN TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath
=== CONT TestAddons/parallel/LocalPath
addons_test.go:873: (dbg) Run: kubectl --context addons-800005 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:879: (dbg) Run: kubectl --context addons-800005 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:883: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run: kubectl --context addons-800005 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [18ed2a5b-a762-41f4-a578-212b211c8c46] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [18ed2a5b-a762-41f4-a578-212b211c8c46] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [18ed2a5b-a762-41f4-a578-212b211c8c46] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 5.003953186s
addons_test.go:891: (dbg) Run: kubectl --context addons-800005 get pvc test-pvc -o=json
addons_test.go:900: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 ssh "cat /opt/local-path-provisioner/pvc-e70ed7af-dbd6-450e-8554-0f8d99cefa0f_default_test-pvc/file1"
addons_test.go:912: (dbg) Run: kubectl --context addons-800005 delete pod test-local-path
addons_test.go:916: (dbg) Run: kubectl --context addons-800005 delete pvc test-pvc
addons_test.go:920: (dbg) Run: out/minikube-linux-amd64 -p addons-800005 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:920: (dbg) Done: out/minikube-linux-amd64 -p addons-800005 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (44.283732823s)
--- PASS: TestAddons/parallel/LocalPath (56.21s)
=== RUN TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin
=== CONT TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-5t56m" [f3b002e8-3ac8-43bf-bc29-715a94af0bd6] Running
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.006363751s
addons_test.go:955: (dbg) Run: out/minikube-linux-amd64 addons disable nvidia-device-plugin -p addons-800005
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.56s)
=== RUN TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd
=== CONT TestAddons/parallel/Yakd
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-9947fc6bf-25wdd" [a090bbba-8f13-4795-8059-30eab25731d8] Running
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.0055938s
--- PASS: TestAddons/parallel/Yakd (6.01s)
=== RUN TestAddons/serial/GCPAuth/Namespaces
addons_test.go:650: (dbg) Run: kubectl --context addons-800005 create ns new-namespace
addons_test.go:664: (dbg) Run: kubectl --context addons-800005 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.12s)
=== RUN TestCertOptions
=== PAUSE TestCertOptions
=== CONT TestCertOptions
cert_options_test.go:49: (dbg) Run: out/minikube-linux-amd64 start -p cert-options-608119 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=kvm2 --container-runtime=crio
cert_options_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-608119 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=kvm2 --container-runtime=crio: (1m34.749630555s)
cert_options_test.go:60: (dbg) Run: out/minikube-linux-amd64 -p cert-options-608119 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run: kubectl --context cert-options-608119 config view
cert_options_test.go:100: (dbg) Run: out/minikube-linux-amd64 ssh -p cert-options-608119 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-608119" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cert-options-608119
--- PASS: TestCertOptions (96.14s)
=== RUN TestCertExpiration
=== PAUSE TestCertExpiration
=== CONT TestCertExpiration
cert_options_test.go:123: (dbg) Run: out/minikube-linux-amd64 start -p cert-expiration-239926 --memory=2048 --cert-expiration=3m --driver=kvm2 --container-runtime=crio
cert_options_test.go:123: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-239926 --memory=2048 --cert-expiration=3m --driver=kvm2 --container-runtime=crio: (2m2.665718885s)
E0214 04:05:56.222529 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 04:06:13.610941 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Run: out/minikube-linux-amd64 start -p cert-expiration-239926 --memory=2048 --cert-expiration=8760h --driver=kvm2 --container-runtime=crio
cert_options_test.go:131: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-239926 --memory=2048 --cert-expiration=8760h --driver=kvm2 --container-runtime=crio: (24.856660619s)
helpers_test.go:175: Cleaning up "cert-expiration-239926" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cert-expiration-239926
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-239926: (1.121928327s)
--- PASS: TestCertExpiration (328.65s)
=== RUN TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag
=== CONT TestForceSystemdFlag
docker_test.go:91: (dbg) Run: out/minikube-linux-amd64 start -p force-systemd-flag-681097 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=kvm2 --container-runtime=crio
docker_test.go:91: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-681097 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=kvm2 --container-runtime=crio: (1m19.064673665s)
docker_test.go:132: (dbg) Run: out/minikube-linux-amd64 -p force-systemd-flag-681097 ssh "cat /etc/crio/crio.conf.d/02-crio.conf"
helpers_test.go:175: Cleaning up "force-systemd-flag-681097" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p force-systemd-flag-681097
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-681097: (1.077050275s)
--- PASS: TestForceSystemdFlag (80.36s)
=== RUN TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv
=== CONT TestForceSystemdEnv
docker_test.go:155: (dbg) Run: out/minikube-linux-amd64 start -p force-systemd-env-059598 --memory=2048 --alsologtostderr -v=5 --driver=kvm2 --container-runtime=crio
docker_test.go:155: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-059598 --memory=2048 --alsologtostderr -v=5 --driver=kvm2 --container-runtime=crio: (1m6.06575734s)
helpers_test.go:175: Cleaning up "force-systemd-env-059598" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p force-systemd-env-059598
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-059598: (1.05107649s)
--- PASS: TestForceSystemdEnv (67.12s)
=== RUN TestKVMDriverInstallOrUpdate
=== PAUSE TestKVMDriverInstallOrUpdate
=== CONT TestKVMDriverInstallOrUpdate
--- PASS: TestKVMDriverInstallOrUpdate (3.20s)
=== RUN TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run: out/minikube-linux-amd64 start -p nospam-024071 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-024071 --driver=kvm2 --container-runtime=crio
error_spam_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -p nospam-024071 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-024071 --driver=kvm2 --container-runtime=crio: (45.132223712s)
--- PASS: TestErrorSpam/setup (45.13s)
=== RUN TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 start --dry-run
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 start --dry-run
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 start --dry-run
--- PASS: TestErrorSpam/start (0.39s)
=== RUN TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 status
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 status
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 status
--- PASS: TestErrorSpam/status (0.80s)
=== RUN TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 pause
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 pause
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 pause
--- PASS: TestErrorSpam/pause (1.60s)
=== RUN TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 unpause
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 unpause
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 unpause
--- PASS: TestErrorSpam/unpause (1.69s)
=== RUN TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 stop: (2.225448413s)
error_spam_test.go:159: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 stop: (1.400635107s)
error_spam_test.go:182: (dbg) Run: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 stop
error_spam_test.go:182: (dbg) Done: out/minikube-linux-amd64 -p nospam-024071 --log_dir /tmp/nospam-024071 stop: (1.325748472s)
--- PASS: TestErrorSpam/stop (4.95s)
=== RUN TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/17909-1487441/.minikube/files/etc/test/nested/copy/1494692/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)
=== RUN TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run: out/minikube-linux-amd64 start -p functional-262041 --memory=4000 --apiserver-port=8441 --wait=all --driver=kvm2 --container-runtime=crio
functional_test.go:2230: (dbg) Done: out/minikube-linux-amd64 start -p functional-262041 --memory=4000 --apiserver-port=8441 --wait=all --driver=kvm2 --container-runtime=crio: (1m43.268892232s)
--- PASS: TestFunctional/serial/StartWithProxy (103.27s)
=== RUN TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)
=== RUN TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run: out/minikube-linux-amd64 start -p functional-262041 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-amd64 start -p functional-262041 --alsologtostderr -v=8: (35.051600531s)
functional_test.go:659: soft start took 35.052259507s for "functional-262041" cluster.
--- PASS: TestFunctional/serial/SoftStart (35.05s)
=== RUN TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run: kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.04s)
=== RUN TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run: kubectl --context functional-262041 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.09s)
=== RUN TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 cache add registry.k8s.io/pause:3.1: (1.049899644s)
functional_test.go:1045: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 cache add registry.k8s.io/pause:3.3: (1.138646463s)
functional_test.go:1045: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 cache add registry.k8s.io/pause:latest: (1.058375056s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.25s)
=== RUN TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run: docker build -t minikube-local-cache-test:functional-262041 /tmp/TestFunctionalserialCacheCmdcacheadd_local543823119/001
functional_test.go:1085: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cache add minikube-local-cache-test:functional-262041
functional_test.go:1085: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 cache add minikube-local-cache-test:functional-262041: (1.410686801s)
functional_test.go:1090: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cache delete minikube-local-cache-test:functional-262041
functional_test.go:1079: (dbg) Run: docker rmi minikube-local-cache-test:functional-262041
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.76s)
=== RUN TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)
=== RUN TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run: out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)
=== RUN TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.25s)
=== RUN TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (242.976382ms)
-- stdout --
[31mFATA[0m[0000] no such image "registry.k8s.io/pause:latest" present
-- /stdout --
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test.go:1154: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cache reload
functional_test.go:1159: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.72s)
=== RUN TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)
=== RUN TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 kubectl -- --context functional-262041 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.12s)
=== RUN TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run: out/kubectl --context functional-262041 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.12s)
=== RUN TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run: out/minikube-linux-amd64 start -p functional-262041 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0214 03:00:56.225184 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:56.231188 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:56.241458 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:56.261734 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:56.301961 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:56.382311 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:56.542776 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:56.863398 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:57.504083 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:00:58.784359 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:01:01.346193 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
functional_test.go:753: (dbg) Done: out/minikube-linux-amd64 start -p functional-262041 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (36.672290354s)
functional_test.go:757: restart took 36.672429112s for "functional-262041" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (36.67s)
=== RUN TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run: kubectl --context functional-262041 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.07s)
=== RUN TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 logs
E0214 03:01:06.466912 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
functional_test.go:1232: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 logs: (1.499263265s)
--- PASS: TestFunctional/serial/LogsCmd (1.50s)
=== RUN TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 logs --file /tmp/TestFunctionalserialLogsFileCmd3501963413/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 logs --file /tmp/TestFunctionalserialLogsFileCmd3501963413/001/logs.txt: (1.559733604s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.56s)
=== RUN TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run: kubectl --context functional-262041 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run: out/minikube-linux-amd64 service invalid-svc -p functional-262041
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-amd64 service invalid-svc -p functional-262041: exit status 115 (314.57076ms)
-- stdout --
|-----------|-------------|-------------|-----------------------------|
| NAMESPACE | NAME | TARGET PORT | URL |
|-----------|-------------|-------------|-----------------------------|
| default | invalid-svc | 80 | http://192.168.39.106:31435 |
|-----------|-------------|-------------|-----------------------------|
-- /stdout --
** stderr **
X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
functional_test.go:2323: (dbg) Run: kubectl --context functional-262041 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (3.94s)
=== RUN TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 config unset cpus
functional_test.go:1195: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 config get cpus: exit status 14 (80.131512ms)
** stderr **
Error: specified key could not be found in config
** /stderr **
functional_test.go:1195: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 config set cpus 2
functional_test.go:1195: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 config get cpus
functional_test.go:1195: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 config unset cpus
functional_test.go:1195: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 config get cpus: exit status 14 (57.495693ms)
** stderr **
Error: specified key could not be found in config
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.45s)
=== RUN TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd
=== CONT TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-262041 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-262041 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 1502907: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (22.12s)
=== RUN TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun
=== CONT TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run: out/minikube-linux-amd64 start -p functional-262041 --dry-run --memory 250MB --alsologtostderr --driver=kvm2 --container-runtime=crio
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-262041 --dry-run --memory 250MB --alsologtostderr --driver=kvm2 --container-runtime=crio: exit status 23 (151.426103ms)
-- stdout --
* [functional-262041] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17909
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on existing profile
-- /stdout --
** stderr **
I0214 03:01:42.447194 1502788 out.go:291] Setting OutFile to fd 1 ...
I0214 03:01:42.447377 1502788 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:42.447389 1502788 out.go:304] Setting ErrFile to fd 2...
I0214 03:01:42.447396 1502788 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:42.447575 1502788 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:01:42.448210 1502788 out.go:298] Setting JSON to false
I0214 03:01:42.449289 1502788 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":20650,"bootTime":1707859053,"procs":190,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:01:42.449352 1502788 start.go:138] virtualization: kvm guest
I0214 03:01:42.452368 1502788 out.go:177] * [functional-262041] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 03:01:42.453918 1502788 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:01:42.453924 1502788 notify.go:220] Checking for updates...
I0214 03:01:42.455506 1502788 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:01:42.457037 1502788 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:01:42.458552 1502788 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:01:42.459876 1502788 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:01:42.461241 1502788 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:01:42.463227 1502788 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:42.463846 1502788 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:42.463932 1502788 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:42.478878 1502788 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41925
I0214 03:01:42.479310 1502788 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:42.479897 1502788 main.go:141] libmachine: Using API Version 1
I0214 03:01:42.479922 1502788 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:42.480288 1502788 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:42.480484 1502788 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:42.480737 1502788 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:01:42.481093 1502788 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:42.481138 1502788 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:42.495794 1502788 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40949
I0214 03:01:42.496260 1502788 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:42.496706 1502788 main.go:141] libmachine: Using API Version 1
I0214 03:01:42.496739 1502788 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:42.497046 1502788 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:42.497341 1502788 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:42.531427 1502788 out.go:177] * Using the kvm2 driver based on existing profile
I0214 03:01:42.532884 1502788 start.go:296] selected driver: kvm2
I0214 03:01:42.532906 1502788 start.go:900] validating driver "kvm2" against &{Name:functional-262041 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:functional-262041 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.106 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mo
unt:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:01:42.533060 1502788 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:01:42.535303 1502788 out.go:177]
W0214 03:01:42.536565 1502788 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
I0214 03:01:42.537834 1502788 out.go:177]
** /stderr **
functional_test.go:987: (dbg) Run: out/minikube-linux-amd64 start -p functional-262041 --dry-run --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio
--- PASS: TestFunctional/parallel/DryRun (0.31s)
=== RUN TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage
=== CONT TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run: out/minikube-linux-amd64 start -p functional-262041 --dry-run --memory 250MB --alsologtostderr --driver=kvm2 --container-runtime=crio
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-262041 --dry-run --memory 250MB --alsologtostderr --driver=kvm2 --container-runtime=crio: exit status 23 (168.881713ms)
-- stdout --
* [functional-262041] minikube v1.32.0 sur Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17909
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Utilisation du pilote kvm2 basé sur le profil existant
-- /stdout --
** stderr **
I0214 03:01:42.775651 1502843 out.go:291] Setting OutFile to fd 1 ...
I0214 03:01:42.775889 1502843 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:42.775903 1502843 out.go:304] Setting ErrFile to fd 2...
I0214 03:01:42.775912 1502843 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:42.776334 1502843 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:01:42.777148 1502843 out.go:298] Setting JSON to false
I0214 03:01:42.778599 1502843 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":20650,"bootTime":1707859053,"procs":191,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 03:01:42.778707 1502843 start.go:138] virtualization: kvm guest
I0214 03:01:42.782368 1502843 out.go:177] * [functional-262041] minikube v1.32.0 sur Ubuntu 20.04 (kvm/amd64)
I0214 03:01:42.784592 1502843 notify.go:220] Checking for updates...
I0214 03:01:42.784617 1502843 out.go:177] - MINIKUBE_LOCATION=17909
I0214 03:01:42.786156 1502843 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 03:01:42.787696 1502843 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 03:01:42.789295 1502843 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 03:01:42.790721 1502843 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 03:01:42.792121 1502843 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 03:01:42.794114 1502843 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:42.794755 1502843 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:42.794855 1502843 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:42.810529 1502843 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34265
I0214 03:01:42.811025 1502843 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:42.811603 1502843 main.go:141] libmachine: Using API Version 1
I0214 03:01:42.811640 1502843 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:42.811996 1502843 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:42.812174 1502843 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:42.812432 1502843 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 03:01:42.812822 1502843 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:42.812878 1502843 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:42.827461 1502843 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41073
I0214 03:01:42.827869 1502843 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:42.828426 1502843 main.go:141] libmachine: Using API Version 1
I0214 03:01:42.828451 1502843 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:42.828799 1502843 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:42.829045 1502843 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:42.862282 1502843 out.go:177] * Utilisation du pilote kvm2 basé sur le profil existant
I0214 03:01:42.863646 1502843 start.go:296] selected driver: kvm2
I0214 03:01:42.863670 1502843 start.go:900] validating driver "kvm2" against &{Name:functional-262041 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17866/minikube-v1.32.1-1703784139-17866-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1704759386-17866@sha256:8c3c33047f9bc285e1f5f2a5aa14744a2fe04c58478f02f77b06169dea8dd3f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:functional-262041 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.106 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mo
unt:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:}
I0214 03:01:42.863830 1502843 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 03:01:42.866141 1502843 out.go:177]
W0214 03:01:42.867456 1502843 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
I0214 03:01:42.868899 1502843 out.go:177]
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.17s)
=== RUN TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd
=== CONT TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 status
functional_test.go:856: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.16s)
=== RUN TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect
=== CONT TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1625: (dbg) Run: kubectl --context functional-262041 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8
functional_test.go:1631: (dbg) Run: kubectl --context functional-262041 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-55497b8b78-vw6qz" [0514d7c2-972e-451c-9bb1-b061ddf60511] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])
E0214 03:01:16.707835 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
helpers_test.go:344: "hello-node-connect-55497b8b78-vw6qz" [0514d7c2-972e-451c-9bb1-b061ddf60511] Running
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 12.004042526s
functional_test.go:1645: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 service hello-node-connect --url
functional_test.go:1651: found endpoint for hello-node-connect: http://192.168.39.106:32514
functional_test.go:1671: http://192.168.39.106:32514: success! body:
Hostname: hello-node-connect-55497b8b78-vw6qz
Pod Information:
-no pod information available-
Server values:
server_version=nginx: 1.13.3 - lua: 10008
Request Information:
client_address=10.244.0.1
method=GET
real path=/
query=
request_version=1.1
request_uri=http://192.168.39.106:8080/
Request Headers:
accept-encoding=gzip
host=192.168.39.106:32514
user-agent=Go-http-client/1.1
Request Body:
-no body in request-
--- PASS: TestFunctional/parallel/ServiceCmdConnect (12.75s)
=== RUN TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd
=== CONT TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 addons list
functional_test.go:1698: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.18s)
=== RUN TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim
=== CONT TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [925b714b-f055-495d-8c79-69b1d58b8286] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.005599259s
functional_test_pvc_test.go:49: (dbg) Run: kubectl --context functional-262041 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run: kubectl --context functional-262041 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run: kubectl --context functional-262041 get pvc myclaim -o=json
functional_test_pvc_test.go:76: (dbg) Run: kubectl --context functional-262041 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run: kubectl --context functional-262041 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [20758dad-1477-4419-8776-e468a592b8e2] Pending
helpers_test.go:344: "sp-pod" [20758dad-1477-4419-8776-e468a592b8e2] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [20758dad-1477-4419-8776-e468a592b8e2] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 15.004518878s
functional_test_pvc_test.go:100: (dbg) Run: kubectl --context functional-262041 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run: kubectl --context functional-262041 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-262041 delete -f testdata/storage-provisioner/pod.yaml: (3.620938767s)
functional_test_pvc_test.go:125: (dbg) Run: kubectl --context functional-262041 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [37ea009c-2f9d-45f0-a569-694a08e71563] Pending
helpers_test.go:344: "sp-pod" [37ea009c-2f9d-45f0-a569-694a08e71563] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [37ea009c-2f9d-45f0-a569-694a08e71563] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 23.004942791s
functional_test_pvc_test.go:114: (dbg) Run: kubectl --context functional-262041 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (51.01s)
=== RUN TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd
=== CONT TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "echo hello"
functional_test.go:1738: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.53s)
=== RUN TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd
=== CONT TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh -n functional-262041 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cp functional-262041:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd1065085256/001/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh -n functional-262041 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh -n functional-262041 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.67s)
=== RUN TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1789: (dbg) Run: kubectl --context functional-262041 replace --force -f testdata/mysql.yaml
functional_test.go:1795: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...
helpers_test.go:344: "mysql-859648c796-p67gq" [2da8c7cf-fd42-45a8-b79c-8cabeed070fc] Pending
helpers_test.go:344: "mysql-859648c796-p67gq" [2da8c7cf-fd42-45a8-b79c-8cabeed070fc] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])
helpers_test.go:344: "mysql-859648c796-p67gq" [2da8c7cf-fd42-45a8-b79c-8cabeed070fc] Running
functional_test.go:1795: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 28.006582644s
functional_test.go:1803: (dbg) Run: kubectl --context functional-262041 exec mysql-859648c796-p67gq -- mysql -ppassword -e "show databases;"
functional_test.go:1803: (dbg) Non-zero exit: kubectl --context functional-262041 exec mysql-859648c796-p67gq -- mysql -ppassword -e "show databases;": exit status 1 (255.570633ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
command terminated with exit code 1
** /stderr **
functional_test.go:1803: (dbg) Run: kubectl --context functional-262041 exec mysql-859648c796-p67gq -- mysql -ppassword -e "show databases;"
--- PASS: TestFunctional/parallel/MySQL (30.28s)
=== RUN TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync
=== CONT TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/1494692/hosts within VM
functional_test.go:1927: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo cat /etc/test/nested/copy/1494692/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.27s)
=== RUN TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/1494692.pem within VM
functional_test.go:1969: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo cat /etc/ssl/certs/1494692.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/1494692.pem within VM
functional_test.go:1969: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo cat /usr/share/ca-certificates/1494692.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/14946922.pem within VM
functional_test.go:1996: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo cat /etc/ssl/certs/14946922.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/14946922.pem within VM
functional_test.go:1996: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo cat /usr/share/ca-certificates/14946922.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.67s)
=== RUN TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels
=== CONT TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run: kubectl --context functional-262041 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.09s)
=== RUN TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled
=== CONT TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo systemctl is-active docker"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 ssh "sudo systemctl is-active docker": exit status 1 (257.535862ms)
-- stdout --
inactive
-- /stdout --
** stderr **
ssh: Process exited with status 3
** /stderr **
functional_test.go:2023: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo systemctl is-active containerd"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 ssh "sudo systemctl is-active containerd": exit status 1 (257.991523ms)
-- stdout --
inactive
-- /stdout --
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.52s)
=== RUN TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License
=== CONT TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run: out/minikube-linux-amd64 license
--- PASS: TestFunctional/parallel/License (0.23s)
=== RUN TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short
=== CONT TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 version --short
--- PASS: TestFunctional/parallel/Version/short (0.15s)
=== RUN TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components
=== CONT TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.88s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort
=== CONT TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-262041 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.28.4
registry.k8s.io/kube-proxy:v1.28.4
registry.k8s.io/kube-controller-manager:v1.28.4
registry.k8s.io/kube-apiserver:v1.28.4
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/echoserver:1.8
registry.k8s.io/coredns/coredns:v1.10.1
localhost/minikube-local-cache-test:functional-262041
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-262041
docker.io/library/nginx:latest
docker.io/library/mysql:5.7
docker.io/kindest/kindnetd:v20230809-80a64d96
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-262041 image ls --format short --alsologtostderr:
I0214 03:01:58.342177 1503508 out.go:291] Setting OutFile to fd 1 ...
I0214 03:01:58.342296 1503508 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:58.342304 1503508 out.go:304] Setting ErrFile to fd 2...
I0214 03:01:58.342309 1503508 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:58.342510 1503508 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:01:58.343128 1503508 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:58.343231 1503508 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:58.343678 1503508 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:58.343747 1503508 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:58.359703 1503508 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33827
I0214 03:01:58.360230 1503508 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:58.360827 1503508 main.go:141] libmachine: Using API Version 1
I0214 03:01:58.360856 1503508 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:58.361339 1503508 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:58.361568 1503508 main.go:141] libmachine: (functional-262041) Calling .GetState
I0214 03:01:58.363736 1503508 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:58.363787 1503508 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:58.379091 1503508 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43939
I0214 03:01:58.379533 1503508 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:58.379993 1503508 main.go:141] libmachine: Using API Version 1
I0214 03:01:58.380015 1503508 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:58.380334 1503508 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:58.380547 1503508 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:58.380780 1503508 ssh_runner.go:195] Run: systemctl --version
I0214 03:01:58.380813 1503508 main.go:141] libmachine: (functional-262041) Calling .GetSSHHostname
I0214 03:01:58.383793 1503508 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:58.384237 1503508 main.go:141] libmachine: (functional-262041) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:0b:eb", ip: ""} in network mk-functional-262041: {Iface:virbr1 ExpiryTime:2024-02-14 03:58:18 +0000 UTC Type:0 Mac:52:54:00:aa:0b:eb Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:functional-262041 Clientid:01:52:54:00:aa:0b:eb}
I0214 03:01:58.384266 1503508 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined IP address 192.168.39.106 and MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:58.384452 1503508 main.go:141] libmachine: (functional-262041) Calling .GetSSHPort
I0214 03:01:58.384651 1503508 main.go:141] libmachine: (functional-262041) Calling .GetSSHKeyPath
I0214 03:01:58.384821 1503508 main.go:141] libmachine: (functional-262041) Calling .GetSSHUsername
I0214 03:01:58.385123 1503508 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/functional-262041/id_rsa Username:docker}
I0214 03:01:58.563120 1503508 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:01:58.657533 1503508 main.go:141] libmachine: Making call to close driver server
I0214 03:01:58.657553 1503508 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:01:58.657880 1503508 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:01:58.657913 1503508 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:01:58.657947 1503508 main.go:141] libmachine: (functional-262041) DBG | Closing plugin on server side
I0214 03:01:58.657960 1503508 main.go:141] libmachine: Making call to close driver server
I0214 03:01:58.657972 1503508 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:01:58.658214 1503508 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:01:58.658233 1503508 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:01:58.658262 1503508 main.go:141] libmachine: (functional-262041) DBG | Closing plugin on server side
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.38s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable
=== CONT TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-262041 image ls --format table --alsologtostderr:
|-----------------------------------------|--------------------|---------------|--------|
| Image | Tag | Image ID | Size |
|-----------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/coredns/coredns | v1.10.1 | ead0a4a53df89 | 53.6MB |
| registry.k8s.io/etcd | 3.5.9-0 | 73deb9a3f7025 | 295MB |
| registry.k8s.io/kube-proxy | v1.28.4 | 83f6cc407eed8 | 74.7MB |
| registry.k8s.io/pause | 3.9 | e6f1816883972 | 750kB |
| docker.io/library/mysql | 5.7 | 5107333e08a87 | 520MB |
| gcr.io/k8s-minikube/storage-provisioner | v5 | 6e38f40d628db | 31.5MB |
| localhost/minikube-local-cache-test | functional-262041 | 013beae7dea35 | 3.35kB |
| registry.k8s.io/kube-controller-manager | v1.28.4 | d058aa5ab969c | 123MB |
| registry.k8s.io/kube-scheduler | v1.28.4 | e3db313c6dbc0 | 61.6MB |
| registry.k8s.io/pause | 3.3 | 0184c1613d929 | 686kB |
| registry.k8s.io/pause | latest | 350b164e7ae1d | 247kB |
| docker.io/kindest/kindnetd | v20230809-80a64d96 | c7d1297425461 | 65.3MB |
| gcr.io/k8s-minikube/busybox | 1.28.4-glibc | 56cc512116c8f | 4.63MB |
| registry.k8s.io/kube-apiserver | v1.28.4 | 7fe0e6f37db33 | 127MB |
| registry.k8s.io/pause | 3.1 | da86e6ba6ca19 | 747kB |
| docker.io/library/nginx | latest | 247f7abff9f70 | 191MB |
| registry.k8s.io/echoserver | 1.8 | 82e4c8a736a4f | 97.8MB |
| gcr.io/google-containers/addon-resizer | functional-262041 | ffd4cfbbe753e | 34.1MB |
|-----------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-262041 image ls --format table --alsologtostderr:
I0214 03:01:59.344816 1503631 out.go:291] Setting OutFile to fd 1 ...
I0214 03:01:59.344975 1503631 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:59.344986 1503631 out.go:304] Setting ErrFile to fd 2...
I0214 03:01:59.344998 1503631 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:59.345238 1503631 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:01:59.345878 1503631 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:59.346009 1503631 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:59.346431 1503631 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:59.346500 1503631 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:59.365107 1503631 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42067
I0214 03:01:59.365586 1503631 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:59.366130 1503631 main.go:141] libmachine: Using API Version 1
I0214 03:01:59.366161 1503631 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:59.366498 1503631 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:59.366704 1503631 main.go:141] libmachine: (functional-262041) Calling .GetState
I0214 03:01:59.368492 1503631 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:59.368542 1503631 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:59.382813 1503631 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42355
I0214 03:01:59.383213 1503631 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:59.383692 1503631 main.go:141] libmachine: Using API Version 1
I0214 03:01:59.383723 1503631 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:59.384096 1503631 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:59.384330 1503631 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:59.384562 1503631 ssh_runner.go:195] Run: systemctl --version
I0214 03:01:59.384587 1503631 main.go:141] libmachine: (functional-262041) Calling .GetSSHHostname
I0214 03:01:59.387549 1503631 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:59.388007 1503631 main.go:141] libmachine: (functional-262041) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:0b:eb", ip: ""} in network mk-functional-262041: {Iface:virbr1 ExpiryTime:2024-02-14 03:58:18 +0000 UTC Type:0 Mac:52:54:00:aa:0b:eb Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:functional-262041 Clientid:01:52:54:00:aa:0b:eb}
I0214 03:01:59.388043 1503631 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined IP address 192.168.39.106 and MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:59.388244 1503631 main.go:141] libmachine: (functional-262041) Calling .GetSSHPort
I0214 03:01:59.388423 1503631 main.go:141] libmachine: (functional-262041) Calling .GetSSHKeyPath
I0214 03:01:59.388581 1503631 main.go:141] libmachine: (functional-262041) Calling .GetSSHUsername
I0214 03:01:59.388712 1503631 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/functional-262041/id_rsa Username:docker}
I0214 03:01:59.483867 1503631 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:01:59.529364 1503631 main.go:141] libmachine: Making call to close driver server
I0214 03:01:59.529390 1503631 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:01:59.529707 1503631 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:01:59.529730 1503631 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:01:59.529744 1503631 main.go:141] libmachine: Making call to close driver server
I0214 03:01:59.529753 1503631 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:01:59.530004 1503631 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:01:59.530022 1503631 main.go:141] libmachine: Making call to close connection to plugin binary
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.27s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson
=== CONT TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-262041 image ls --format json --alsologtostderr:
[{"id":"e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c","repoDigests":["registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097","registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"750414"},{"id":"c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc","repoDigests":["docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052","docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"],"repoTags":["docker.io/kindest/kindnetd:v20230809-80a64d96"],"size":"65258016"},{"id":"5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933","repoDigests":["docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb","docker.io/library/mysql@sha256:dab0a802b44617303694fb17d166501de279c3031ddeb28c56ecf7fcab5ef0da"],"repoTags":["docker.
io/library/mysql:5.7"],"size":"519571821"},{"id":"56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e","gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"4631262"},{"id":"82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410","repoDigests":["registry.k8s.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969"],"repoTags":["registry.k8s.io/echoserver:1.8"],"size":"97846543"},{"id":"7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257","repoDigests":["registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499","registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"],"repoTags":["registry.k8s.io/kube-apiserver:v1.28.4"],"size"
:"127226832"},{"id":"247f7abff9f7097bbdab57df76fedd124d1e24a6ec4944fb5ef0ad128997ce05","repoDigests":["docker.io/library/nginx@sha256:ac2b22fdbe4c13e6f3be8c5fe9a19677aa7614acaa1cbf5d354af723873cbd28","docker.io/library/nginx@sha256:b41c95c4080d503eac2e455a47280079c5905c6281a1a5ee8fe75b52a92b35a0"],"repoTags":["docker.io/library/nginx:latest"],"size":"190871401"},{"id":"0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da","repoDigests":["registry.k8s.io/pause@sha256:1000de19145c53d83aab989956fa8fca08dcbcc5b0208bdc193517905e6ccd04"],"repoTags":["registry.k8s.io/pause:3.3"],"size":"686139"},{"id":"83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e","repoDigests":["registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e","registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"],"repoTags":["registry.k8s.io/kube-proxy:v1.28.4"],"size":"74749335"},{"id":"e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b6
3881a109c5cfba1","repoDigests":["registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba","registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"],"repoTags":["registry.k8s.io/kube-scheduler:v1.28.4"],"size":"61551410"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":["gcr.io/google-containers/addon-resizer@sha256:0ce7cf4876524f069adf654e4dd3c95fe4bfc889c8bbc03cd6ecd061d9392126"],"repoTags":["gcr.io/google-containers/addon-resizer:functional-262041"],"size":"34114467"},{"id":"6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944","gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"31470524"},{"id":"013beae7dea35d
883f509655352d9d6ff76efae69247566dddfad16ccbb096b0","repoDigests":["localhost/minikube-local-cache-test@sha256:bd7ec84445a10c36ce84310d17127b851a20f6f1cd81a04dd2abcae5be97a4ff"],"repoTags":["localhost/minikube-local-cache-test:functional-262041"],"size":"3345"},{"id":"ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc","repoDigests":["registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e","registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"53621675"},{"id":"73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9","repoDigests":["registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15","registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"],"repoTags":["registry.k8s.io/etcd:3.5.9-0"],"size":"295456551"},{"id":"07655ddf2eebe5d250f7a72c25f638b271268
05d61779741b4e62e69ba080558","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93","docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029"],"repoTags":[],"size":"249229937"},{"id":"d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c","registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.28.4"],"size":"123261750"},{"id":"da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e","repoDigests":["registry.k8s.io/pause@sha256:84805ddcaaae94434d8eacb7e843f549ec1da0cd277787b97ad9d9ac2cea929e"],"repoTags":["registry.k8s.io/pause:3.1"],"size":"746911"},{"id":"350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06","repoDigests":[
"registry.k8s.io/pause@sha256:5bcb06ed43da4a16c6e6e33898eb0506e940bd66822659ecf0a898bbb0da7cb9"],"repoTags":["registry.k8s.io/pause:latest"],"size":"247077"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-262041 image ls --format json --alsologtostderr:
I0214 03:01:59.085756 1503602 out.go:291] Setting OutFile to fd 1 ...
I0214 03:01:59.085905 1503602 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:59.085917 1503602 out.go:304] Setting ErrFile to fd 2...
I0214 03:01:59.085926 1503602 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:59.086174 1503602 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:01:59.086869 1503602 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:59.087033 1503602 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:59.087603 1503602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:59.087681 1503602 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:59.103929 1503602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34959
I0214 03:01:59.104433 1503602 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:59.105095 1503602 main.go:141] libmachine: Using API Version 1
I0214 03:01:59.105137 1503602 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:59.105516 1503602 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:59.105730 1503602 main.go:141] libmachine: (functional-262041) Calling .GetState
I0214 03:01:59.107614 1503602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:59.107655 1503602 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:59.124220 1503602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34599
I0214 03:01:59.124624 1503602 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:59.125068 1503602 main.go:141] libmachine: Using API Version 1
I0214 03:01:59.125094 1503602 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:59.125455 1503602 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:59.125659 1503602 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:59.125862 1503602 ssh_runner.go:195] Run: systemctl --version
I0214 03:01:59.125896 1503602 main.go:141] libmachine: (functional-262041) Calling .GetSSHHostname
I0214 03:01:59.128942 1503602 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:59.129437 1503602 main.go:141] libmachine: (functional-262041) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:0b:eb", ip: ""} in network mk-functional-262041: {Iface:virbr1 ExpiryTime:2024-02-14 03:58:18 +0000 UTC Type:0 Mac:52:54:00:aa:0b:eb Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:functional-262041 Clientid:01:52:54:00:aa:0b:eb}
I0214 03:01:59.129474 1503602 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined IP address 192.168.39.106 and MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:59.129624 1503602 main.go:141] libmachine: (functional-262041) Calling .GetSSHPort
I0214 03:01:59.129809 1503602 main.go:141] libmachine: (functional-262041) Calling .GetSSHKeyPath
I0214 03:01:59.129942 1503602 main.go:141] libmachine: (functional-262041) Calling .GetSSHUsername
I0214 03:01:59.130068 1503602 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/functional-262041/id_rsa Username:docker}
I0214 03:01:59.230967 1503602 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:01:59.281128 1503602 main.go:141] libmachine: Making call to close driver server
I0214 03:01:59.281145 1503602 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:01:59.281498 1503602 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:01:59.281525 1503602 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:01:59.281535 1503602 main.go:141] libmachine: Making call to close driver server
I0214 03:01:59.281543 1503602 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:01:59.281777 1503602 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:01:59.281793 1503602 main.go:141] libmachine: Making call to close connection to plugin binary
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.27s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml
=== CONT TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-262041 image ls --format yaml --alsologtostderr:
- id: 5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933
repoDigests:
- docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb
- docker.io/library/mysql@sha256:dab0a802b44617303694fb17d166501de279c3031ddeb28c56ecf7fcab5ef0da
repoTags:
- docker.io/library/mysql:5.7
size: "519571821"
- id: 247f7abff9f7097bbdab57df76fedd124d1e24a6ec4944fb5ef0ad128997ce05
repoDigests:
- docker.io/library/nginx@sha256:ac2b22fdbe4c13e6f3be8c5fe9a19677aa7614acaa1cbf5d354af723873cbd28
- docker.io/library/nginx@sha256:b41c95c4080d503eac2e455a47280079c5905c6281a1a5ee8fe75b52a92b35a0
repoTags:
- docker.io/library/nginx:latest
size: "190871401"
- id: 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
- gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "4631262"
- id: 013beae7dea35d883f509655352d9d6ff76efae69247566dddfad16ccbb096b0
repoDigests:
- localhost/minikube-local-cache-test@sha256:bd7ec84445a10c36ce84310d17127b851a20f6f1cd81a04dd2abcae5be97a4ff
repoTags:
- localhost/minikube-local-cache-test:functional-262041
size: "3345"
- id: 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e
repoDigests:
- registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e
- registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532
repoTags:
- registry.k8s.io/kube-proxy:v1.28.4
size: "74749335"
- id: ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e
- registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "53621675"
- id: 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9
repoDigests:
- registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15
- registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3
repoTags:
- registry.k8s.io/etcd:3.5.9-0
size: "295456551"
- id: 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499
- registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb
repoTags:
- registry.k8s.io/kube-apiserver:v1.28.4
size: "127226832"
- id: e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba
- registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32
repoTags:
- registry.k8s.io/kube-scheduler:v1.28.4
size: "61551410"
- id: da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e
repoDigests:
- registry.k8s.io/pause@sha256:84805ddcaaae94434d8eacb7e843f549ec1da0cd277787b97ad9d9ac2cea929e
repoTags:
- registry.k8s.io/pause:3.1
size: "746911"
- id: 0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da
repoDigests:
- registry.k8s.io/pause@sha256:1000de19145c53d83aab989956fa8fca08dcbcc5b0208bdc193517905e6ccd04
repoTags:
- registry.k8s.io/pause:3.3
size: "686139"
- id: 350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06
repoDigests:
- registry.k8s.io/pause@sha256:5bcb06ed43da4a16c6e6e33898eb0506e940bd66822659ecf0a898bbb0da7cb9
repoTags:
- registry.k8s.io/pause:latest
size: "247077"
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests:
- gcr.io/google-containers/addon-resizer@sha256:0ce7cf4876524f069adf654e4dd3c95fe4bfc889c8bbc03cd6ecd061d9392126
repoTags:
- gcr.io/google-containers/addon-resizer:functional-262041
size: "34114467"
- id: 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
- gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "31470524"
- id: d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c
- registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232
repoTags:
- registry.k8s.io/kube-controller-manager:v1.28.4
size: "123261750"
- id: c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc
repoDigests:
- docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052
- docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4
repoTags:
- docker.io/kindest/kindnetd:v20230809-80a64d96
size: "65258016"
- id: 07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
- docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029
repoTags: []
size: "249229937"
- id: 82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410
repoDigests:
- registry.k8s.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969
repoTags:
- registry.k8s.io/echoserver:1.8
size: "97846543"
- id: e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c
repoDigests:
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
- registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10
repoTags:
- registry.k8s.io/pause:3.9
size: "750414"
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-262041 image ls --format yaml --alsologtostderr:
I0214 03:01:58.726022 1503531 out.go:291] Setting OutFile to fd 1 ...
I0214 03:01:58.726271 1503531 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:58.726282 1503531 out.go:304] Setting ErrFile to fd 2...
I0214 03:01:58.726287 1503531 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:58.726561 1503531 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:01:58.727376 1503531 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:58.727560 1503531 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:58.728117 1503531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:58.728201 1503531 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:58.744631 1503531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35293
I0214 03:01:58.745100 1503531 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:58.745769 1503531 main.go:141] libmachine: Using API Version 1
I0214 03:01:58.745799 1503531 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:58.746254 1503531 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:58.746486 1503531 main.go:141] libmachine: (functional-262041) Calling .GetState
I0214 03:01:58.748506 1503531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:58.748555 1503531 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:58.764954 1503531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39215
I0214 03:01:58.765432 1503531 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:58.765997 1503531 main.go:141] libmachine: Using API Version 1
I0214 03:01:58.766030 1503531 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:58.766459 1503531 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:58.766657 1503531 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:58.766855 1503531 ssh_runner.go:195] Run: systemctl --version
I0214 03:01:58.766876 1503531 main.go:141] libmachine: (functional-262041) Calling .GetSSHHostname
I0214 03:01:58.769750 1503531 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:58.770169 1503531 main.go:141] libmachine: (functional-262041) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:0b:eb", ip: ""} in network mk-functional-262041: {Iface:virbr1 ExpiryTime:2024-02-14 03:58:18 +0000 UTC Type:0 Mac:52:54:00:aa:0b:eb Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:functional-262041 Clientid:01:52:54:00:aa:0b:eb}
I0214 03:01:58.770199 1503531 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined IP address 192.168.39.106 and MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:58.770395 1503531 main.go:141] libmachine: (functional-262041) Calling .GetSSHPort
I0214 03:01:58.770590 1503531 main.go:141] libmachine: (functional-262041) Calling .GetSSHKeyPath
I0214 03:01:58.770784 1503531 main.go:141] libmachine: (functional-262041) Calling .GetSSHUsername
I0214 03:01:58.770965 1503531 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/functional-262041/id_rsa Username:docker}
I0214 03:01:58.890147 1503531 ssh_runner.go:195] Run: sudo crictl images --output json
I0214 03:01:59.008501 1503531 main.go:141] libmachine: Making call to close driver server
I0214 03:01:59.008518 1503531 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:01:59.008811 1503531 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:01:59.008820 1503531 main.go:141] libmachine: (functional-262041) DBG | Closing plugin on server side
I0214 03:01:59.008829 1503531 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:01:59.008841 1503531 main.go:141] libmachine: Making call to close driver server
I0214 03:01:59.008851 1503531 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:01:59.010810 1503531 main.go:141] libmachine: (functional-262041) DBG | Closing plugin on server side
I0214 03:01:59.010893 1503531 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:01:59.010930 1503531 main.go:141] libmachine: Making call to close connection to plugin binary
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.35s)
=== RUN TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild
=== CONT TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 ssh pgrep buildkitd: exit status 1 (225.360187ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test.go:314: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image build -t localhost/my-image:functional-262041 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 image build -t localhost/my-image:functional-262041 testdata/build --alsologtostderr: (3.624785574s)
functional_test.go:319: (dbg) Stdout: out/minikube-linux-amd64 -p functional-262041 image build -t localhost/my-image:functional-262041 testdata/build --alsologtostderr:
STEP 1/3: FROM gcr.io/k8s-minikube/busybox
STEP 2/3: RUN true
--> 709a2077f8f
STEP 3/3: ADD content.txt /
COMMIT localhost/my-image:functional-262041
--> f57d4703eb6
Successfully tagged localhost/my-image:functional-262041
f57d4703eb6118d8f416a6f648b990525bd27efdfcbdc6e041c46d93d4688581
functional_test.go:322: (dbg) Stderr: out/minikube-linux-amd64 -p functional-262041 image build -t localhost/my-image:functional-262041 testdata/build --alsologtostderr:
I0214 03:01:58.992116 1503584 out.go:291] Setting OutFile to fd 1 ...
I0214 03:01:58.992322 1503584 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:58.992337 1503584 out.go:304] Setting ErrFile to fd 2...
I0214 03:01:58.992343 1503584 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:01:58.992675 1503584 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:01:58.993581 1503584 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:58.994207 1503584 config.go:182] Loaded profile config "functional-262041": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:01:58.994705 1503584 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:58.994812 1503584 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:59.010249 1503584 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32883
I0214 03:01:59.010839 1503584 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:59.011523 1503584 main.go:141] libmachine: Using API Version 1
I0214 03:01:59.011554 1503584 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:59.011921 1503584 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:59.012100 1503584 main.go:141] libmachine: (functional-262041) Calling .GetState
I0214 03:01:59.014189 1503584 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:01:59.014248 1503584 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:01:59.030582 1503584 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34767
I0214 03:01:59.031049 1503584 main.go:141] libmachine: () Calling .GetVersion
I0214 03:01:59.031597 1503584 main.go:141] libmachine: Using API Version 1
I0214 03:01:59.031631 1503584 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:01:59.031974 1503584 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:01:59.032181 1503584 main.go:141] libmachine: (functional-262041) Calling .DriverName
I0214 03:01:59.032381 1503584 ssh_runner.go:195] Run: systemctl --version
I0214 03:01:59.032415 1503584 main.go:141] libmachine: (functional-262041) Calling .GetSSHHostname
I0214 03:01:59.035569 1503584 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:59.035944 1503584 main.go:141] libmachine: (functional-262041) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:0b:eb", ip: ""} in network mk-functional-262041: {Iface:virbr1 ExpiryTime:2024-02-14 03:58:18 +0000 UTC Type:0 Mac:52:54:00:aa:0b:eb Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:functional-262041 Clientid:01:52:54:00:aa:0b:eb}
I0214 03:01:59.035984 1503584 main.go:141] libmachine: (functional-262041) DBG | domain functional-262041 has defined IP address 192.168.39.106 and MAC address 52:54:00:aa:0b:eb in network mk-functional-262041
I0214 03:01:59.036115 1503584 main.go:141] libmachine: (functional-262041) Calling .GetSSHPort
I0214 03:01:59.036296 1503584 main.go:141] libmachine: (functional-262041) Calling .GetSSHKeyPath
I0214 03:01:59.036453 1503584 main.go:141] libmachine: (functional-262041) Calling .GetSSHUsername
I0214 03:01:59.036585 1503584 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/functional-262041/id_rsa Username:docker}
I0214 03:01:59.162446 1503584 build_images.go:151] Building image from path: /tmp/build.45517986.tar
I0214 03:01:59.162516 1503584 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0214 03:01:59.175022 1503584 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.45517986.tar
I0214 03:01:59.179898 1503584 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.45517986.tar: stat -c "%s %y" /var/lib/minikube/build/build.45517986.tar: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/build/build.45517986.tar': No such file or directory
I0214 03:01:59.179933 1503584 ssh_runner.go:362] scp /tmp/build.45517986.tar --> /var/lib/minikube/build/build.45517986.tar (3072 bytes)
I0214 03:01:59.209765 1503584 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.45517986
I0214 03:01:59.219190 1503584 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.45517986 -xf /var/lib/minikube/build/build.45517986.tar
I0214 03:01:59.232534 1503584 crio.go:297] Building image: /var/lib/minikube/build/build.45517986
I0214 03:01:59.232611 1503584 ssh_runner.go:195] Run: sudo podman build -t localhost/my-image:functional-262041 /var/lib/minikube/build/build.45517986 --cgroup-manager=cgroupfs
Trying to pull gcr.io/k8s-minikube/busybox:latest...
Getting image source signatures
Copying blob sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa
Copying blob sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa
Copying config sha256:beae173ccac6ad749f76713cf4440fe3d21d1043fe616dfbe30775815d1d0f6a
Writing manifest to image destination
Storing signatures
I0214 03:02:02.521721 1503584 ssh_runner.go:235] Completed: sudo podman build -t localhost/my-image:functional-262041 /var/lib/minikube/build/build.45517986 --cgroup-manager=cgroupfs: (3.289074623s)
I0214 03:02:02.521799 1503584 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.45517986
I0214 03:02:02.531162 1503584 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.45517986.tar
I0214 03:02:02.539585 1503584 build_images.go:207] Built localhost/my-image:functional-262041 from /tmp/build.45517986.tar
I0214 03:02:02.539619 1503584 build_images.go:123] succeeded building to: functional-262041
I0214 03:02:02.539633 1503584 build_images.go:124] failed building to:
I0214 03:02:02.539657 1503584 main.go:141] libmachine: Making call to close driver server
I0214 03:02:02.539668 1503584 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:02:02.539968 1503584 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:02:02.540001 1503584 main.go:141] libmachine: Making call to close connection to plugin binary
I0214 03:02:02.540003 1503584 main.go:141] libmachine: (functional-262041) DBG | Closing plugin on server side
I0214 03:02:02.540012 1503584 main.go:141] libmachine: Making call to close driver server
I0214 03:02:02.540021 1503584 main.go:141] libmachine: (functional-262041) Calling .Close
I0214 03:02:02.540312 1503584 main.go:141] libmachine: (functional-262041) DBG | Closing plugin on server side
I0214 03:02:02.540372 1503584 main.go:141] libmachine: Successfully made call to close driver server
I0214 03:02:02.540392 1503584 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:447: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls
2024/02/14 03:02:04 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (4.09s)
=== RUN TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run: docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:346: (dbg) Run: docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-262041
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.93s)
=== RUN TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1435: (dbg) Run: kubectl --context functional-262041 create deployment hello-node --image=registry.k8s.io/echoserver:1.8
functional_test.go:1441: (dbg) Run: kubectl --context functional-262041 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-d7447cc7f-l2ccm" [91f58080-5fca-4baa-a345-ec93a5cea010] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])
helpers_test.go:344: "hello-node-d7447cc7f-l2ccm" [91f58080-5fca-4baa-a345-ec93a5cea010] Running
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 13.00548384s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (13.26s)
=== RUN TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image load --daemon gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 image load --daemon gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr: (5.806452787s)
functional_test.go:447: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (6.11s)
=== RUN TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image load --daemon gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 image load --daemon gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr: (2.470889058s)
functional_test.go:447: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.72s)
=== RUN TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.54s)
=== RUN TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 service list -o json
functional_test.go:1490: Took "725.089711ms" to run "out/minikube-linux-amd64 -p functional-262041 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.73s)
=== RUN TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 service --namespace=default --https --url hello-node
functional_test.go:1518: found endpoint: https://192.168.39.106:31738
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.78s)
=== RUN TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.40s)
=== RUN TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 service hello-node --url
functional_test.go:1561: found endpoint for hello-node: http://192.168.39.106:31738
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.47s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes
=== CONT TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.12s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== CONT TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.12s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters
=== CONT TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.12s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run: out/minikube-linux-amd64 profile lis
functional_test.go:1271: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.35s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run: out/minikube-linux-amd64 profile list
functional_test.go:1311: Took "377.827079ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1320: (dbg) Run: out/minikube-linux-amd64 profile list -l
functional_test.go:1325: Took "70.476508ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.45s)
=== RUN TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image save gcr.io/google-containers/addon-resizer:functional-262041 /home/jenkins/workspace/KVM_Linux_crio_integration/addon-resizer-save.tar --alsologtostderr
functional_test.go:379: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 image save gcr.io/google-containers/addon-resizer:functional-262041 /home/jenkins/workspace/KVM_Linux_crio_integration/addon-resizer-save.tar --alsologtostderr: (1.619519192s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.62s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run: out/minikube-linux-amd64 profile list -o json
functional_test.go:1362: Took "309.858314ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1370: (dbg) Run: out/minikube-linux-amd64 profile list -o json --light
functional_test.go:1375: Took "58.98361ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.37s)
=== RUN TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdany-port1126419177/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1707879691855512434" to /tmp/TestFunctionalparallelMountCmdany-port1126419177/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1707879691855512434" to /tmp/TestFunctionalparallelMountCmdany-port1126419177/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1707879691855512434" to /tmp/TestFunctionalparallelMountCmdany-port1126419177/001/test-1707879691855512434
functional_test_mount_test.go:115: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (274.174939ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test_mount_test.go:115: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Feb 14 03:01 created-by-test
-rw-r--r-- 1 docker docker 24 Feb 14 03:01 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Feb 14 03:01 test-1707879691855512434
functional_test_mount_test.go:137: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh cat /mount-9p/test-1707879691855512434
functional_test_mount_test.go:148: (dbg) Run: kubectl --context functional-262041 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [934c4fb8-d909-4c70-bc55-97959901a859] Pending
helpers_test.go:344: "busybox-mount" [934c4fb8-d909-4c70-bc55-97959901a859] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [934c4fb8-d909-4c70-bc55-97959901a859] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [934c4fb8-d909-4c70-bc55-97959901a859] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 19.007128579s
functional_test_mount_test.go:169: (dbg) Run: kubectl --context functional-262041 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdany-port1126419177/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (22.00s)
=== RUN TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image rm gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr
functional_test.go:447: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.64s)
=== RUN TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image load /home/jenkins/workspace/KVM_Linux_crio_integration/addon-resizer-save.tar --alsologtostderr
functional_test.go:408: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 image load /home/jenkins/workspace/KVM_Linux_crio_integration/addon-resizer-save.tar --alsologtostderr: (2.64810149s)
functional_test.go:447: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (3.49s)
=== RUN TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run: docker rmi gcr.io/google-containers/addon-resizer:functional-262041
functional_test.go:423: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 image save --daemon gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr
E0214 03:01:37.188227 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
functional_test.go:423: (dbg) Done: out/minikube-linux-amd64 -p functional-262041 image save --daemon gcr.io/google-containers/addon-resizer:functional-262041 --alsologtostderr: (5.253228063s)
functional_test.go:428: (dbg) Run: docker image inspect gcr.io/google-containers/addon-resizer:functional-262041
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (5.29s)
=== RUN TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdspecific-port3984097054/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (299.45291ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test_mount_test.go:243: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdspecific-port3984097054/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 ssh "sudo umount -f /mount-9p": exit status 1 (317.788079ms)
-- stdout --
umount: /mount-9p: not mounted.
-- /stdout --
** stderr **
ssh: Process exited with status 32
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-amd64 -p functional-262041 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdspecific-port3984097054/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.20s)
=== RUN TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2476575970/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2476575970/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2476575970/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T" /mount1: exit status 1 (358.788665ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-262041 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run: out/minikube-linux-amd64 mount -p functional-262041 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2476575970/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2476575970/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-262041 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2476575970/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.88s)
=== RUN TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run: docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run: docker rmi -f gcr.io/google-containers/addon-resizer:functional-262041
--- PASS: TestFunctional/delete_addon-resizer_images (0.07s)
=== RUN TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run: docker rmi -f localhost/my-image:functional-262041
--- PASS: TestFunctional/delete_my-image_image (0.01s)
=== RUN TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run: docker rmi -f minikube-local-cache-test:functional-262041
--- PASS: TestFunctional/delete_minikube_cached_images (0.01s)
=== RUN TestHA/serial/StartCluster
ha_test.go:101: (dbg) Run: out/minikube-linux-amd64 start -p ha-447944 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=kvm2 --container-runtime=crio
E0214 03:02:18.149014 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:03:40.070344 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
ha_test.go:101: (dbg) Done: out/minikube-linux-amd64 start -p ha-447944 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=kvm2 --container-runtime=crio: (3m41.237325407s)
ha_test.go:107: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
--- PASS: TestHA/serial/StartCluster (221.99s)
=== RUN TestHA/serial/DeployApp
ha_test.go:128: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-amd64 kubectl -p ha-447944 -- rollout status deployment/busybox: (6.522861847s)
ha_test.go:140: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-mjds9 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-szrmk -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-v4857 -- nslookup kubernetes.io
E0214 03:05:56.222960 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-mjds9 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-szrmk -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-v4857 -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-mjds9 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-szrmk -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-v4857 -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestHA/serial/DeployApp (9.47s)
=== RUN TestHA/serial/PingHostFromPods
ha_test.go:199: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-mjds9 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-mjds9 -- sh -c "ping -c 1 192.168.39.1"
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-szrmk -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-szrmk -- sh -c "ping -c 1 192.168.39.1"
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-v4857 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 kubectl -p ha-447944 -- exec busybox-5b5d89c9d6-v4857 -- sh -c "ping -c 1 192.168.39.1"
--- PASS: TestHA/serial/PingHostFromPods (1.52s)
=== RUN TestHA/serial/AddWorkerNode
ha_test.go:228: (dbg) Run: out/minikube-linux-amd64 node add -p ha-447944 -v=7 --alsologtostderr
E0214 03:06:13.611635 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:13.617022 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:13.627308 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:13.647693 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:13.688054 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:13.768496 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:13.929003 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:14.249613 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:14.890538 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:16.170895 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:18.731151 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:23.852315 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:06:23.910783 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:06:34.092874 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
ha_test.go:228: (dbg) Done: out/minikube-linux-amd64 node add -p ha-447944 -v=7 --alsologtostderr: (46.908739191s)
ha_test.go:234: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
--- PASS: TestHA/serial/AddWorkerNode (47.83s)
=== RUN TestHA/serial/NodeLabels
ha_test.go:255: (dbg) Run: kubectl --context ha-447944 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestHA/serial/NodeLabels (0.07s)
=== RUN TestHA/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestHA/serial/HAppyAfterClusterStart (0.61s)
=== RUN TestHA/serial/CopyFile
ha_test.go:326: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status --output json -v=7 --alsologtostderr
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp testdata/cp-test.txt ha-447944:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944:/home/docker/cp-test.txt /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944:/home/docker/cp-test.txt ha-447944-m02:/home/docker/cp-test_ha-447944_ha-447944-m02.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m02 "sudo cat /home/docker/cp-test_ha-447944_ha-447944-m02.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944:/home/docker/cp-test.txt ha-447944-m03:/home/docker/cp-test_ha-447944_ha-447944-m03.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m03 "sudo cat /home/docker/cp-test_ha-447944_ha-447944-m03.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944:/home/docker/cp-test.txt ha-447944-m04:/home/docker/cp-test_ha-447944_ha-447944-m04.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m04 "sudo cat /home/docker/cp-test_ha-447944_ha-447944-m04.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp testdata/cp-test.txt ha-447944-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m02:/home/docker/cp-test.txt /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944-m02.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m02:/home/docker/cp-test.txt ha-447944:/home/docker/cp-test_ha-447944-m02_ha-447944.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944 "sudo cat /home/docker/cp-test_ha-447944-m02_ha-447944.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m02:/home/docker/cp-test.txt ha-447944-m03:/home/docker/cp-test_ha-447944-m02_ha-447944-m03.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m03 "sudo cat /home/docker/cp-test_ha-447944-m02_ha-447944-m03.txt"
E0214 03:06:54.573941 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m02:/home/docker/cp-test.txt ha-447944-m04:/home/docker/cp-test_ha-447944-m02_ha-447944-m04.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m04 "sudo cat /home/docker/cp-test_ha-447944-m02_ha-447944-m04.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp testdata/cp-test.txt ha-447944-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944-m03.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt ha-447944:/home/docker/cp-test_ha-447944-m03_ha-447944.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944 "sudo cat /home/docker/cp-test_ha-447944-m03_ha-447944.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt ha-447944-m02:/home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m02 "sudo cat /home/docker/cp-test_ha-447944-m03_ha-447944-m02.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m03:/home/docker/cp-test.txt ha-447944-m04:/home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m04 "sudo cat /home/docker/cp-test_ha-447944-m03_ha-447944-m04.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp testdata/cp-test.txt ha-447944-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt /tmp/TestHAserialCopyFile3894609235/001/cp-test_ha-447944-m04.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt ha-447944:/home/docker/cp-test_ha-447944-m04_ha-447944.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944 "sudo cat /home/docker/cp-test_ha-447944-m04_ha-447944.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt ha-447944-m02:/home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m02 "sudo cat /home/docker/cp-test_ha-447944-m04_ha-447944-m02.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 cp ha-447944-m04:/home/docker/cp-test.txt ha-447944-m03:/home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 ssh -n ha-447944-m03 "sudo cat /home/docker/cp-test_ha-447944-m04_ha-447944-m03.txt"
--- PASS: TestHA/serial/CopyFile (14.69s)
=== RUN TestHA/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run: out/minikube-linux-amd64 profile list --output json
ha_test.go:390: (dbg) Done: out/minikube-linux-amd64 profile list --output json: (3.537154477s)
--- PASS: TestHA/serial/DegradedAfterControlPlaneNodeStop (3.54s)
=== RUN TestHA/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestHA/serial/HAppyAfterSecondaryNodeRestart (0.45s)
=== RUN TestHA/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Done: out/minikube-linux-amd64 -p ha-447944 node delete m03 -v=7 --alsologtostderr: (8.844715732s)
ha_test.go:493: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:511: (dbg) Run: kubectl get nodes
ha_test.go:519: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestHA/serial/DeleteSecondaryNode (9.62s)
=== RUN TestHA/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestHA/serial/DegradedAfterSecondaryNodeDelete (0.41s)
=== RUN TestHA/serial/RestartCluster
ha_test.go:560: (dbg) Run: out/minikube-linux-amd64 start -p ha-447944 --wait=true -v=7 --alsologtostderr --driver=kvm2 --container-runtime=crio
E0214 03:20:56.224808 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:21:13.611594 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:22:36.657679 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:25:56.223087 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:26:13.611169 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
ha_test.go:560: (dbg) Done: out/minikube-linux-amd64 start -p ha-447944 --wait=true -v=7 --alsologtostderr --driver=kvm2 --container-runtime=crio: (7m39.000533112s)
ha_test.go:566: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
ha_test.go:584: (dbg) Run: kubectl get nodes
ha_test.go:592: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestHA/serial/RestartCluster (459.83s)
=== RUN TestHA/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestHA/serial/DegradedAfterClusterRestart (0.40s)
=== RUN TestHA/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run: out/minikube-linux-amd64 node add -p ha-447944 --control-plane -v=7 --alsologtostderr
ha_test.go:605: (dbg) Done: out/minikube-linux-amd64 node add -p ha-447944 --control-plane -v=7 --alsologtostderr: (1m19.813039128s)
ha_test.go:611: (dbg) Run: out/minikube-linux-amd64 -p ha-447944 status -v=7 --alsologtostderr
--- PASS: TestHA/serial/AddSecondaryNode (80.72s)
=== RUN TestHA/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestHA/serial/HAppyAfterSecondaryNodeAdd (0.59s)
=== RUN TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run: out/minikube-linux-amd64 start -p ingress-addon-legacy-791930 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=kvm2 --container-runtime=crio
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-amd64 start -p ingress-addon-legacy-791930 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=kvm2 --container-runtime=crio: (1m14.906385984s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (74.91s)
=== RUN TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 addons enable ingress --alsologtostderr -v=5: (13.014088372s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (13.01s)
=== RUN TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run: out/minikube-linux-amd64 -p ingress-addon-legacy-791930 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.59s)
=== RUN TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 start -p json-output-468139 --output=json --user=testUser --memory=2200 --wait=true --driver=kvm2 --container-runtime=crio
E0214 03:33:59.272163 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-468139 --output=json --user=testUser --memory=2200 --wait=true --driver=kvm2 --container-runtime=crio: (1m39.845182268s)
--- PASS: TestJSONOutput/start/Command (99.85s)
=== RUN TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)
=== RUN TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 pause -p json-output-468139 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.72s)
=== RUN TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)
=== RUN TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 unpause -p json-output-468139 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.63s)
=== RUN TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)
=== RUN TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 stop -p json-output-468139 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-468139 --output=json --user=testUser: (7.351082523s)
--- PASS: TestJSONOutput/stop/Command (7.35s)
=== RUN TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)
=== RUN TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestErrorJSONOutput
json_output_test.go:160: (dbg) Run: out/minikube-linux-amd64 start -p json-output-error-820200 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-820200 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (78.093226ms)
-- stdout --
{"specversion":"1.0","id":"521b30fd-afbb-40dd-a7aa-1ab6fb79519c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-820200] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
{"specversion":"1.0","id":"60e26948-4b9c-4b31-811d-42b54d76d145","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17909"}}
{"specversion":"1.0","id":"b3d621a5-8500-463e-8582-fa60b45d39f4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
{"specversion":"1.0","id":"a0807362-078c-4402-960c-7ca03381b9b6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig"}}
{"specversion":"1.0","id":"71e9b34d-961e-4050-8104-c408ace196d9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube"}}
{"specversion":"1.0","id":"96f7ba88-45e5-48ed-8424-23dca038f787","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
{"specversion":"1.0","id":"2820be93-f00e-4b49-af37-9216e21cadb4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
{"specversion":"1.0","id":"e3b9536c-e063-42cd-b9c9-789fc674063d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-820200" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p json-output-error-820200
--- PASS: TestErrorJSONOutput (0.22s)
=== RUN TestMainNoArgs
main_test.go:68: (dbg) Run: out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.06s)
=== RUN TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p first-564295 --driver=kvm2 --container-runtime=crio
E0214 03:34:58.298740 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:34:58.304072 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:34:58.314378 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:34:58.334692 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:34:58.375072 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:34:58.455414 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:34:58.615846 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:34:58.936527 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:34:59.577530 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:35:00.858478 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:35:03.419507 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:35:08.540357 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p first-564295 --driver=kvm2 --container-runtime=crio: (47.34810481s)
minikube_profile_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p second-566813 --driver=kvm2 --container-runtime=crio
E0214 03:35:18.781007 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:35:39.261463 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:35:56.222649 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p second-566813 --driver=kvm2 --container-runtime=crio: (49.077420012s)
minikube_profile_test.go:51: (dbg) Run: out/minikube-linux-amd64 profile first-564295
minikube_profile_test.go:55: (dbg) Run: out/minikube-linux-amd64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run: out/minikube-linux-amd64 profile second-566813
minikube_profile_test.go:55: (dbg) Run: out/minikube-linux-amd64 profile list -ojson
helpers_test.go:175: Cleaning up "second-566813" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p second-566813
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p second-566813: (1.002455547s)
helpers_test.go:175: Cleaning up "first-564295" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p first-564295
--- PASS: TestMinikubeProfile (99.21s)
=== RUN TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-1-330358 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=kvm2 --container-runtime=crio
E0214 03:36:13.611704 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:36:20.222499 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-330358 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=kvm2 --container-runtime=crio: (26.217661295s)
--- PASS: TestMountStart/serial/StartWithMountFirst (27.22s)
=== RUN TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p mount-start-1-330358 ssh -- ls /minikube-host
mount_start_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p mount-start-1-330358 ssh -- mount | grep 9p
--- PASS: TestMountStart/serial/VerifyMountFirst (0.41s)
=== RUN TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-2-349274 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=kvm2 --container-runtime=crio
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-349274 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=kvm2 --container-runtime=crio: (26.350187141s)
--- PASS: TestMountStart/serial/StartWithMountSecond (27.35s)
=== RUN TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-349274 ssh -- ls /minikube-host
mount_start_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-349274 ssh -- mount | grep 9p
--- PASS: TestMountStart/serial/VerifyMountSecond (0.42s)
=== RUN TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run: out/minikube-linux-amd64 delete -p mount-start-1-330358 --alsologtostderr -v=5
--- PASS: TestMountStart/serial/DeleteFirst (0.70s)
=== RUN TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-349274 ssh -- ls /minikube-host
mount_start_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-349274 ssh -- mount | grep 9p
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.43s)
=== RUN TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run: out/minikube-linux-amd64 stop -p mount-start-2-349274
mount_start_test.go:155: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-349274: (1.349705501s)
--- PASS: TestMountStart/serial/Stop (1.35s)
=== RUN TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-2-349274
mount_start_test.go:166: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-349274: (22.55703013s)
--- PASS: TestMountStart/serial/RestartStopped (23.56s)
=== RUN TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-349274 ssh -- ls /minikube-host
mount_start_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-349274 ssh -- mount | grep 9p
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.41s)
=== RUN TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run: out/minikube-linux-amd64 start -p multinode-920904 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=kvm2 --container-runtime=crio
E0214 03:37:42.143060 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:39:16.658511 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
multinode_test.go:96: (dbg) Done: out/minikube-linux-amd64 start -p multinode-920904 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=kvm2 --container-runtime=crio: (1m52.813752762s)
multinode_test.go:102: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (113.24s)
=== RUN TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-920904 -- rollout status deployment/busybox: (2.036501756s)
multinode_test.go:505: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-vfm4b -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-xqpsh -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-vfm4b -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-xqpsh -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-vfm4b -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-xqpsh -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (4.00s)
=== RUN TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-vfm4b -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-vfm4b -- sh -c "ping -c 1 192.168.39.1"
multinode_test.go:572: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-xqpsh -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-920904 -- exec busybox-5b5d89c9d6-xqpsh -- sh -c "ping -c 1 192.168.39.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.96s)
=== RUN TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-920904 -v 3 --alsologtostderr
E0214 03:39:58.298157 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
multinode_test.go:121: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-920904 -v 3 --alsologtostderr: (43.086204495s)
multinode_test.go:127: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (43.67s)
=== RUN TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run: kubectl --context multinode-920904 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.07s)
=== RUN TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.23s)
=== RUN TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp testdata/cp-test.txt multinode-920904:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile142466148/001/cp-test_multinode-920904.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904:/home/docker/cp-test.txt multinode-920904-m02:/home/docker/cp-test_multinode-920904_multinode-920904-m02.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m02 "sudo cat /home/docker/cp-test_multinode-920904_multinode-920904-m02.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904:/home/docker/cp-test.txt multinode-920904-m03:/home/docker/cp-test_multinode-920904_multinode-920904-m03.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m03 "sudo cat /home/docker/cp-test_multinode-920904_multinode-920904-m03.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp testdata/cp-test.txt multinode-920904-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile142466148/001/cp-test_multinode-920904-m02.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904-m02:/home/docker/cp-test.txt multinode-920904:/home/docker/cp-test_multinode-920904-m02_multinode-920904.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904 "sudo cat /home/docker/cp-test_multinode-920904-m02_multinode-920904.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904-m02:/home/docker/cp-test.txt multinode-920904-m03:/home/docker/cp-test_multinode-920904-m02_multinode-920904-m03.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m03 "sudo cat /home/docker/cp-test_multinode-920904-m02_multinode-920904-m03.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp testdata/cp-test.txt multinode-920904-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile142466148/001/cp-test_multinode-920904-m03.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt multinode-920904:/home/docker/cp-test_multinode-920904-m03_multinode-920904.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904 "sudo cat /home/docker/cp-test_multinode-920904-m03_multinode-920904.txt"
helpers_test.go:556: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 cp multinode-920904-m03:/home/docker/cp-test.txt multinode-920904-m02:/home/docker/cp-test_multinode-920904-m03_multinode-920904-m02.txt
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 ssh -n multinode-920904-m02 "sudo cat /home/docker/cp-test_multinode-920904-m03_multinode-920904-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (7.73s)
=== RUN TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p multinode-920904 node stop m03: (2.211631553s)
multinode_test.go:254: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-920904 status: exit status 7 (457.994383ms)
-- stdout --
multinode-920904
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-920904-m02
type: Worker
host: Running
kubelet: Running
multinode-920904-m03
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
multinode_test.go:261: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-920904 status --alsologtostderr: exit status 7 (462.629223ms)
-- stdout --
multinode-920904
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-920904-m02
type: Worker
host: Running
kubelet: Running
multinode-920904-m03
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I0214 03:40:25.319352 1521017 out.go:291] Setting OutFile to fd 1 ...
I0214 03:40:25.319543 1521017 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:40:25.319556 1521017 out.go:304] Setting ErrFile to fd 2...
I0214 03:40:25.319562 1521017 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 03:40:25.319837 1521017 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 03:40:25.320090 1521017 out.go:298] Setting JSON to false
I0214 03:40:25.320136 1521017 mustload.go:65] Loading cluster: multinode-920904
I0214 03:40:25.320258 1521017 notify.go:220] Checking for updates...
I0214 03:40:25.320726 1521017 config.go:182] Loaded profile config "multinode-920904": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 03:40:25.320748 1521017 status.go:255] checking status of multinode-920904 ...
I0214 03:40:25.321387 1521017 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:40:25.321459 1521017 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:40:25.346432 1521017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41931
I0214 03:40:25.346912 1521017 main.go:141] libmachine: () Calling .GetVersion
I0214 03:40:25.347422 1521017 main.go:141] libmachine: Using API Version 1
I0214 03:40:25.347444 1521017 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:40:25.347846 1521017 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:40:25.348068 1521017 main.go:141] libmachine: (multinode-920904) Calling .GetState
I0214 03:40:25.349736 1521017 status.go:330] multinode-920904 host status = "Running" (err=<nil>)
I0214 03:40:25.349753 1521017 host.go:66] Checking if "multinode-920904" exists ...
I0214 03:40:25.350055 1521017 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:40:25.350096 1521017 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:40:25.366488 1521017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40519
I0214 03:40:25.366888 1521017 main.go:141] libmachine: () Calling .GetVersion
I0214 03:40:25.367325 1521017 main.go:141] libmachine: Using API Version 1
I0214 03:40:25.367346 1521017 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:40:25.367734 1521017 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:40:25.367970 1521017 main.go:141] libmachine: (multinode-920904) Calling .GetIP
I0214 03:40:25.370527 1521017 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:40:25.371012 1521017 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:40:25.371061 1521017 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:40:25.371187 1521017 host.go:66] Checking if "multinode-920904" exists ...
I0214 03:40:25.371473 1521017 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:40:25.371509 1521017 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:40:25.386858 1521017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33541
I0214 03:40:25.387243 1521017 main.go:141] libmachine: () Calling .GetVersion
I0214 03:40:25.387676 1521017 main.go:141] libmachine: Using API Version 1
I0214 03:40:25.387694 1521017 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:40:25.387992 1521017 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:40:25.388181 1521017 main.go:141] libmachine: (multinode-920904) Calling .DriverName
I0214 03:40:25.388373 1521017 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:40:25.388416 1521017 main.go:141] libmachine: (multinode-920904) Calling .GetSSHHostname
I0214 03:40:25.391045 1521017 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:40:25.391491 1521017 main.go:141] libmachine: (multinode-920904) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0c:53:1c", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:37:48 +0000 UTC Type:0 Mac:52:54:00:0c:53:1c Iaid: IPaddr:192.168.39.169 Prefix:24 Hostname:multinode-920904 Clientid:01:52:54:00:0c:53:1c}
I0214 03:40:25.391526 1521017 main.go:141] libmachine: (multinode-920904) DBG | domain multinode-920904 has defined IP address 192.168.39.169 and MAC address 52:54:00:0c:53:1c in network mk-multinode-920904
I0214 03:40:25.391660 1521017 main.go:141] libmachine: (multinode-920904) Calling .GetSSHPort
I0214 03:40:25.391825 1521017 main.go:141] libmachine: (multinode-920904) Calling .GetSSHKeyPath
I0214 03:40:25.391966 1521017 main.go:141] libmachine: (multinode-920904) Calling .GetSSHUsername
I0214 03:40:25.392076 1521017 sshutil.go:53] new ssh client: &{IP:192.168.39.169 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904/id_rsa Username:docker}
I0214 03:40:25.476675 1521017 ssh_runner.go:195] Run: systemctl --version
I0214 03:40:25.482586 1521017 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:40:25.495925 1521017 kubeconfig.go:125] found "multinode-920904" server: "https://192.168.39.169:8443"
I0214 03:40:25.495951 1521017 api_server.go:166] Checking apiserver status ...
I0214 03:40:25.495986 1521017 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0214 03:40:25.515034 1521017 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1152/cgroup
I0214 03:40:25.523774 1521017 api_server.go:182] apiserver freezer: "3:freezer:/kubepods/burstable/pod3be77efdd656fce83a1ee57d47f0da56/crio-ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72"
I0214 03:40:25.523828 1521017 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod3be77efdd656fce83a1ee57d47f0da56/crio-ba1cab6d5491a2e9d360237dad562e39e0ac6750d663bdd6ca0f3e0e1b714b72/freezer.state
I0214 03:40:25.533025 1521017 api_server.go:204] freezer state: "THAWED"
I0214 03:40:25.533053 1521017 api_server.go:253] Checking apiserver healthz at https://192.168.39.169:8443/healthz ...
I0214 03:40:25.539503 1521017 api_server.go:279] https://192.168.39.169:8443/healthz returned 200:
ok
I0214 03:40:25.539541 1521017 status.go:422] multinode-920904 apiserver status = Running (err=<nil>)
I0214 03:40:25.539553 1521017 status.go:257] multinode-920904 status: &{Name:multinode-920904 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I0214 03:40:25.539596 1521017 status.go:255] checking status of multinode-920904-m02 ...
I0214 03:40:25.540147 1521017 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:40:25.540190 1521017 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:40:25.555210 1521017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39007
I0214 03:40:25.555774 1521017 main.go:141] libmachine: () Calling .GetVersion
I0214 03:40:25.556321 1521017 main.go:141] libmachine: Using API Version 1
I0214 03:40:25.556350 1521017 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:40:25.556653 1521017 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:40:25.556844 1521017 main.go:141] libmachine: (multinode-920904-m02) Calling .GetState
I0214 03:40:25.558386 1521017 status.go:330] multinode-920904-m02 host status = "Running" (err=<nil>)
I0214 03:40:25.558413 1521017 host.go:66] Checking if "multinode-920904-m02" exists ...
I0214 03:40:25.558726 1521017 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:40:25.558773 1521017 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:40:25.573170 1521017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34999
I0214 03:40:25.573563 1521017 main.go:141] libmachine: () Calling .GetVersion
I0214 03:40:25.573951 1521017 main.go:141] libmachine: Using API Version 1
I0214 03:40:25.573973 1521017 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:40:25.574278 1521017 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:40:25.574483 1521017 main.go:141] libmachine: (multinode-920904-m02) Calling .GetIP
I0214 03:40:25.577244 1521017 main.go:141] libmachine: (multinode-920904-m02) DBG | domain multinode-920904-m02 has defined MAC address 52:54:00:95:95:64 in network mk-multinode-920904
I0214 03:40:25.577693 1521017 main.go:141] libmachine: (multinode-920904-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:95:95:64", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:38:56 +0000 UTC Type:0 Mac:52:54:00:95:95:64 Iaid: IPaddr:192.168.39.100 Prefix:24 Hostname:multinode-920904-m02 Clientid:01:52:54:00:95:95:64}
I0214 03:40:25.577723 1521017 main.go:141] libmachine: (multinode-920904-m02) DBG | domain multinode-920904-m02 has defined IP address 192.168.39.100 and MAC address 52:54:00:95:95:64 in network mk-multinode-920904
I0214 03:40:25.577935 1521017 host.go:66] Checking if "multinode-920904-m02" exists ...
I0214 03:40:25.578214 1521017 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:40:25.578245 1521017 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:40:25.593213 1521017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46061
I0214 03:40:25.593579 1521017 main.go:141] libmachine: () Calling .GetVersion
I0214 03:40:25.594057 1521017 main.go:141] libmachine: Using API Version 1
I0214 03:40:25.594075 1521017 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:40:25.594405 1521017 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:40:25.594601 1521017 main.go:141] libmachine: (multinode-920904-m02) Calling .DriverName
I0214 03:40:25.594791 1521017 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0214 03:40:25.594816 1521017 main.go:141] libmachine: (multinode-920904-m02) Calling .GetSSHHostname
I0214 03:40:25.597672 1521017 main.go:141] libmachine: (multinode-920904-m02) DBG | domain multinode-920904-m02 has defined MAC address 52:54:00:95:95:64 in network mk-multinode-920904
I0214 03:40:25.598129 1521017 main.go:141] libmachine: (multinode-920904-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:95:95:64", ip: ""} in network mk-multinode-920904: {Iface:virbr1 ExpiryTime:2024-02-14 04:38:56 +0000 UTC Type:0 Mac:52:54:00:95:95:64 Iaid: IPaddr:192.168.39.100 Prefix:24 Hostname:multinode-920904-m02 Clientid:01:52:54:00:95:95:64}
I0214 03:40:25.598158 1521017 main.go:141] libmachine: (multinode-920904-m02) DBG | domain multinode-920904-m02 has defined IP address 192.168.39.100 and MAC address 52:54:00:95:95:64 in network mk-multinode-920904
I0214 03:40:25.598379 1521017 main.go:141] libmachine: (multinode-920904-m02) Calling .GetSSHPort
I0214 03:40:25.598553 1521017 main.go:141] libmachine: (multinode-920904-m02) Calling .GetSSHKeyPath
I0214 03:40:25.598752 1521017 main.go:141] libmachine: (multinode-920904-m02) Calling .GetSSHUsername
I0214 03:40:25.598926 1521017 sshutil.go:53] new ssh client: &{IP:192.168.39.100 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-1487441/.minikube/machines/multinode-920904-m02/id_rsa Username:docker}
I0214 03:40:25.692364 1521017 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0214 03:40:25.705015 1521017 status.go:257] multinode-920904-m02 status: &{Name:multinode-920904-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
I0214 03:40:25.705054 1521017 status.go:255] checking status of multinode-920904-m03 ...
I0214 03:40:25.705504 1521017 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0214 03:40:25.705543 1521017 main.go:141] libmachine: Launching plugin server for driver kvm2
I0214 03:40:25.721563 1521017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33785
I0214 03:40:25.721981 1521017 main.go:141] libmachine: () Calling .GetVersion
I0214 03:40:25.722479 1521017 main.go:141] libmachine: Using API Version 1
I0214 03:40:25.722502 1521017 main.go:141] libmachine: () Calling .SetConfigRaw
I0214 03:40:25.722829 1521017 main.go:141] libmachine: () Calling .GetMachineName
I0214 03:40:25.723035 1521017 main.go:141] libmachine: (multinode-920904-m03) Calling .GetState
I0214 03:40:25.724569 1521017 status.go:330] multinode-920904-m03 host status = "Stopped" (err=<nil>)
I0214 03:40:25.724586 1521017 status.go:343] host is not running, skipping remaining checks
I0214 03:40:25.724593 1521017 status.go:257] multinode-920904-m03 status: &{Name:multinode-920904-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (3.13s)
=== RUN TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 node start m03 -v=7 --alsologtostderr
E0214 03:40:25.984005 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:40:56.222584 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
multinode_test.go:282: (dbg) Done: out/minikube-linux-amd64 -p multinode-920904 node start m03 -v=7 --alsologtostderr: (31.665071778s)
multinode_test.go:290: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status -v=7 --alsologtostderr
multinode_test.go:306: (dbg) Run: kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (32.33s)
=== RUN TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-amd64 -p multinode-920904 node delete m03: (1.924166932s)
multinode_test.go:422: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status --alsologtostderr
multinode_test.go:436: (dbg) Run: kubectl get nodes
multinode_test.go:444: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (2.47s)
=== RUN TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run: out/minikube-linux-amd64 start -p multinode-920904 --wait=true -v=8 --alsologtostderr --driver=kvm2 --container-runtime=crio
E0214 03:49:58.298565 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 03:50:39.273396 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:50:56.222432 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 03:51:13.611330 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 03:51:21.344825 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
multinode_test.go:376: (dbg) Done: out/minikube-linux-amd64 start -p multinode-920904 --wait=true -v=8 --alsologtostderr --driver=kvm2 --container-runtime=crio: (2m58.216384993s)
multinode_test.go:382: (dbg) Run: out/minikube-linux-amd64 -p multinode-920904 status --alsologtostderr
multinode_test.go:396: (dbg) Run: kubectl get nodes
multinode_test.go:404: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (178.82s)
=== RUN TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-920904
multinode_test.go:464: (dbg) Run: out/minikube-linux-amd64 start -p multinode-920904-m02 --driver=kvm2 --container-runtime=crio
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-920904-m02 --driver=kvm2 --container-runtime=crio: exit status 14 (86.783687ms)
-- stdout --
* [multinode-920904-m02] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17909
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
! Profile name 'multinode-920904-m02' is duplicated with machine name 'multinode-920904-m02' in profile 'multinode-920904'
X Exiting due to MK_USAGE: Profile name should be unique
** /stderr **
multinode_test.go:472: (dbg) Run: out/minikube-linux-amd64 start -p multinode-920904-m03 --driver=kvm2 --container-runtime=crio
multinode_test.go:472: (dbg) Done: out/minikube-linux-amd64 start -p multinode-920904-m03 --driver=kvm2 --container-runtime=crio: (48.913593881s)
multinode_test.go:479: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-920904
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-920904: exit status 80 (247.838179ms)
-- stdout --
* Adding node m03 to cluster multinode-920904 as [worker]
-- /stdout --
** stderr **
X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-920904-m03 already exists in multinode-920904-m03 profile
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
multinode_test.go:484: (dbg) Run: out/minikube-linux-amd64 delete -p multinode-920904-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-920904-m03: (1.017608639s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (50.33s)
=== RUN TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run: out/minikube-linux-amd64 start -p scheduled-stop-742175 --memory=2048 --driver=kvm2 --container-runtime=crio
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-742175 --memory=2048 --driver=kvm2 --container-runtime=crio: (48.5466199s)
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-742175 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run: out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-742175 -n scheduled-stop-742175
scheduled_stop_test.go:169: signal error was: <nil>
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-742175 --schedule 15s
scheduled_stop_test.go:169: signal error was: os: process already finished
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-742175 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-742175 -n scheduled-stop-742175
scheduled_stop_test.go:205: (dbg) Run: out/minikube-linux-amd64 status -p scheduled-stop-742175
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-742175 --schedule 15s
scheduled_stop_test.go:169: signal error was: os: process already finished
scheduled_stop_test.go:205: (dbg) Run: out/minikube-linux-amd64 status -p scheduled-stop-742175
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-742175: exit status 7 (86.8242ms)
-- stdout --
scheduled-stop-742175
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-742175 -n scheduled-stop-742175
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-742175 -n scheduled-stop-742175: exit status 7 (83.9978ms)
-- stdout --
Stopped
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-742175" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p scheduled-stop-742175
--- PASS: TestScheduledStopUnix (120.48s)
=== RUN TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade
=== CONT TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run: /tmp/minikube-v1.26.0.2064300182 start -p running-upgrade-945990 --memory=2200 --vm-driver=kvm2 --container-runtime=crio
E0214 03:59:58.298086 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.2064300182 start -p running-upgrade-945990 --memory=2200 --vm-driver=kvm2 --container-runtime=crio: (2m20.716626003s)
version_upgrade_test.go:130: (dbg) Run: out/minikube-linux-amd64 start -p running-upgrade-945990 --memory=2200 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-945990 --memory=2200 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio: (1m33.866064199s)
helpers_test.go:175: Cleaning up "running-upgrade-945990" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p running-upgrade-945990
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-945990: (1.299593641s)
--- PASS: TestRunningBinaryUpgrade (236.42s)
=== RUN TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-618167 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-618167 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio: (1m8.73200536s)
version_upgrade_test.go:227: (dbg) Run: out/minikube-linux-amd64 stop -p kubernetes-upgrade-618167
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-618167: (2.570885636s)
version_upgrade_test.go:232: (dbg) Run: out/minikube-linux-amd64 -p kubernetes-upgrade-618167 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-618167 status --format={{.Host}}: exit status 7 (107.405565ms)
-- stdout --
Stopped
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-618167 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-618167 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio: (1m26.809338743s)
version_upgrade_test.go:248: (dbg) Run: kubectl --context kubernetes-upgrade-618167 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-618167 --memory=2200 --kubernetes-version=v1.16.0 --driver=kvm2 --container-runtime=crio
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-618167 --memory=2200 --kubernetes-version=v1.16.0 --driver=kvm2 --container-runtime=crio: exit status 106 (120.450357ms)
-- stdout --
* [kubernetes-upgrade-618167] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17909
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.29.0-rc.2 cluster to v1.16.0
* Suggestion:
1) Recreate the cluster with Kubernetes 1.16.0, by running:
minikube delete -p kubernetes-upgrade-618167
minikube start -p kubernetes-upgrade-618167 --kubernetes-version=v1.16.0
2) Create a second cluster with Kubernetes 1.16.0, by running:
minikube start -p kubernetes-upgrade-6181672 --kubernetes-version=v1.16.0
3) Use the existing cluster at version Kubernetes 1.29.0-rc.2, by running:
minikube start -p kubernetes-upgrade-618167 --kubernetes-version=v1.29.0-rc.2
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-618167 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-618167 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio: (1m2.199054617s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-618167" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubernetes-upgrade-618167
--- PASS: TestKubernetesUpgrade (221.55s)
=== RUN TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-841938 --no-kubernetes --kubernetes-version=1.20 --driver=kvm2 --container-runtime=crio
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-841938 --no-kubernetes --kubernetes-version=1.20 --driver=kvm2 --container-runtime=crio: exit status 14 (102.925501ms)
-- stdout --
* [NoKubernetes-841938] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17909
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
to unset a global config run:
$ minikube config unset kubernetes-version
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.10s)
=== RUN TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-841938 --driver=kvm2 --container-runtime=crio
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-841938 --driver=kvm2 --container-runtime=crio: (1m50.15684033s)
no_kubernetes_test.go:200: (dbg) Run: out/minikube-linux-amd64 -p NoKubernetes-841938 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (110.45s)
=== RUN TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-841938 --no-kubernetes --driver=kvm2 --container-runtime=crio
E0214 04:00:56.222519 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 04:01:13.611921 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-841938 --no-kubernetes --driver=kvm2 --container-runtime=crio: (39.907428537s)
no_kubernetes_test.go:200: (dbg) Run: out/minikube-linux-amd64 -p NoKubernetes-841938 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-amd64 -p NoKubernetes-841938 status -o json: exit status 2 (319.891471ms)
-- stdout --
{"Name":"NoKubernetes-841938","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run: out/minikube-linux-amd64 delete -p NoKubernetes-841938
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-amd64 delete -p NoKubernetes-841938: (1.083056843s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (41.31s)
=== RUN TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.80s)
=== RUN TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run: /tmp/minikube-v1.26.0.1133324285 start -p stopped-upgrade-581303 --memory=2200 --vm-driver=kvm2 --container-runtime=crio
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.1133324285 start -p stopped-upgrade-581303 --memory=2200 --vm-driver=kvm2 --container-runtime=crio: (1m2.877625768s)
version_upgrade_test.go:192: (dbg) Run: /tmp/minikube-v1.26.0.1133324285 -p stopped-upgrade-581303 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.1133324285 -p stopped-upgrade-581303 stop: (12.151019791s)
version_upgrade_test.go:198: (dbg) Run: out/minikube-linux-amd64 start -p stopped-upgrade-581303 --memory=2200 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-581303 --memory=2200 --alsologtostderr -v=1 --driver=kvm2 --container-runtime=crio: (47.640626947s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (122.67s)
=== RUN TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-841938 --no-kubernetes --driver=kvm2 --container-runtime=crio
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-841938 --no-kubernetes --driver=kvm2 --container-runtime=crio: (49.030495706s)
--- PASS: TestNoKubernetes/serial/Start (49.03s)
=== RUN TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run: out/minikube-linux-amd64 ssh -p NoKubernetes-841938 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-841938 "sudo systemctl is-active --quiet service kubelet": exit status 1 (228.102269ms)
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.23s)
=== RUN TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run: out/minikube-linux-amd64 profile list
no_kubernetes_test.go:169: (dbg) Done: out/minikube-linux-amd64 profile list: (15.022689424s)
no_kubernetes_test.go:179: (dbg) Run: out/minikube-linux-amd64 profile list --output=json
no_kubernetes_test.go:179: (dbg) Done: out/minikube-linux-amd64 profile list --output=json: (18.17474384s)
--- PASS: TestNoKubernetes/serial/ProfileList (33.20s)
=== RUN TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run: out/minikube-linux-amd64 stop -p NoKubernetes-841938
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-841938: (1.756401872s)
--- PASS: TestNoKubernetes/serial/Stop (1.76s)
=== RUN TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-841938 --driver=kvm2 --container-runtime=crio
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-841938 --driver=kvm2 --container-runtime=crio: (49.758216285s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (49.76s)
=== RUN TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run: out/minikube-linux-amd64 start -p false-528898 --memory=2048 --alsologtostderr --cni=false --driver=kvm2 --container-runtime=crio
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-528898 --memory=2048 --alsologtostderr --cni=false --driver=kvm2 --container-runtime=crio: exit status 14 (147.184073ms)
-- stdout --
* [false-528898] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17909
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
-- /stdout --
** stderr **
I0214 04:03:01.171225 1530302 out.go:291] Setting OutFile to fd 1 ...
I0214 04:03:01.171532 1530302 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:03:01.171546 1530302 out.go:304] Setting ErrFile to fd 2...
I0214 04:03:01.171553 1530302 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0214 04:03:01.171750 1530302 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-1487441/.minikube/bin
I0214 04:03:01.172409 1530302 out.go:298] Setting JSON to false
I0214 04:03:01.173584 1530302 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":24329,"bootTime":1707859053,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0214 04:03:01.173659 1530302 start.go:138] virtualization: kvm guest
I0214 04:03:01.176243 1530302 out.go:177] * [false-528898] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0214 04:03:01.177902 1530302 notify.go:220] Checking for updates...
I0214 04:03:01.177921 1530302 out.go:177] - MINIKUBE_LOCATION=17909
I0214 04:03:01.179680 1530302 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0214 04:03:01.181351 1530302 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-1487441/kubeconfig
I0214 04:03:01.182863 1530302 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-1487441/.minikube
I0214 04:03:01.184542 1530302 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0214 04:03:01.186122 1530302 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0214 04:03:01.188218 1530302 config.go:182] Loaded profile config "NoKubernetes-841938": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v0.0.0
I0214 04:03:01.188323 1530302 config.go:182] Loaded profile config "force-systemd-env-059598": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0214 04:03:01.188426 1530302 config.go:182] Loaded profile config "stopped-upgrade-581303": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0214 04:03:01.188513 1530302 driver.go:392] Setting default libvirt URI to qemu:///system
I0214 04:03:01.232705 1530302 out.go:177] * Using the kvm2 driver based on user configuration
I0214 04:03:01.234120 1530302 start.go:296] selected driver: kvm2
I0214 04:03:01.234146 1530302 start.go:900] validating driver "kvm2" against <nil>
I0214 04:03:01.234162 1530302 start.go:911] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0214 04:03:01.236846 1530302 out.go:177]
W0214 04:03:01.238351 1530302 out.go:239] X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
I0214 04:03:01.239808 1530302 out.go:177]
** /stderr **
net_test.go:88:
----------------------- debugLogs start: false-528898 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-528898
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-528898
>>> host: /etc/nsswitch.conf:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /etc/hosts:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /etc/resolv.conf:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-528898
>>> host: crictl pods:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: crictl containers:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> k8s: describe netcat deployment:
error: context "false-528898" does not exist
>>> k8s: describe netcat pod(s):
error: context "false-528898" does not exist
>>> k8s: netcat logs:
error: context "false-528898" does not exist
>>> k8s: describe coredns deployment:
error: context "false-528898" does not exist
>>> k8s: describe coredns pods:
error: context "false-528898" does not exist
>>> k8s: coredns logs:
error: context "false-528898" does not exist
>>> k8s: describe api server pod(s):
error: context "false-528898" does not exist
>>> k8s: api server logs:
error: context "false-528898" does not exist
>>> host: /etc/cni:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: ip a s:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: ip r s:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: iptables-save:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: iptables table nat:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> k8s: describe kube-proxy daemon set:
error: context "false-528898" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "false-528898" does not exist
>>> k8s: kube-proxy logs:
error: context "false-528898" does not exist
>>> host: kubelet daemon status:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: kubelet daemon config:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> k8s: kubelet logs:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-528898
>>> host: docker daemon status:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: docker daemon config:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /etc/docker/daemon.json:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: docker system info:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: cri-docker daemon status:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: cri-docker daemon config:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: cri-dockerd version:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: containerd daemon status:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: containerd daemon config:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /etc/containerd/config.toml:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: containerd config dump:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: crio daemon status:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: crio daemon config:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: /etc/crio:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
>>> host: crio config:
* Profile "false-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-528898"
----------------------- debugLogs end: false-528898 [took: 6.13403724s] --------------------------------
helpers_test.go:175: Cleaning up "false-528898" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p false-528898
--- PASS: TestNetworkPlugins/group/false (6.48s)
=== RUN TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run: out/minikube-linux-amd64 logs -p stopped-upgrade-581303
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-amd64 logs -p stopped-upgrade-581303: (1.040993219s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.04s)
=== RUN TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run: out/minikube-linux-amd64 ssh -p NoKubernetes-841938 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-841938 "sudo systemctl is-active --quiet service kubelet": exit status 1 (251.656959ms)
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.25s)
=== RUN TestPause/serial/Start
pause_test.go:80: (dbg) Run: out/minikube-linux-amd64 start -p pause-951466 --memory=2048 --install-addons=false --wait=all --driver=kvm2 --container-runtime=crio
pause_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p pause-951466 --memory=2048 --install-addons=false --wait=all --driver=kvm2 --container-runtime=crio: (2m32.754100038s)
--- PASS: TestPause/serial/Start (152.75s)
=== RUN TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p auto-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=kvm2 --container-runtime=crio
E0214 04:04:58.298225 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p auto-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=kvm2 --container-runtime=crio: (2m41.152470729s)
--- PASS: TestNetworkPlugins/group/auto/Start (161.15s)
=== RUN TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p kindnet-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=kvm2 --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=kvm2 --container-runtime=crio: (2m7.241085146s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (127.24s)
=== RUN TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p calico-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=kvm2 --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p calico-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=kvm2 --container-runtime=crio: (1m44.054574038s)
--- PASS: TestNetworkPlugins/group/calico/Start (104.05s)
=== RUN TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-pjmxc" [2dc0f50a-599c-4e5d-99f8-089f36fd9671] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.005987303s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)
=== RUN TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p kindnet-528898 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.24s)
=== RUN TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context kindnet-528898 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-9l5qp" [d5da1876-eecf-4a88-88f9-456f9b932f9d] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-9l5qp" [d5da1876-eecf-4a88-88f9-456f9b932f9d] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 13.004385515s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (13.27s)
=== RUN TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p auto-528898 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.25s)
=== RUN TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context auto-528898 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-tq96q" [90ff1927-90f5-4ca0-b610-d4dded37e141] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0214 04:07:19.274506 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
helpers_test.go:344: "netcat-56589dfd74-tq96q" [90ff1927-90f5-4ca0-b610-d4dded37e141] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 12.00543906s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (12.33s)
=== RUN TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run: kubectl --context kindnet-528898 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.19s)
=== RUN TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run: kubectl --context kindnet-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.16s)
=== RUN TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run: kubectl --context kindnet-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.14s)
=== RUN TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run: kubectl --context auto-528898 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.19s)
=== RUN TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run: kubectl --context auto-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.17s)
=== RUN TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run: kubectl --context auto-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.15s)
=== RUN TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p custom-flannel-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=kvm2 --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-flannel-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=kvm2 --container-runtime=crio: (1m28.830476891s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (88.83s)
=== RUN TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p enable-default-cni-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=kvm2 --container-runtime=crio
E0214 04:08:01.345471 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=kvm2 --container-runtime=crio: (2m14.411621749s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (134.41s)
=== RUN TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-gk7mb" [505e6da8-b1f8-4f41-b4d1-6cb8d1480722] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.008265453s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)
=== RUN TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p calico-528898 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.29s)
=== RUN TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context calico-528898 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-wng55" [040ee644-815f-4b51-8ea2-10a579cd6db3] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-wng55" [040ee644-815f-4b51-8ea2-10a579cd6db3] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 12.00593619s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (12.34s)
=== RUN TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run: kubectl --context calico-528898 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.21s)
=== RUN TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run: kubectl --context calico-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.18s)
=== RUN TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run: kubectl --context calico-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.19s)
=== RUN TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p custom-flannel-528898 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.48s)
=== RUN TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context custom-flannel-528898 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-lbq9p" [21acf127-0882-486d-b349-1b7f1b3d96e7] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-lbq9p" [21acf127-0882-486d-b349-1b7f1b3d96e7] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 12.015274667s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (12.39s)
=== RUN TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p flannel-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=kvm2 --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p flannel-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=kvm2 --container-runtime=crio: (1m32.215824916s)
--- PASS: TestNetworkPlugins/group/flannel/Start (92.22s)
=== RUN TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run: kubectl --context custom-flannel-528898 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.25s)
=== RUN TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run: kubectl --context custom-flannel-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.18s)
=== RUN TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run: kubectl --context custom-flannel-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.23s)
=== RUN TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p bridge-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=kvm2 --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p bridge-528898 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=kvm2 --container-runtime=crio: (1m59.910547282s)
--- PASS: TestNetworkPlugins/group/bridge/Start (119.91s)
=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-960884 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0
E0214 04:09:58.298249 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-960884 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0: (2m49.783989442s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (169.78s)
=== RUN TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p enable-default-cni-528898 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.25s)
=== RUN TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context enable-default-cni-528898 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-h8srv" [aa01be11-c119-4424-9aae-0297e48fc79e] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-h8srv" [aa01be11-c119-4424-9aae-0297e48fc79e] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 11.006078838s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.24s)
=== RUN TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run: kubectl --context enable-default-cni-528898 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.27s)
=== RUN TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run: kubectl --context enable-default-cni-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.25s)
=== RUN TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run: kubectl --context enable-default-cni-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.19s)
=== RUN TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p no-preload-527067 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-527067 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.29.0-rc.2: (2m20.133726267s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (140.13s)
=== RUN TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-v6qxj" [ec0225b8-f42e-4dac-8bcb-d8d5a48151f1] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.005263213s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)
=== RUN TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p flannel-528898 "pgrep -a kubelet"
E0214 04:10:56.222782 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.27s)
=== RUN TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context flannel-528898 replace --force -f testdata/netcat-deployment.yaml
net_test.go:149: (dbg) Done: kubectl --context flannel-528898 replace --force -f testdata/netcat-deployment.yaml: (2.403741717s)
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-d7dz4" [c5bb43df-1b3c-45b4-a5fb-869983fd2c1b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-d7dz4" [c5bb43df-1b3c-45b4-a5fb-869983fd2c1b] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 12.005486819s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (14.50s)
=== RUN TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run: kubectl --context flannel-528898 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.20s)
=== RUN TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run: kubectl --context flannel-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.17s)
=== RUN TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run: kubectl --context flannel-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.16s)
=== RUN TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-722906 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-722906 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.4: (1m49.557664239s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (109.56s)
=== RUN TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p bridge-528898 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)
=== RUN TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context bridge-528898 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-7dl24" [03c88230-64ee-402c-805f-353a4f2399ea] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-7dl24" [03c88230-64ee-402c-805f-353a4f2399ea] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 12.006494479s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (12.42s)
=== RUN TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run: kubectl --context bridge-528898 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.20s)
=== RUN TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run: kubectl --context bridge-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.17s)
=== RUN TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run: kubectl --context bridge-528898 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.19s)
E0214 04:40:39.276514 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 04:40:50.025051 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
=== RUN TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p default-k8s-diff-port-224675 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.4
E0214 04:12:09.289112 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:09.294391 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:09.304667 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:09.325019 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:09.365556 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:09.445947 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:09.606801 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:09.927948 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:10.569111 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:11.849894 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:14.410127 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:17.490265 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:17.495563 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:17.505893 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:17.526254 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:17.566613 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:17.647009 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:17.807367 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:18.127573 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:18.768090 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:19.531002 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:20.048490 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:22.609144 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:27.730049 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:12:29.771214 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:12:36.659970 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-224675 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.4: (1m38.37308979s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (98.37s)
=== RUN TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run: kubectl --context old-k8s-version-960884 create -f testdata/busybox.yaml
E0214 04:12:37.970574 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) Done: kubectl --context old-k8s-version-960884 create -f testdata/busybox.yaml: (1.233760149s)
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [7e353c8e-c3d3-44a9-a78c-58bc30c66f27] Pending
helpers_test.go:344: "busybox" [7e353c8e-c3d3-44a9-a78c-58bc30c66f27] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [7e353c8e-c3d3-44a9-a78c-58bc30c66f27] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 8.004833351s
start_stop_delete_test.go:196: (dbg) Run: kubectl --context old-k8s-version-960884 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.42s)
=== RUN TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-960884 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run: kubectl --context old-k8s-version-960884 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.02s)
=== RUN TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run: kubectl --context no-preload-527067 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [0deaf0f2-b91b-40b8-b087-51b92894c7eb] Pending
helpers_test.go:344: "busybox" [0deaf0f2-b91b-40b8-b087-51b92894c7eb] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
E0214 04:12:58.451384 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
helpers_test.go:344: "busybox" [0deaf0f2-b91b-40b8-b087-51b92894c7eb] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 8.005403449s
start_stop_delete_test.go:196: (dbg) Run: kubectl --context no-preload-527067 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (8.32s)
=== RUN TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p no-preload-527067 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p no-preload-527067 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.007166199s)
start_stop_delete_test.go:215: (dbg) Run: kubectl --context no-preload-527067 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.08s)
=== RUN TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run: kubectl --context embed-certs-722906 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [2a7def5f-8196-48a1-84a8-f91ea79dc5b8] Pending
helpers_test.go:344: "busybox" [2a7def5f-8196-48a1-84a8-f91ea79dc5b8] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [2a7def5f-8196-48a1-84a8-f91ea79dc5b8] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.004780651s
start_stop_delete_test.go:196: (dbg) Run: kubectl --context embed-certs-722906 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (8.33s)
=== RUN TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-722906 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-722906 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.132134874s)
start_stop_delete_test.go:215: (dbg) Run: kubectl --context embed-certs-722906 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.21s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run: kubectl --context default-k8s-diff-port-224675 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [7a966e85-ff0d-4240-9a1e-0cd8931223ce] Pending
helpers_test.go:344: "busybox" [7a966e85-ff0d-4240-9a1e-0cd8931223ce] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [7a966e85-ff0d-4240-9a1e-0cd8931223ce] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.005204541s
start_stop_delete_test.go:196: (dbg) Run: kubectl --context default-k8s-diff-port-224675 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.31s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-224675 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-224675 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.142283028s)
start_stop_delete_test.go:215: (dbg) Run: kubectl --context default-k8s-diff-port-224675 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.22s)
=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-960884 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-960884 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0: (13m0.173827464s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-960884 -n old-k8s-version-960884
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (780.47s)
=== RUN TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p no-preload-527067 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.29.0-rc.2
E0214 04:15:39.942461 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:15:46.075143 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-527067 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.29.0-rc.2: (11m3.830339546s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-527067 -n no-preload-527067
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (664.11s)
=== RUN TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-722906 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.4
E0214 04:16:00.267276 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-722906 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.4: (9m53.353918244s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-722906 -n embed-certs-722906
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (593.64s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p default-k8s-diff-port-224675 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.4
E0214 04:16:27.035935 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:16:30.988605 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:16:31.957819 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:31.963088 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:31.973338 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:31.993628 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:32.033973 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:32.114372 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:32.274864 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:32.595500 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:33.236463 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:34.517049 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:36.540586 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:16:37.077340 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:42.198380 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:16:52.439535 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:17:01.862913 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:17:09.288495 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:17:11.949996 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:17:12.920726 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:17:17.489593 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:17:36.973977 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:17:45.172664 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:17:48.956887 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:17:53.881700 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:18:33.871173 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:18:52.697515 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:19:15.802396 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:19:18.020770 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:19:20.381131 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:19:45.704009 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:19:58.298106 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 04:20:05.113032 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:20:32.797668 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
E0214 04:20:50.025838 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:20:56.222570 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 04:21:13.611450 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 04:21:17.711394 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/flannel-528898/client.crt: no such file or directory
E0214 04:21:31.958003 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:21:59.642911 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/bridge-528898/client.crt: no such file or directory
E0214 04:22:09.288345 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/kindnet-528898/client.crt: no such file or directory
E0214 04:22:17.489844 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/auto-528898/client.crt: no such file or directory
E0214 04:23:52.698514 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/calico-528898/client.crt: no such file or directory
E0214 04:23:59.275457 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
E0214 04:24:18.020413 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/custom-flannel-528898/client.crt: no such file or directory
E0214 04:24:41.346518 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 04:24:58.298449 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 04:25:05.113614 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-224675 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.28.4: (9m21.806742456s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-224675 -n default-k8s-diff-port-224675
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (562.11s)
=== RUN TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p newest-cni-050621 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.29.0-rc.2
E0214 04:39:58.298790 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
E0214 04:40:05.113229 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/enable-default-cni-528898/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-050621 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.29.0-rc.2: (58.866228307s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (58.87s)
=== RUN TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-050621 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-050621 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.484827125s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.49s)
=== RUN TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run: out/minikube-linux-amd64 stop -p newest-cni-050621 --alsologtostderr -v=3
E0214 04:40:56.222464 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/addons-800005/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-050621 --alsologtostderr -v=3: (11.39364222s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (11.39s)
=== RUN TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-050621 -n newest-cni-050621
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-050621 -n newest-cni-050621: exit status 7 (82.466149ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p newest-cni-050621 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.22s)
=== RUN TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-amd64 start -p newest-cni-050621 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.29.0-rc.2
E0214 04:41:13.611821 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/functional-262041/client.crt: no such file or directory
E0214 04:41:21.347482 1494692 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-1487441/.minikube/profiles/ingress-addon-legacy-791930/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-050621 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.29.0-rc.2: (39.687163405s)
start_stop_delete_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-050621 -n newest-cni-050621
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (39.96s)
=== RUN TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run: out/minikube-linux-amd64 -p newest-cni-050621 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230809-80a64d96
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.29s)
=== RUN TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 pause -p newest-cni-050621 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-050621 -n newest-cni-050621
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-050621 -n newest-cni-050621: exit status 2 (264.719748ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-050621 -n newest-cni-050621
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-050621 -n newest-cni-050621: exit status 2 (250.123482ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 unpause -p newest-cni-050621 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-050621 -n newest-cni-050621
start_stop_delete_test.go:311: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-050621 -n newest-cni-050621
--- PASS: TestStartStop/group/newest-cni/serial/Pause (2.59s)
=== RUN TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)
=== RUN TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)
=== RUN TestDownloadOnly/v1.28.4/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.4/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.28.4/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.4/binaries (0.00s)
=== RUN TestDownloadOnly/v1.28.4/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.4/kubectl (0.00s)
=== RUN TestDownloadOnly/v1.29.0-rc.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.29.0-rc.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/binaries (0.00s)
=== RUN TestDownloadOnly/v1.29.0-rc.2/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/kubectl (0.00s)
=== RUN TestDownloadOnlyKic
aaa_download_only_test.go:220: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)
=== RUN TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm
=== CONT TestAddons/parallel/Olm
addons_test.go:498: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)
=== RUN TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing crio
--- SKIP: TestDockerFlags (0.00s)
=== RUN TestDockerEnvContainerd
docker_test.go:170: running with crio false linux amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)
=== RUN TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)
=== RUN TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)
=== RUN TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv
=== CONT TestFunctional/parallel/DockerEnv
functional_test.go:459: only validate docker env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)
=== RUN TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv
=== CONT TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:90: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:90: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/WaitService
functional_test_tunnel_test.go:90: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/WaitService (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:90: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:90: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:90: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:90: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.01s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:90: password required to execute 'route', skipping testTunnel: exit status 1
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.01s)
=== RUN TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)
=== RUN TestImageBuild
image_test.go:33:
--- SKIP: TestImageBuild (0.00s)
=== RUN TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)
=== RUN TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)
=== RUN TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)
=== RUN TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)
=== RUN TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)
=== RUN TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)
=== RUN TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing crio container runtime
--- SKIP: TestSkaffold (0.00s)
=== RUN TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)
=== RUN TestMissingContainerUpgrade
version_upgrade_test.go:284: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)
=== RUN TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as crio container runtimes requires CNI
panic.go:523:
----------------------- debugLogs start: kubenet-528898 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-528898
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-528898
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /etc/hosts:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /etc/resolv.conf:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-528898
>>> host: crictl pods:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: crictl containers:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> k8s: describe netcat deployment:
error: context "kubenet-528898" does not exist
>>> k8s: describe netcat pod(s):
error: context "kubenet-528898" does not exist
>>> k8s: netcat logs:
error: context "kubenet-528898" does not exist
>>> k8s: describe coredns deployment:
error: context "kubenet-528898" does not exist
>>> k8s: describe coredns pods:
error: context "kubenet-528898" does not exist
>>> k8s: coredns logs:
error: context "kubenet-528898" does not exist
>>> k8s: describe api server pod(s):
error: context "kubenet-528898" does not exist
>>> k8s: api server logs:
error: context "kubenet-528898" does not exist
>>> host: /etc/cni:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: ip a s:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: ip r s:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: iptables-save:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: iptables table nat:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-528898" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-528898" does not exist
>>> k8s: kube-proxy logs:
error: context "kubenet-528898" does not exist
>>> host: kubelet daemon status:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: kubelet daemon config:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> k8s: kubelet logs:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-528898
>>> host: docker daemon status:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: docker daemon config:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: docker system info:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: cri-docker daemon status:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: cri-docker daemon config:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: cri-dockerd version:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: containerd daemon status:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: containerd daemon config:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: containerd config dump:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: crio daemon status:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: crio daemon config:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: /etc/crio:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
>>> host: crio config:
* Profile "kubenet-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-528898"
----------------------- debugLogs end: kubenet-528898 [took: 4.020162773s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-528898" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubenet-528898
--- SKIP: TestNetworkPlugins/group/kubenet (4.19s)
=== RUN TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:523:
----------------------- debugLogs start: cilium-528898 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-528898
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-528898
>>> host: /etc/nsswitch.conf:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /etc/hosts:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /etc/resolv.conf:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-528898
>>> host: crictl pods:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: crictl containers:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> k8s: describe netcat deployment:
error: context "cilium-528898" does not exist
>>> k8s: describe netcat pod(s):
error: context "cilium-528898" does not exist
>>> k8s: netcat logs:
error: context "cilium-528898" does not exist
>>> k8s: describe coredns deployment:
error: context "cilium-528898" does not exist
>>> k8s: describe coredns pods:
error: context "cilium-528898" does not exist
>>> k8s: coredns logs:
error: context "cilium-528898" does not exist
>>> k8s: describe api server pod(s):
error: context "cilium-528898" does not exist
>>> k8s: api server logs:
error: context "cilium-528898" does not exist
>>> host: /etc/cni:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: ip a s:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: ip r s:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: iptables-save:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: iptables table nat:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-528898
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-528898
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-528898" does not exist
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-528898" does not exist
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-528898
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-528898
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-528898" does not exist
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-528898" does not exist
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-528898" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-528898" does not exist
>>> k8s: kube-proxy logs:
error: context "cilium-528898" does not exist
>>> host: kubelet daemon status:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: kubelet daemon config:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> k8s: kubelet logs:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-528898
>>> host: docker daemon status:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: docker daemon config:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /etc/docker/daemon.json:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: docker system info:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: cri-docker daemon status:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: cri-docker daemon config:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: cri-dockerd version:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: containerd daemon status:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: containerd daemon config:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /etc/containerd/config.toml:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: containerd config dump:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: crio daemon status:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: crio daemon config:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: /etc/crio:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
>>> host: crio config:
* Profile "cilium-528898" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-528898"
----------------------- debugLogs end: cilium-528898 [took: 4.486680866s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-528898" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cilium-528898
--- SKIP: TestNetworkPlugins/group/cilium (4.65s)
=== RUN TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts
=== CONT TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-648156" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p disable-driver-mounts-648156
--- SKIP: TestStartStop/group/disable-driver-mounts (0.18s)